Automated versus peer assessment: Effects of learners' English public speaking
Date
2024-06-01
Contributor
Advisor
Department
Instructor
Depositor
Speaker
Researcher
Consultant
Interviewer
Narrator
Transcriber
Annotator
Journal Title
Journal ISSN
Volume Title
Publisher
University of Hawaii National Foreign Language Resource Center
Center for Language & Technology
Center for Language & Technology
Volume
28
Number/Issue
2
Starting Page
210
Ending Page
228
Alternative Title
Abstract
This quasi-experimental research investigates the employment of a formative assessment platform aided by artificial intelligence in an English public speaking course. The platform integrates deep learning, automatic speech recognition, and automatic writing evaluation. It provides automated assessment and immediate feedback on speakers’ public speaking anxiety and their speaking and writing competence. Fifty-two English public speaking learners were randomly assigned to two groups. The control group (G1) undertook self-, peer, and teacher assessment via the platform, while the experimental group (G2) experienced self-, automated, and teacher assessment. The ANCOVA results revealed that students in G1 perceived significantly higher social engagement than those in G2, which indicates that social interaction between learners during peer assessment cannot be substituted by automated assessment. The chi-square analysis showed students’ different concerns regarding online formative assessment. While students in G1 showed concerns for peers’ qualifications and willingness to provide feedback, students in G2 suggested generating more detailed automated feedback to improve self-learning. No significant differences were found in learners’ English public speaking self-efficacy, engagement, or competence. This indicates that automated assessment can serve as an effective strategy for formative assessment and that AI tools may supplement peers as reliable learning companions in the foreseeable future.
Description
Keywords
Automated Assessment, Peer Assessment, English Public Speaking, Learner Engagement, Self-efficacy
Citation
Zheng, C., Chen, X., Zhang, H., & Chai, C. S (2024). Automated versus peer assessment: Effects on learners’ English public speaking. Language Learning & Technology, 28(2), 210–228. https://hdl.handle.net/10125/73577
Extent
228
Format
Geographic Location
Time Period
Related To
Related To (URI)
Table of Contents
Rights
Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License
Rights Holder
Local Contexts
Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.