Generative AI Agents in Language Learning: A Randomized Field Experiment

Simple item page
dc.contributor.authorCheon, Gyeombi
dc.contributor.authorChoi, Yunmin
dc.contributor.authorLee, Dongwon
dc.contributor.authorBaek, Jiye
dc.date.accessioned2024-12-26T21:08:41Z
dc.date.available2024-12-26T21:08:41Z
dc.date.issued2025-01-07
dc.description.abstractArtificial Intelligence (AI) is revolutionizing education, particularly with advancements in generative AI conversational agents. Our study investigates the effectiveness of these generative AI agents in enhancing English-speaking skills compared to human agents. Through a randomized field experiment involving 363 participants, we found that unrestricted use of AI tools led to a 5.90% improvement in lexical diversity, as measured by the Type-Token Ratio (TTR), highlighting the benefits of self-paced learning. Notably, learners with below-average proficiency experienced a 9.53% improvement in TTR, suggesting AI's potential to bridge educational equity gaps. Moreover, AI tools significantly reduced evaluation apprehension, further enhancing learning outcomes. These findings underscore AI's capacity to provide personalized, anxiety-free learning environments, particularly for students with lower proficiency, and offer valuable insights for integrating AI into educational strategies to foster more inclusive learning experiences.
dc.format.extent10
dc.identifier.doi10.24251/HICSS.2025.596
dc.identifier.isbn978-0-9981331-8-8
dc.identifier.other78aa3fe3-0967-44f1-88ea-0e443ed86ccf
dc.identifier.urihttps://hdl.handle.net/10125/109443
dc.relation.ispartofProceedings of the 58th Hawaii International Conference on System Sciences
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectGenerative Artificial Intelligence in Higher Education
dc.subjectevaluation apprehension, generative ai, language learning
dc.titleGenerative AI Agents in Language Learning: A Randomized Field Experiment
dc.typeConference Paper
dc.type.dcmiText
prism.startingpage4946

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
0485.pdf
Size:
556.67 KB
Format:
Adobe Portable Document Format
Download

Collections

Generative Artificial Intelligence in Higher Education