Generative AI Agents in Language Learning: A Randomized Field Experiment
Files
Date
2025-01-07
Contributor
Advisor
Department
Instructor
Depositor
Speaker
Researcher
Consultant
Interviewer
Narrator
Transcriber
Annotator
Journal Title
Journal ISSN
Volume Title
Publisher
Volume
Number/Issue
Starting Page
4946
Ending Page
Alternative Title
Abstract
Artificial Intelligence (AI) is revolutionizing education, particularly with advancements in generative AI conversational agents. Our study investigates the effectiveness of these generative AI agents in enhancing English-speaking skills compared to human agents. Through a randomized field experiment involving 363 participants, we found that unrestricted use of AI tools led to a 5.90% improvement in lexical diversity, as measured by the Type-Token Ratio (TTR), highlighting the benefits of self-paced learning. Notably, learners with below-average proficiency experienced a 9.53% improvement in TTR, suggesting AI's potential to bridge educational equity gaps. Moreover, AI tools significantly reduced evaluation apprehension, further enhancing learning outcomes. These findings underscore AI's capacity to provide personalized, anxiety-free learning environments, particularly for students with lower proficiency, and offer valuable insights for integrating AI into educational strategies to foster more inclusive learning experiences.
Description
Keywords
Generative Artificial Intelligence in Higher Education, evaluation apprehension, generative ai, language learning
Citation
Extent
10
Format
Geographic Location
Time Period
Related To
Proceedings of the 58th Hawaii International Conference on System Sciences
Related To (URI)
Table of Contents
Rights
Attribution-NonCommercial-NoDerivatives 4.0 International
Rights Holder
Local Contexts
Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.