Comprehensibility of AI-generated and human simplified texts for L2 learners

Abstract

There is currently limited investigation of readers’ comprehension of AI simplified text from the perspective of educators, but such research can help to more effectively address the specific needs and perspectives of language teachers and learners regarding the comprehensibility of AI simplified text. Therefore, the purpose of this study was to compare second language readers’ comprehension of an original reading passage, a version that was simplified by human experts, and a version that was automatically simplified by AI. Results showed that the AI and human simplified texts were not any easier to comprehend than the original version of the text when readers’ topic familiarity was taken into account in the analysis. These findings suggest that AI-generated simplified text does not yet improve L2 learners' comprehension. Thus, further study is needed on the effect of AI simplifications using learner-centered qualitative assessments like think aloud to assess the efficacy of simplified texts. These findings also serve as a reminder to researchers and teachers that they must carefully evaluate AI tools before attempting to apply them to instructional practice.