Exploring AI-Generated text in student writing: How does AI help?

Files

28_02_10125-73577.pdf (3.81 MB)

Date

2024-06-01

Authors

Contributor

Advisor

Department

Instructor

Depositor

Speaker

Researcher

Consultant

Interviewer

Narrator

Transcriber

Annotator

Journal Title

Journal ISSN

Volume Title

Publisher

University of Hawaii National Foreign Language Resource Center
Center for Language & Technology

Volume

28

Number/Issue

2

Starting Page

183

Ending Page

209

Alternative Title

Abstract

English as a foreign language (EFL) students’ use of artificial intelligence (AI) tools that generate human-like text may enhance students’ written work. However, the extent to which students use AI-generated text to complete a written composition and how AI-generated text influences the overall writing quality remain uncertain. 23 Hong Kong secondary school students wrote stories with AI-writing tools, integrating their own words and AI-generated text into the stories. We analyzed the basic structure, organization, and syntactic complexity of each story and its AI-generated text. Experts scored the quality of each story’s content, language, and organization. By employing multiple linear regression and cluster analyses, we found that both the number of human words and the number of AI-generated words significantly contributed to writing scores. Furthermore, students could be classified into competent and less competent writers based on the variations of students’ usage of AI-generated text compared to their peers. Cluster analyses revealed some benefit of AI-generated text in improving the scores of both high-scoring students’ and low-scoring students’ writing. We suggest differentiated, pedagogical strategies for EFL students to effectively use AI-writing tools and AI-generated text to complete writing tasks.

Description

Keywords

Artificial Intelligence, Natural Language Generation, Creative Writing, Short Stories

Citation

Woo, D. J., Susanto, H., Yeung, C. H., Guo, K., & Fung, A. K. Y. (2024). Exploring AI-Generated text in student writing: How does AI help? Language Learning & Technology, 28(2), 183–209. https://hdl.handle.net/10125/73577

URI

https://hdl.handle.net/10125/73577

Extent

209

Format

Geographic Location

Time Period

Related To

Related To (URI)

Table of Contents

Rights

Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License

Rights Holder

Local Contexts

Collections

Volume 28 Number 2, June 2024 Special Issue: Artificial Intelligence for Language Learning
Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.