Are we testing what we think we are? A multi-site investigation of typed and handwritten L2 Chinese writing assessments
Date
2025-02-01
Authors
Contributor
Advisor
Department
Instructor
Depositor
Speaker
Researcher
Consultant
Interviewer
Narrator
Transcriber
Annotator
Journal Title
Journal ISSN
Volume Title
Publisher
University of Hawaii National Foreign Language Resource Center
Center for Language & Technology
Center for Language & Technology
Volume
29
Number/Issue
2
Starting Page
190
Ending Page
221
Alternative Title
Abstract
The extent to which writing modality (i.e., hand-writing vs. keyboarding) impacts second-language (L2) writing assessment scores remains unclear. For alphabetic languages like English, research shows mixed results, documenting both equivalent and divergent scores between typed and handwritten tests (e.g., Barkaoui & Knouzi, 2018). However, for non-alphabetic languages like Chinese, typed responses consistently outscore handwritten ones across proficiency levels (e.g., Bourgerie et al., 2023; Liao, 2023; Zhang & Min, 2019; Zhu et al., 2016), and advanced proficiency groups. This study examined whether this scoring differential exists at the intermediate level. Writing samples were collected from 60 intermediate-level university L2 Chinese learners (N = 120), with counter-balanced prompts and modalities. Two certified raters used a three-criterion analytic rubric for scoring. A linear mixed-effects model showed that regardless of modality or prompt order, test takers produced more content and achieved higher scores on typed responses, even when controlling for language proficiency, multilingual experiences, and Chinese writing/typing habits. These findings suggest that handwritten and typed L2 Chinese test tasks may assess different constructs, carrying implications for various assessment contexts (classroom assessment, placement testing, proficiency tests) and assessment research.
Description
Keywords
Writing assessment, Modality, E-writing, Chinese, Less commonly taught languages
Citation
Coss, M. D. (2025). Are we testing what we think we are? A multi-site investigation of typed and handwritten L2 Chinese writing assessments. Language Learning & Technology, 29(2), 190–221. https://hdl.handle.net/10125/73616
Extent
31
Format
Geographic Location
Time Period
Related To
Related To (URI)
Table of Contents
Rights
Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License
Rights Holder
Local Contexts
Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.