ScholarSpace will be brought offline for upgrades on Wednesday December 9th at 11AM HST. Service will be disrupted for approximately 2 hours. Please direct any questions to

Item Description

Show full item record

Title: Abridged Estimate of Inter-rater Reliability in ELI Writing Assessment 
Author: Koyama, Dennis; Silver, Dan
Date: 2006
Abstract: The current study investigates the reliability estimates of the newly adopted writing placement test at ELI. To examine whether three raters’ judgment on learner level were consistent enough to justify the placement, statistical reliability measures such as Cronbach’s alpha, Standard Error of Measurement, and Correlation coefficients were adopted. The analysis of the consistencies among raters revealed that although generally the placement results were consistent among raters, several limitations were found. For example, frequent rater inconsistencies were found and oral report seemed to reveal high variability in their first decision and their final report. Further suggestions to improve inter-rater reliability are presented.
Pages/Duration: 15 pages
Keywords: placement test, writing assessment, inter-rater reliability, test reliability, L2 writing

Item File(s)

Files Size Format View
Koyama and Silver2006.pdf 346.3Kb PDF View/Open

This item appears in the following Collection(s)


Advanced Search


My Account