Towards enhanced second language reading comprehension assessment: Computerized versus manual scoring of written recall protocols

Simple item page
dc.contributor.author Heinz, Peter J.
dc.date.accessioned 2020-05-22T02:00:00Z
dc.date.available 2020-05-22T02:00:00Z
dc.date.issued 2004-10
dc.description.abstract Second language (L2) reading comprehension assessment has long relied upon classical quantitative, product-oriented measurement techniques (i.e., multiple-choice and cloze) in both research and classroom assessment. As Bernhardt (1991) clearly demonstrated, these traditionally employed assessment methods are unable to capture the complex processes that take place between learner and text. The present paper has as its central purpose to enhance and extend the efficiency, consistency, and validity of an alternative measure, the immediate free recall protocol. Unlike the multiple choice or cloze tests, the recall protocol is a truly integrative authentic-task measure, firmly grounded on a constructivist model of reading comprehension. Given an understanding of the model, the literature base on memorial representation, and the formulation of a "weak-rule" scoring system, the present study demonstrates a computerized recall protocol scoring system that has high correlation with traditional manual scoring methods. The results further demonstrate that the computerized procedure provides efficiency in delivery and scoring, enhances consistency, is practical for large-scale assessment, and can lead to improved diagnostic and placement testing. Using this system as part of a multiple-measures approach, valid and reliable quantitative score information is readily available and directly linked to a qualitative database ripe for additional examination to advance L2 reading comprehension research and model development.
dc.identifier.doi 10125/66779
dc.identifier.issn 1539-0578
dc.identifier.uri http://hdl.handle.net/10125/66779
dc.publisher University of Hawaii National Foreign Language Resource Center
dc.publisher Center for Language & Technology
dc.subject reading comprehension
dc.subject assessment
dc.subject recall protocol
dc.subject computer based testing
dc.title Towards enhanced second language reading comprehension assessment: Computerized versus manual scoring of written recall protocols
dc.type Article
dc.type.dcmi Text
local.rfl.topic Research Methods
prism.endingpage 124
prism.number 2
prism.startingpage 97
prism.volume 16
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
16_2_10125_66779_heinz.pdf
Size:
82.41 KB
Format:
Adobe Portable Document Format
Description:
Download
Collections
Volume 16, No. 2