Please use this identifier to cite or link to this item: http://hdl.handle.net/10125/100362

Validating the scoring inference of the Japanese opi ratings : the use of extended turns, connective expressions, and discourse organization

File Description SizeFormat 
Tominaga_Waka_r.pdfVersion for non-UH users. Copying/Printing is not permitted3.03 MBAdobe PDFView/Open
Tominaga_Waka_uh.pdfVersion for UH users3.88 MBAdobe PDFView/Open

Item Summary

Title: Validating the scoring inference of the Japanese opi ratings : the use of extended turns, connective expressions, and discourse organization
Authors: Tominaga, Waka
Keywords: text type
Issue Date: Aug 2014
Publisher: [Honolulu] : [University of Hawaii at Manoa], [August 2014]
Abstract: Adopting Kane's (2006) argument-based approach to validity as a guiding framework, this study examined the scoring inference of the OPI ratings based on the level descriptions in the ACTFL Proficiency Guidelines, with a focus on the "text type" criterion. The Guidelines state that Intermediate speakers typically produce "sentences" while Advanced speakers are capable of using "connected discourse of paragraph length" (ACTFL, 2012c, pp. 5--8). However, there is little empirical evidence to support such characterizations. In an attempt to fill this gap, this conversation analytic study investigated the appropriateness of the text type criterion by examining how Intermediate and Advanced candidates participated in turn-taking in the OPI and responded to the OPI's narration and description tasks, which were designed to elicit a "connected discourse of paragraph length." The focal data consisted of audio/video recordings of 15 face-to-face Japanese OPIs. From a larger pool of OPI data collected for program assessment research by the College of Languages, Linguistics, and Literature at the University of Hawaiʻi at Mānoa, three OPIs for each of the five (sub)levels ranging from Intermediate-Low to Advanced-Mid were randomly selected and transcribed. The study found that while the candidates at higher proficiency levels tended to demonstrate superior ability to use connective expressions in their discourse, the level descriptions concerning the text type criterion did not necessarily match actual candidate performance, especially for the lower proficiency levels (Intermediate-Low/Mid). The problems seemed to reside in the Guidelines' failure to recognize the candidates' interactional competence to produce sequentially appropriate actions in an orderly manner, as well as the use of units of analysis for writing (e.g., sentences, paragraphs) to describe oral proficiency. Further research is called for in order to collect more empirical evidence to inform future revisions of the Guidelines.
Description: Ph.D. University of Hawaii at Manoa 2014.
Includes bibliographical references.
URI/DOI: http://hdl.handle.net/10125/100362
Rights: All UHM dissertations and theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission from the copyright owner.
Appears in Collections:Ph.D. - East Asian Languages and Literatures (Japanese)



Items in ScholarSpace are protected by copyright, with all rights reserved, unless otherwise indicated.