Does the test work? Evaluating a web-based language placement test

Abstract

In response to the need for examples of test validation from which everyday language programs can benefit, this paper reports on a study that used Bachman’s (2005) assessment use argument (AUA) framework to examine evidence to support claims made about the intended interpretations and uses of scores based on a new web-based Spanish language placement test. The test, which consisted of 100 items distributed across five item types (sound discrimination, grammar, listening comprehension, reading comprehension, and vocabulary), was tested with 2,201 incoming first-year and transfer students at a large, Midwestern public university. Analyses of internal consistency and validity revealed the test to be reliable and valid with regard to its functionality, the content covered on the exam, and the consistency with which placement decisions could be made. Findings are discussed in light of the AUA model developed for the placement test, and practical suggestions for university-level language program instructors and testing administrators are outlined.