Classical test theory and item response theory: Two understandings of one high-stakes performance exam

Abstract

Language testing professionals as well as teacher educators have articulated the need for a broad variety stakeholders, including classroom teachers, to develop assessment literacy. In this paper we argue that when teachers are involved in local development projects, they have the opportunity—and the need—to expand their assessment knowledge and skills beyond what is necessary for conducting principled classroom assessments. We further claim that a particular analytic approach, Rasch analysis, should be considered a possible element of this expanded assessment literacy. To this end, we use placement exam data from one Colombian university to illustrate how Rasch analysis differs from—and can usefully complement—classical test theory.