Item Response Theory and Measuring Abilities

Abstract

Ability measurement changed greatly at the end of the last century. Classical test theory (CTT) methods guided measurement for most of the last century. CTT methods are based on large sampling norms, fixed length tests, and ordinal level measurement scales. Here, a person's ability performance is based on relative standing among a population of individuals for a given test. However, a person's performance, or its change, relative to a person's performance on a particular item is not well incorporated. Ability measurement and test theory have evolved into newer methods. These newer approaches, known as item response theory (IRT) methods, are replacing CTT techniques. In IRT methods, person performance may be referenced to specific item parameters, as well as to relative standing in a population of persons. Persons can receive different tests measuring the same unidimensional trait, of varying lengths, and still be meaningfully compared, given that the tests are linked or equated. The scale of measurement for IRT is interval-level, so relative score levels and their change are weighted accordingly. In this chapter, both classical and item response theory approaches will be covered, and each method's strengths and weaknesses discussed. Keywords: ability measurement; classical test theory; item response theory; test theory