Multistage Test Design Considerations in International Large-Scale Assessments of Educational Achievement

Abstract

Numerous choices exist for designing and implementing a multistage test (MST) for dozens of heterogeneous educational systems internationally. In this chapter, we review recent research that focuses on MST in an international large-scale assessment (ILSA) context. To do so, we first describe the inherent heterogeneity and associated measurement challenges of ILSAs, describing how MST offers a means for tailoring assessments to better measure the full achievement distribution while minimizing test burden. We then emphasize design choices and how these impact item and person parameter estimates as well as item exposure rates. We also discuss the tension between fully realizing the promise of an MST design with the primacy of stable trend estimates. Specifically, we discuss the design choices with respect to the structure of MST and panels, related routing decisions within MST, routing methods, module lengths, and position effects.KeywordsMulti-stage testingAdaptive testingInternational large-scale assessment design