A snapshot of g? Binary and polytomous item-response theory investigations of the last series of the Standard Progressive Matrices (SPM-LS)

Abstract

Raven’s progressive matrices (Raven, 1941) are extremely popular measures of general mental ability. However, their length may not suit every researcher’s or practitioner’s needs. Short versions of the Advanced version have resulted in problematic factor structures and internal consistencies (Arthur, Tubre, Paul, & Sanchez-Ku, 1999; Bors & Stokes, 1998): Is the last series of the Standard Progressive Matrices a more viable option? The aim of this research was to investigate the structural validity and internal reliability of the last series of the SPM (SPM-LS) as a standalone measure. The SPM-LS binary (correct/incorrect) responses of 499 undergraduate students were investigated through unidimensional Item-Response Theory (IRT) 1–4 Parameter Logistic (PL) models. They were satisfactorily modeled by unidimensional models (CFI3PL = 0.974, TLI3PL = 0.959, RMSEA3PL = 0.059, SRMR3PL = 0.056), offering good empirical reliability (rxx′,3PL = 0.843), and outperforming the short Advanced Progressive Matrices’ previously reported qualities. Full nominal responses – recovering information from the distractor responses – were further examined with recently introduced 2–4 Parameter Logistic Nested (PLN) models (Suh & Bolt, 2010), providing significant reliability gains (Δrxx′ = 0.029, Bootstrapped 95% CI [0.019, 0.036], z = 6.06, p < .001). Uses, limitations, conditional reliability and scoring strategies are further examined and discussed.