Error analysis of raven test performance

Abstract

Two studies were performed concerned with error analyses of matrix analogy problems. In the first study information concealed in the incorrect response alternatives of the Standard Progressive Matrices (SPM) was used to find out what kinds of errors are committed when children ( n = 1655, age range 8.5–12.5 years) make incorrect response choices. The error analysis of the SPM showed that omitting solution rules is a major cause of incorrect responses and that post-hoc error classification of the alternatives was problematic. In the second study, Experimental Progressive Matrices (EPM) were constructed, based on five solution rules, with an a priori notion regarding variation in rule complexity. Response alternatives were constructed thus, that from incorrect choices the number and kinds of rules omitted could be deduced. Children ( n = 200, age range 8.5–12.5 years) completed the paper and pencil version of the SPM and EPM. Both tests yielded the same test scores. Errors were most often due to omitting one rule. Lower scoring children were particularly apt to omit complex rules. Further development of the EPM is needed to obtain a Raven like test which can give insight into how a child acquires a particular test score.