Linking via Pseudo‐Equivalent Group Design: Methodological Considerations and an Application to the PISA and PIAAC Assessments

Abstract

AbstractThis article presents the pseudo‐equivalent group approach and discusses how it can enhance the quality of linking in the presence of nonequivalent groups. The pseudo‐equivalent group approach allows to achieve pseudo‐equivalence using propensity score reweighting techniques. We use it to perform linking to establish scale concordance between two assessments. The article presents Monte‐Carlo simulations and a real data application based on data from the Survey of Adult Skills (PIAAC) and the Programme for International Student Assessment (PISA). Monte‐Carlo simulations suggest that the pseudo‐equivalent group design is particularly useful whenever there is a large overlap across the two groups with respect to balancing variables and when the correlation between such variables and ability is medium or high. The example based on PISA and PIAAC data indicates that the approach can provide reasonable accurate linking that can be used for group‐level comparisons.