Investigating the measurement of academic resilience in Aotearoa New Zealand using international large-scale assessment data

Abstract

Academic resilience captures academic success despite adversity and thus is an important concept for promoting equity within education. However, our understanding of how and why rates of academic resilience differ between contexts is currently limited by variation in the ways that the construct has been operationalised in quantitative research. Similarly, comparing the strength of protective factors that promote academic resilience is hindered by differing approaches to the measurement of academic resilience. This methodological variation has complicated attempts to reconcile disparate findings about academic resilience. The current study applied six commonly used operationalisations of academic resilience that combined different thresholds of high risk and high achievement, to three international large-scale assessments, to explore how these different operationalisations impacted the findings produced. The context of Aotearoa New Zealand was chosen as a case study to further academic resilience research within this context and investigate how academic resilience manifests in an education system with relatively high levels of average achievement alongside low levels of educational equity. Within international large-scale assessment datasets, prevalence rates differed markedly across subject areas, grade levels, and collection cycles, as a function of the measure of academic resilience employed, while the strength of protective factors was more consistent. Thresholds that were norm-referenced produced more consistent findings across the different datasets compared to thresholds that were criterion-referenced. High levels of missing data prevented the analysis of some datasets, and differences in the way that key constructs were measured undermined the comparability of findings across international large-scale assessments. The findings emphasise the strengths and limitations of utilising international large-scale assessment data for the study of academic resilience, particularly within the Aotearoa New Zealand context. Furthermore, the study highlights that researchers’ methodological decisions have important impacts on the conclusions drawn about academic resilience.