Identifying baseline and ceiling thresholds within the Qualistar Early Learning Quality Rating and Improvement System

Abstract

Increasingly, states are implementing quality rating and improvement systems (QRIS) as a means of improving the availability of high-quality child care and children's school readiness skills. A fundamental design decision under QRIS is where to set the thresholds on the quality measures used in the program assessment component of the QRIS. This study applied generalized additive modeling (GAM) on data from Colorado's QRIS in order to identify thresholds on several components of Colorado's QRIS, including the Early Childhood Environment Rating Scale-Revised (ECERS-R), classroom ratios, and staff credentials. We found evidence of baseline thresholds that needed to be surpassed before significant relationships between quality and outcomes could be observed. In addition, there were ceiling thresholds, such that beyond certain cut-points, gains in quality were associated with little to no improvements in outcomes. Based on this work, it appears that GAM can be used to empirically identify thresholds, but more research is needed to understand the applicability of the GAM-derived thresholds in other early care contexts and settings.