Can Policy Promote Adoption or Outcomes of Evidence-based Prevention Programming?: a Case Illustration of Positive Behavioral Interventions and Supports.

Abstract

This study examined the impact of a state policy requiring that any school with a habitual truancy rate of 8% or higher to be trained in Tier 1 school-wide Positive Behavioral Interventions and Supports (SW-PBIS). A regression discontinuity (RD) design was used to examine how the schools' mandate status related to SW-PBIS training as well as student suspensions, truancy, and achievement in 410 public middle and high schools, of which 261 were affected by the mandate. We further examined the growth trajectories (i.e., improvement) of implementation fidelity over time using growth mixture modeling (GMM). Contrary to the intent of the policy to improve student outcomes, the RD results suggestedthat the mandate did not significantlyimpact reading and math achievement, truancy rates, or SW-PBIS training in 2010-2011 through 2013-2014. Mandated schools had higher suspension rates in 2010-2011 through 2013-2014 than the non-mandated schools; however, these differences in the suspension rates appear to have persisted from years prior to the mandate. Descriptive analyses suggested that mandated schools had statistically significantly higher rates of training, and the GMM analyses on the fidelity data indicated that mandated schools were significantly more likely to be in an improving implementationgrowth trajectory over time. Taken together, results suggested that the policy showed some promise for improving SW-PBIS training and fidelity over time, but it had little to no impact on student outcomes.