Accounting for Traumatic Historical Events in Educational Randomized Controlled Trials

Abstract

As an example of how historical events may influence the findings and interpretations of a randomized trial, we use a school-based evaluation of a classroom management program that was conducted in a nearby district before and after the shooting of Michael Brown in Ferguson, Missouri (N = 102 teachers and 1,450 students). The findings suggest that the event differentially affected teacher and student response within and across conditions. Black teachers benefited more from the intervention as evidenced by their independently observed classroom management skills and praise-to-reprimand ratios; however, these effects were minimized or disappeared after the event. Additionally, although the intervention equally benefited the academic achievement of Black and White students before the event, the opportunity gap widened after the event. Implications for the design, analysis, and reporting of findings from randomized controlled trials are discussed. Supplemental data for this article is available online at http://dx.doi.org/10.1080/2372966X.2021.2024768 Impact Statement This cluster randomized trial conducted before and after the Michael Brown shooting revealed that historical events can differentially effect participants both within and across conditions. Moreover, findings suggest that the Black–White opportunity gap will not be reduced by schools alone.