TOOLBOX Effects on K-2 Student Growth in Social-Emotional Competence: Evidence from a Quasi-Experimental Study

Abstract

TOOLBOX is a school-based social and emotional learning (SEL) program to teach and reinforce 12 tools (e.g., Breathing Tool, Courage Tool) for healthy youth development. Although TOOLBOX has been broadly adopted, it remains largely untested. This quasi-experimental study aims to examine the relationship between TOOLBOX implementation and the growth of social-emotional competence (SEC) among K-2 students. First, we compare the growth trajectories of SEC between TOOLBOX and non-TOOLBOX conditions during one academic year. Then, within the TOOLBOX condition, we compare two implementation directives—TOOLBOX Standard and TOOLBOX Primer—to assess (a) the extent to which TOOLBOX was implemented and (b) the SEC growth trajectories among youth. Two district schools were given an implementation directive and materials to implement TOOLBOX Standard curriculum (full, structured lesson plans and strategies with higher dosage anticipated), and two district schools to implement TOOLBOX Primer (basic, introductory lesson plans and strategies with lower dosage anticipated). There were no dosage benchmarks available for either condition. Two additional district schools practiced as usual (non-TOOLBOX). The study sample consisted of 1766 K-2 students and their 80 classroom teachers. Student SEC was measured three times using the Devereux Student Strengths Assessment-Mini, a teacher-completed brief behavioral rating scale. Implementation dosage and quality were measured three times using teacher self-reports. Latent growth modeling and t tests were conducted. In Fall, SEC did not differ between TOOLBOX and non-TOOLBOX conditions. TOOLBOX students, however, showed a greater increase in SEC over the year. Within the TOOLBOX condition, Standard teachers incorporated the “tools” into academic instruction more frequently in Spring compared to Primer teachers. For most other implementation variables, no statistical difference was found between TOOLBOX implementation directives. Student SEC growth trajectories did not differ between Standard and Primer schools. Quasi-experimental evidence supports the overall benefits of TOOLBOX on K-2 students’ social and emotional growth. We discuss possible reasons for non-differential outcomes between Standard and Primer implementation directives within the TOOLBOX condition (e.g., gap between implementation directives and actual implementation behaviors). The gap between implementation directives and behaviors may provide an impetus for practicing school psychologists to contribute to more robust forms of implementation leadership (e.g., remove obstacles for implementation) and offer implementation support (e.g., coaching, feedback loops).