Comparing Self-Report and Observations to Assess the Implementation of an In-Home Program Serving At-Risk Families

Abstract

Assessing the implementation of home visitation interventions for families with at-risk children is an essential component of effective service delivery; however, collecting implementation assessment data is expensive. This study examined two different methods of assessing the adherence and quality of a home visitation program, provider self-reports of service delivery, and video observations of the home visit that assessed a total of 64 sessions. Detailed transcriptions were also coded with regard to quality of skills instruction. The two implementation assessment methods overlapped considerably regarding whether a core topic was discussed during the home visit and the percentage of time spent during the average session on many of the core components. Areas of divergence between the two assessment methods are reviewed. Implications for supervision and quality improvement efforts of home visitation providers are discussed.