The utility of modeling in evaluation planning: the case of the coordination of domestic violence services in Maryland

Abstract

This pilot study illustrates the modification of evaluation planning tools, such as documents models [Rutman, Evaluation research methods: A basic guide, 1984], logic models [Burt et al. Evaluation guidebook. Projects funded by S.T.O.P. Formula Grants under the Violence Against Women Act, 1997] and program theory models [Weiss, Evaluation. Methods for studying programs and policies, 1998] in planning the evaluation of the coordination of domestic violence (DV) services in the metropolitan area of Baltimore, Maryland. Coordinated community responses (CCR) are systematic approaches to intervention—in this case for DV intervention—that emphasize comprehensive, collaborative and integrated service delivery. Evaluation studies typically focus on assessing the performance of programs within various components of the system (judicial, crisis intervention, social services, health care). The present paper argues for a holistic, theory-based evaluation approach to examine the entire system, which involves modeling the structure of, and linkages among, the system components. This process reveals that the activities of the agencies in the CCR are guided by varying intervention models, leading to different priorities: batterer sanctioning, victim advocacy, service delivery, or family reunification. Any subsequent evaluation of the intervention system as a whole has to take these differences into account. Data collection methods and indicators for a system-wide process evaluation are suggested.