Increasing the Impact of Program Evaluation: The Importance of Challenging Assumptions and Incorporating New Perspectives.

Abstract

These remarks, which were given as the 2022 Recipient of the Peter H. Rossi Award for Contributions to the Theory or Practice of Program Evaluation, emphasize ways to increase the impact of program evaluation. First, is the importance of asking good questions, including ones that challenge the assumptions and models that dominate the field. Relatedly, we need to question the assumption that "one size fits all" and recognize the variation that exists-across contexts, time, and individuals. The key question is what works for whom under what conditions, and this also pushes us to think about why effects differ and what is driving those differences, that is, the underlying mechanisms. It is also important to incorporate new perspectives to improve our questions, models, research design, and interpretation, thus helping to address the aforementioned points. We should both welcome diverse perspectives into the research community and listen carefully to the communities we seek to study and incorporating their insights. Although the examples focus on a career in education research, the implications of the points are relevant for any aspect of social policy.