Learning from Policy Failure and Failing to Learn from Policy

Abstract

Evaluation studies provide a key source of learning from policy success and failure. Policy interventions and their evaluation are, however, drenched in inescapable complexity. This makes it more difficult to evaluate this kind of intervention in the highly regarded randomized experimental design. Based on the experiences of the Health Action Zones (HAZs), Judge and Bauld outline key elements of a more realistic evaluation framework, which might contribute to a further understanding of complex policy initiatives in the field of public health.1 Their recommendations provide a good basis for the further development of the methodology of evaluation studies. Three additional issues should be mentioned, however. First, what is evidence in health policy? Second, we want to emphasize the importance of the evaluator having an open mind during the evaluation process. Third, we believe that the ultimate goal for us as evaluators is to influence health policy, in addition to understanding a policy intervention. In line with Judge and Bauld, we must consider the question ‘what is evidence in health policy?’ Their paper can be read as a plea for the use of another type of evidence than that …