A Case for the Advancement of Utilisation of Realist Evaluation in International Development: An Oxfam Focused Illustration

Abstract

Grounded in scientific realist philosophy and expounded by Pawson and Tilley (1997), realist evaluation is founded on the assertion that community development programs seek to address real problems, and not social constructs. It is therefore a realistic approach to evaluation that informs policy and decision makers of the effectiveness of programs, examining the program's specific mechanisms, contexts and outcomes. Pawson and Tilley (1997) place people at the centre of the realist approach to evaluation, emphasising that the effectiveness of programs is dependent on the respondents’ willingness to engage, as well as the existence of an environment that enables them to participate. This paper seeks to reinforce the significance of realist evaluation in international development programs, illustrating its value in informing programs that are effective and responsive, and employing contextually appropriate mechanisms that enhance communities’ benefits. Realist philosophy asserts that, ‘entities exist independently of being perceived, or independently of our theories about them’ (Phillips, 1987, p. 205). It is this reality, outside of our knowledge and experiences, that we seek to define, as best we can and never absolutely, through scientific approaches and social inquiry (Ball, MUller & Nelson, 2014). It is within this framework that realist evaluation exists. As championed by Pawson and Tilley (2004), realist evaluation is theory based and seeks to answer the question, ‘what works for whom in what circumstances and in what respects, and how’ (p. 2). Pawson and Tilley (1994) note that unlike experimental research which focuses primarily on addressing what works using a successionist approach1, realistic evaluation takes a generative approach and examines underlying causal linkages to changes observed (p. 291). Examining mechanisms, contexts and outcomes, realistic evaluation presents a methodological approach that amplifies the role of people in bringing about change. For Pawson and Tilley (1994), ‘programmes ‘work, if subjects choose to make them work and are placed in the right conditions to enable them to do so’ (p. 294). This is useful to Oxfam Australia's (2014) focus on ‘a just world without poverty, where people influence decisions that affect their lives, enjoy their rights, and assume their responsibilities—a world in which everyone is valued, and everyone is treated equally’ (p. 6). Inspired by the Australasian Evaluation Society's (2016) priority to influence and promote evaluation practice, this article seeks to contribute to the discourse on realist evaluation in an endeavour to advance its application in evaluation practice within the international development sector.