Real Talk: A Realist Dialogic Approach in a Realist Evaluation

Abstract

Realist evaluation is a method increasingly adopted to provide an understanding of how and why a program works, for whom, and under what circumstances. Initial program theories (IPT) are the crucial starting point of any realist evaluation, however descriptions about how they are developed in practice remain under-reported in the published literature. This article argues for the value of genuine research-group conversations using David Bohm’s concept of dialogue in realist research. We label it the realist dialogic approach. We draw out the relational qualities as well as the contextual circumstances of dialogue through our development of IPT and interview guides for a research study on the implementation and scaling of a large-system value-based program to transform complex health services. We selected the relevant middle-range theories, conducted a literature review, and drew on informal discussions with key stakeholders, to develop IPT through research-group conversations. The benefits of this approach were: 1) development of rigorous, novel, deep and well-tailored IPT, 2) detailed understanding of the complex intervention under investigation and development of rapport and networks with participants, 3) empirically grounded Context-Mechanism-Outcome (CMO) configurations, predicated on suitable abstract and contextually-contingent middle-range theories, and 4) productive research team interactions which supported the entire research process. The challenges of this approach include: 1) establishing and retaining a sense of humility across the research team, 2) contextual circumstances can hinder dialogic relationship, and 3) time and resource heavy. This paper uses middle-range theory and ethnographic insights to advance the existing practice of realist evaluations and offer transferable lessons to other scholars considering similar approaches. Moreover, we content that the use of middle-range theory to extend the methodological literature is a novel contribution to realist work.