Development Of Programme Theory Research Articles

Reducing refusals of care through improved personal care interactions between caregivers and people with dementia: protocol for a realist synthesis

IntroductionPeople with dementia develop progressive difficulties conducting basic activities of daily living, often requiring considerable assistance from caregivers. Many people with dementia, particularly in the advanced stages, can refuse assistance...

Real-world occupational therapy interventions for early-stage dementia: Characteristics and contextual barriers.

There is an absence of evidence generated in a UK context to support interventions based on occupational therapists' core skills for people living with early-stage dementia. To inform the development of a programme theory and a future evaluation, this paper aimed to describe real-world (routine) community-based occupational therapy interventions for this population and contextual barriers. Occupational therapy practitioners (n = 21) from five Health Boards in Wales, UK participated in semi-structured interviews (n = 17) which were audio recorded, transcribed, and analysed thematically. The availability of, and access to, real-world community-based interventions was variable, and associated with multilevel contextual barriers (resources, understanding of dementia specialist occupational therapy, professional influence, and evidence base). Where available and accessible, contents comprised a pre-intervention component (relational work, assessment, and goal setting) and intervention component (personalised problem-solving and coping strategies, emotional support, and advice and signposting), to meet needs associated with everyday activities and poor wellbeing. Variation in mode, duration, contents, and who received interventions, was associated with contextual barriers. Findings indicate that the development of an intervention programme theory and future evaluation design, will need to account for the impact context may have on the variability of real-world intervention characteristics, and how this in turn may influence outcomes.

Exploring the impact of early-stage dementia on everyday activities

Introduction: This paper explores the impact that early-stage dementia has on everyday activities from the perspective of people living with dementia, their supporters and occupational therapy practitioners. Method: People living with dementia and their supporters ( n = 10), and occupational therapy practitioners ( n = 21) took part in semi-structured interviews, with transcripts analysed thematically. Findings: Six primary themes were identified across participants, namely: (1) ‘Everybody seems to be different, [but] they are similar’; (2) An awareness of change: ‘Something’s not quite right’; (3) ‘ Changes’ and ‘ difficulties’ associated with complex and unfamiliar activities; (4) Social withdrawal and exclusion: ‘I’ve felt like I was a leper’; (5) Post-diagnostic mental health: ‘. . . a dark place’; and (6) A process of adaptation: ‘I’m still who I am, I can still do things. . .’ Conclusion: Findings indicate that occupational therapy intervention programmes for people living with early-stage dementia should target difficulties associated with a broad range of activity types, and include components that target mental health and motivational needs. The study adds to existing knowledge about the need to personally tailor interventions to ensure that they meet individual needs, experiences, and circumstances. Findings will inform the development of an occupational therapy intervention programme theory (theory of change) for early-stage dementia.

Health technology assessment implementation in WHO South-East Asia Region: a realist review protocol.

A robust Health Technology Assessment (HTA) framework is crucial to address the rising burden of healthcare costs and to inform decision-making to promote high-quality health systems. This research aims to describe the HTA methods and mechanisms for the successful implementation of HTA in the WHO South-East Asia region, and contextualize the synthesized evidence relevant to Indian settings. Realist review involves developing a program theory by conducting a systematic search strategy, screening, study selection, data extraction, and data synthesis. A systematic search for literature will be conducted on PubMed (NCBI), EMBASE (Elsevier), Scopus (Elsevier), Web of Science (Clarivate), and ProQuest Central for identifying the methods used for HTA of health technology interventions. Stakeholder consultations will be conducted to develop a program theory following the Context-Mechanism-Outcome configurations (CMOcs) framework. Searches for primary evidence will be conducted iteratively. Data will be extracted and tested against the programme theory. The proposed realist review will be reported as per the Realist and MEta-narrative Evidence Syntheses: Evolving Standards [RAMESES II] guidelines. To our knowledge, there has been no comprehensive review conducted to understand the mechanisms of HTA methods in the WHO South-East Asia region. The findings from the realist review will help us understand the mechanisms through which the HTA could work in WHO South-East Asian countries. We will then contextualize the findings obtained from evidence to Indian settings, based on program theory development through stakeholder consultation. A framework will be developed that can be used by policymakers/HTA experts in India for effective implementation of the same.

Evaluation of different models of general practitioners working in or alongside emergency departments: a mixed-methods realist evaluation.

Emergency healthcare services are under intense pressure to meet increasing patient demands. Many patients presenting to emergency departments could be managed by general practitioners in general practitioner-emergency department service models. To evaluate the effectiveness, safety, patient experience and system implications of the different general practitioner-emergency department models. Mixed-methods realist evaluation. Phase 1 (2017-8), to understand current practice: rapid realist literature review, national survey and follow-up key informant interviews, national stakeholder event and safety data analysis. Phase 2 (2018-21), to collect and analyse qualitative (observations, interviews) and quantitative data (time series analysis); cost-consequences analysis of routine data; and case site data for 'marker condition' analysis from a purposive sample of 13 case sites in England and Wales. Phase 3 (2021-2), to conduct mixed-methods analysis for programme theory and toolkit development. General practitioners commonly work in emergency departments, but delivery models vary widely in terms of the scope of the general practitioner role and the scale of the general practitioner service. We developed a taxonomy to describe general practitioner-emergency department service models (Integrated with the emergency department service, Parallel within the emergency department, Outside the emergency department on the hospital site) and present a programme theory as principal output of the study to describe how these service models were observed to operate. Routine data were of variable quality, limiting our analysis. Time series analysis demonstrated trends across intervention sites for: increased time spent in the emergency department; increased emergency department attendances and reattendances; and mixed results for hospital admissions. Evidence on patient experience was limited but broadly supportive; we identified department-level processes to optimise the safety of general practitioner-emergency department models. The quality, heterogeneity and extent of routine emergency department data collection during the study period limited the conclusions. Recruitment was limited by criteria for case sites (time series requirements) and individual patients (with 'marker conditions'). Pandemic and other pressures limited data collection for marker condition analysis. Data collected and analysed were pre pandemic; new approaches such as 'telephone first' and their relevance to our findings remains unexplored. Findings suggest that general practitioner-emergency department service models do not meet the aim of reducing the overall emergency department waiting times and improving patient flow with limited evidence of cost savings. Qualitative data indicated that general practitioners were often valued as members of the wider emergency department team. We have developed a toolkit, based on our findings, to provide guidance for implementing and delivering general practitioner-emergency department services. The emergency care data set has since been introduced across England to help standardise data collection to facilitate further research. We would advocate the systematic capture of patient experience measures and patient-reported outcome measures as part of routine care. More could be done to support the development of the general practitioner in emergency department role, including a core set of competencies and governance structure, to reflect the different general practitioner-emergency department models and to evaluate the effectiveness and cost effectiveness to guide future policy. This study is registered as PROSPERO CRD42017069741. This award was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme (NIHR award ref: 15/145/04) and is published in full in Health and Social Care Delivery Research; Vol. 12, No. 10. See the NIHR Funding and Awards website for further award information.

Developing initial programme theories for a realist synthesis on digital clinical consultations in maternity care: contributions from stakeholder involvement.

The COVID pandemic prompted an increase in the use of digital clinical consultations (telephone or video calls) within midwifery and nursing care. This paper reports on a realist review project related to maternity care that seeks to illuminate for whom such consultations can safely and acceptably be used, how, for what purposes and in what contexts. This paper addresses the first phase of a realist enquiry - initial programme theory development - focusing particularly on the role of stakeholder involvement (including digital transformation leaders, midwives, obstetricians, service users and community organisations). Three sub-stages of initial programme theory development are described highlighting the contribution of stakeholder groups to each stage: (i) consultation to focus the review question, (ii) focused searching and (iii) further consultation. Realist literature searching strategies yielded limited theory-rich evidence on digital consultations. Stakeholders provided essential additional contributions resulting in the development of 13 initial programme theories and a conceptual framework. More research on the implementation of virtual midwifery/nursing consultations is needed. Nursing/midwifery digital researchers should involve stakeholders to help shape research priorities, deepen contextual understanding and sense-check emerging findings.

An exploration of analytical tools to conduct a realist synthesis and demonstrate programme theory development: An example from a realist review

Introduction A realist literature review involves iterative processes, with searches, appraisal and synthesis occurring simultaneously. Whilst this lends itself to theory development, the synthesis process often lacks transparency. This has led to unanticipated challenges for novice realist researchers, particularly PhD candidates. Methods The aim of this paper is to contribute to the realist methodological knowledge base by outlining the analytical tools of coding, consolidating and conceptual mapping used within a realist review. Specifically, how these techniques aid the synthesis process and demonstrate the development of valid and evidence informed programme theories. Results A worked example is provided to illustrate how; (i) coding techniques using realist logic can evidence a rigorous synthesis process; (ii) the use of consolidating techniques facilitates data management and aids theory development; and (iii) conceptual mapping demonstrates programme theory development. Conclusions Recommendations for novice realist researchers include defining and documenting the analytical tools for conducting a rigorous realist synthesis to provide transparency about how valid programme theories were developed. Plus, theory development checks can be built into the structure of the review process.

Initial programme theory development: The first step in a realist evaluation of a cross-sectoral intervention for expectant Danish parents living with psychosocial risks.

A distinct inequality in maternity care exists, and women with psychosocial risks are at a greater risk of adverse birth outcomes. In several high-income countries, a psychosocial risk assessment early in pregnancy is recommended so that expectant parents are offered an appropriate level of care which facilitates relevant, tailored interventions for those in need. In 2017, a cross-sectoral and interdisciplinary intervention for expectant parents with psychosocial risks was developed and implemented in the North Denmark Region. The development process of the intervention has not been reported and theory-based knowledge about how supportive interventions bring about change for expectant parents with psychosocial risks is scarce. Through the initial phase of a realist evaluation, we aimed to elicit key contexts and mechanisms of change regarding the intervention for expectant parents with psychosocial risks. Through an initial programme theory, this article illustrates how, for whom and in which contexts the intervention is intended to work. Data is comprised of intervention documents, 14 pilot observations and 29 realist interviews with key stakeholders. A thematic analytical approach inspired by retroductive thinking was applied to identify and analyse patterns related to the incentive of the intervention, its structure, intended outcomes, generative mechanisms and contextual matters. Generative mechanisms responsible for bringing about change in the intervention were identified as healthcare professionals' approach, continuity, trust, early intervention and social network. Cross-sectoral collaboration and healthcare professionals' competencies were assumed to be central stimulating contextual factors. The initial programme theory developed in this study will serve as the basis for further refinement via empirical testing in a later phase of the realist evaluation.

Understanding strategies that foster nurses to act as clinical leaders in hospitals: A realist review.

To identify strategies that develop clinical nursing leadership competencies among staff nurses, and to explain the contextual elements and mechanisms that underpin the development of clinical nursing leadership competencies. Realist review according to the Realist and Meta-narrative Evidence Syntheses-Evolving Standards (RAMESES). PubMed, Embase, CINAHL, Web of Science, Wiley Online Library, PsycInfo and ProQuest were searched from January 2000 until October 2022. Three iterative phases: (1) development of initial programme theory, (2) structured searches for relevant published and grey literature and (3) data synthesis and interpretation by researchers and theory triangulation, and discussions within the research group. Multiple context-mechanism-outcome configurations were extracted from 10 reports that explain how, under what circumstances and why strategies can facilitate (or discourage) staff nurses to act as clinical leaders. Reports were both quantitative and qualitative in design, originating from English-speaking countries only. A logic model was developed and suggests four contexts and five mechanisms underlying the development of clinical nursing leadership. Growth in clinical nursing leadership was mainly experienced through experiential learning, which was enhanced by a supportive relationship with a coach or mentor, the use of reflective practices and modelling from other leaders. Furthermore, a supportive work environment triggers ownership, confidence and motivation, and thereby growth in clinical nursing leadership competencies. Fostering competencies for clinical leadership among staff nurses requires multifaceted strategies. Strategies are successful if, and only if, they combine learning by doing, by knowing and by observing, and establish a responsive work environment. Hospital policy should ensure that staff nurses have access to reciprocal relationships with role models or a coach. In order to grow as clinical nurse leader, ownership and self-reflection on own leadership behaviour need to be facilitated. Prospero ID CRD42021292290.

The Connections Matter: Bi-Directional Learning in Program Evaluation and Practice-Oriented Research.

Intended for researchers and clinical leaders, this article suggests that embedded program evaluation is a good fit with the desired features of practice-oriented research. The systematic nature of evaluation that is built into the operational workflow of a practice setting may increase the diversity of methods available to explore processes and outcomes of interest. We propose a novel conceptual framework that uses a human-centered systems lens to foster such embedded evaluation in clinical routine. This approach emphasizes the evaluator-practitioner partnership to build confidence in the bi-directional learning of practice-based evidence with evidence-based practice. The iterative cycles inherent to design thinking are aimed at developing better evaluation questions. The attention to structure and context inherent to systems thinking is intended to support meaningful perspectives in the naturally complex world of health care. Importantly, the combined human-centered systems lens can create greater awareness of the influence of individual and systemic biases that exist in any endeavor or institution that involves people. Recommended tools and strategies include systems mapping, program theory development, and visual facilitation using a logic model to represent the complexity of mental health treatment for communication, shared understanding, and connection to the broader evidence base. To illustrate elements of the proposed conceptual framework, two case examples are drawn from routine outcome monitoring (ROM) and progress feedback. We conclude with questions for future collaboration and research that may strengthen the partnership of evaluators and practitioners as a community of learners in service of local and system-level improvement.

Health technology assessment implementation in WHO South-East Asia Region: a realist review protocol

Background: A robust Health Technology Assessment (HTA) mechanism is crucial to address the rising burden of healthcare costs and expenditures of patients. This research aims to describe the HTA methods and mechanisms for successful implementation of HTA in the WHO South-East Asia region, and contextualize the synthesized evidence relevant to Indian settings. Methods: Realist review involves developing a program theory by conducting a systematic search strategy, screening, study selection, data extraction, and data synthesis. A systematic search for literature will be conducted on PubMed (NCBI), EMBASE (Elsevier), Scopus (Elsevier), Web of Science (Clarivate), and ProQuest Central for identifying the methods used for HTA of health technology interventions. Stakeholder consultations will be conducted to develop a program theory following the Context-Mechanism-Outcome configurations (CMOcs) framework. Searches for primary evidence will be conducted iteratively. Data will be extracted and tested against the programme theory. The proposed realist review will be reported as per the Realist and MEta-narrative Evidence Syntheses: Evolving Standards [RAMESES II] guidelines. Conclusions: To our knowledge, there has been no comprehensive review conducted to understand the mechanisms of HTA methods in the WHO South-East Asia region. The findings from the realist review will help us understand the mechanisms through which the HTA could work in WHO South-East Asian countries. We will then contextualize the findings obtained from evidence to Indian settings, based on program theory development through stakeholder consultation. A framework will be developed that can be used by policymakers/HTA experts in India for effective implementation of the same.

The Impact of Ex-Post Legislative Evaluations in Healthcare: A Mixed Methods Realist Evaluation Study Protocol for Conducting Case Studies.

Recent studies on the impact of ex-post legislative evaluations show that there are different types of impact and different factors that can influence it. These include the context of a legislative evaluation, research quality, and interactions between researchers and other actors within the evaluation process. However, thorough empirical research in this area is lacking. This warrants empirical research into the factors that influence the impact of ex-post legislative evaluations, so these insights can be used to increase the likelihood of ex-post legislative evaluations having an impact. In this protocol, we report on the realist evaluation methodology that will be used to evaluate the impact of three ex-post legislative evaluations in the Dutch healthcare sector. The mixed methods realist evaluation approach will facilitate this theory-driven, qualitative research. The study will consist of the following three steps: (1) Initial programme theory development, (2) theory validation, and (3) theory refinement. Knowledge from two scoping reviews conducted previously, and two subsequent expert meetings will form the basis for developing the initial programme theory. During this study, three case studies will be conducted, in which three individual ex-post legislative evaluations will be examined. Specificmethods for data collection will include: documentary review, observation, structured questionnaires and focus group discussions with purposefully identified key stakeholders. Using the framework approach, the data will be analysed thematically in a within-case analysis followed by a cross-case analysis. This protocol provides insight into how the study will be conducted. As this study uses multiple qualitative researchmethods to answer one question, this protocol supports refining data collection procedures. Careful consideration of the approach beforehand can minimise pitfalls, reduce publication bias and improve reproducibility. The protocol therefore specifies how the research question will be answered in detail, and this provides solid guidance for the research process.

‘For Want of a Nail’: developing a transparent approach to retroduction and early initial programme theory development in a realist evaluation of community end of life care services

ABSTRACT A crucial part of theory-driven realist thinking is retroduction, the process of looking backwards for explanation of how and why things may be. Conducted early in the realist evaluation process, it provides a foundation for evidenced ‘theory gleaning’. Despite retroduction being an inherent part of the realist process, it is often ‘hidden’ in realist reports. This paper explains the thinking behind, alongside an example of, a framework created by the authors to make transparent the retroductive process as used in a realist evaluation of two community End of Life Care services. The approach makes visible the application of the ‘sociological imagination’ and lends robustness to hypotheses by establishing how the authors utilised: wide-ranging potential generative causation; stakeholder and Patient and Public Involvement feedback; literature scoping; and substantive theories at the middle range, specifically Transitions Theory. These stages led to the development of Initial Programme Theories, with a clear history of genesis.

Supporting care home residents in the last year of life through 'Needs Rounds': Development of a pre-implementation programme theory through a rapid collaborative online approach.

Realist evaluation aims to address the knowledge to practice gap by explaining how an intervention is expected to work, as well as what is likely to impact upon the success of its implementation, by developing programme theories that link contexts, mechanisms and outcomes. Co-production approaches to the development of programme theories offer substantial benefits in addressing power relations, including and valuing different types of knowledge, and promoting buy-in from stakeholders while navigating the complex social systems in which innovations are embedded. This paper describes the co-production of an initial programme theory of how an evidence based intervention developed in Australia - called 'Palliative Care Needs Rounds' - might work in England and Scotland to support care home residents approaching their end of life. Using realist evaluation and iPARIHS (integrated Promoting Action on Research Implementation in Health Services) we sought to determine how contexts and mechanisms of change might shape implementation outcomes. Pre-intervention online interviews (n = 28) were conducted (February-April 2021), followed by four co-design online workshops with 43 participants (April-June 2021). The online interviews and workshops included a range of stakeholders, including care home staff, specialist palliative care staff, paramedics, general practitioners, and relatives of people living in care homes. This methodology paper reports developments in realist evaluation and co-production methodologies, and how they were used to develop context, mechanisms, outcomes (CMOs) configurations, and chains of inference. The initial (pre-intervention) programme theory is used to illustrate this process. Two developments to iPARIHS are described. First, involving stakeholders in the collaborative co-design workshops created opportunities to commence facilitation. Second, we describe developing iPARIHS' innovation component, to include novel stakeholder interpretations, perceptions and anticipated use of the intervention as they participated in workshop discussions. This rapid and robust co-production methodology draws on interactive collaborative research practices (interviews, workshop discussions of data, illustrative vignettes and visual methods). These innovative and engaging methods can be packaged for online processes to develop, describe and interrogate the CMOs in order to co-produce a programme theory. These approaches also commence facilitation and innovation, and can be adopted in other implementation science and realist studies.

Towards an integrated framework for evaluating transformative innovation policy

In recent years, a new frame for innovation policy has emerged, namely “transformative innovation policy” (TIP), which aims at addressing transformative change or “Grand Challenges”. Such a shift in policy theory should, ideally, be reflected in policy evaluation, but the literature has so far provided little advice on how to address TIP-related evaluation challenges such as directionality and system-level behavioural additionality. This paper discusses how the evaluation of policy interventions targeting system innovation can be designed to address these challenges. Combining the literature on sustainability transitions with policy evaluation, we propose an integrated evaluation framework composed of three main components: (i) programme theory (programme goals, systems boundaries and desired (or accepted) development paths); (ii) system analysis (transformative outcomes); and (iii) synthesis and overall assessment (including revision of programme theory). By integrating the two sets of literature, we provide a bridge between academic research on transitions and current evaluation practices. We briefly illustrate the applicability of the integrated framework in the BioInnovation Strategic Innovation Programme in Sweden.

Theory amidst complexity – using process tracing in ex‐post evaluations

AbstractEvaluators who take a complexity‐aware approach must consider tradeoffs related to theoretical parsimony, falsifiability, and measurement validity. These tradeoffs may be particularly pronounced with ex‐post evaluation designs in which program theory development and monitoring frameworks are often completed before the evaluator is engaged. In this chapter, we argue that theory‐based evaluation (TBE) approaches can address unique ex‐post evaluation challenges that complexity‐aware evaluation (CAE) alone cannot, and that these two sets of approaches are complimentary. We will outline strategies that evaluators may use to conduct rigorous ex‐post evaluations of democracy, human rights, and governance (DRG) interventions that merge CAE's inductive approaches with a theory‐testing structure. It will illustrate these strategies with two case studies of ex‐post evaluation using process tracing (PT).

Using Intervention Mapping to develop an intervention to promote healthy child weight development

Abstract Background Clear documentation of the understanding of the problem, development process, and content of interventions is essential to understand why interventions succeed or fail. Transparent reporting will enable future researchers to build on previous evidence and replicate or adapt interventions for new contexts. This paper describes the theory- and evidence-based systematic development of the Bloom Trial - a home-based intervention to promote healthy weight development among infants and children in Denmark. Methods Development of the intervention is guided by the six-step planning tool the Intervention Mapping protocol. Step 1: Needs assessment including identification of risk factors in infancy and existing interventions, interviews with parents, and an organizational capacity assessment. Step 2: Development of program theory and matrices. Step 3: Selection of theoretical methods and practical applications for modifying personal and environmental determinants. Step 4: Development of intervention tools. Step 5: Planning of program adoption, implementation, and sustainability. Step 6: Generation of an evaluation plan. Results The Bloom intervention is universal but with a strong focus on families with low socio-economic position and non-Danish ethnic background. It is aimed at first-time parents and addresses early risk factors for child overweight such as parental skills and healthy habits related to food and meals, movement, screen time and sleep, and introduce a new theme: sense of security in the family. It will be integrated in existing services delivered by community health nurses supplemented with extra elements such as telephone consultations, family groups and a video library. Conclusions The transparency of the developmental process and theoretical, empirical, and contextual foundation of the Bloom Trial may enable future studies to build on our findings and accumulate knowledge to promote healthy weight development among infants and children. Key messages

A Study Protocol of Realist Evaluation of Palliative Home Care Program for Non-Cancer Patients in Singapore.

Violet Program (ViP) was developed to address the current home palliative service gap for individuals with life limiting non-cancer conditions residing in the Eastern part of Singapore. While its basic principles and processes have been planned and implemented, how ViP works, for whom and in what circumstances are not yet well understood. Therefore, we propose for a realist evaluation (RE) - a theory-based evaluation, to address the current knowledge gaps. Evaluation findings may guide, support further development and broader uptake of ViP. This study will be conducted in three phases: 1. development of initial program theory (IPT), 2. testing of programme theory, and 3. refinement of IPT. First, IPT will be elicited through review of programme documents, scoping review of reviews and in-depth interviews with stakeholders involved in the conceptualization of ViP. Then, a convergent mixed method study will be conducted to assess contexts (C), mechanisms (M) and outcomes (O) to test the IPT through interviews with stakeholders, surveys and analysis of program and administrative databases. Based on findings gathered and through consultation with respective stakeholders, IPT will be refined to highlight what works (outcomes), how (mechanisms) and for whom under what conditions (contexts).

Using a realist lens to understand the Victorian Family Preservation and Reunification Response in the first year of implementation — Towards a better understanding of practice

Programs for families where children are at risk aim to develop the conditions for safety and care that is rewarding, loving, stable and secure. Understanding what leads to outcomes is less clear, and realist research methods are a useful in unpacking this. The Social Care Theorising Model informed the collection of focus group data from practitioners and team leaders in a family preservation and reunification program being scale up across the state of Victoria in Australia. Demi-regularities (patterns of a program’s function that are reasonably stable) were generated to provide a rapid understanding of practice knowledge to inform data-driven decision making. This study combined the methodology from two studies to balance the need for realist informed findings without time and resource intensive processes of program theory development. Twelve demi-regularities were found which were grouped into three socio-ecological themes of family, organisation and system. At the family level, practitioners described what enabled engagement, readiness, the development of a therapeutic relationship and the need for supported closure. The organisational level suggested the preconditions to engagement, the caseload needed to work intensively, management of staff stress and work needed to operationalise goals. The systems level largely described the essential role of the Child Protection Navigator and how they enable service delivery. This study provides an understanding of what works, for whom, when and why in an innovative family preservation and reunification program.

Conducting focus groups in realist evaluation.

Focus groups are valuable tools for evaluators to help stakeholders to clarify programme theories. In 1987, R.K. Merton, often attributed with the birth of focus groups, wrote about how these were ‘being mercilessly misused’. In the 1940s, his team had conceived focus groups as tools for developing middle-range theory, but through their astonishing success focus groups have metamorphosed and are often an ‘unchallenged’ choice in many evaluation approaches, while their practice seems to provide a philosophically diverse picture. This article examines what knowledge focus group data generate, and how they support theory development. It starts with an overview of the history of focus groups, establishing a relationship between their emergence as a data collection method and the evaluation profession. Practical lessons for conducting groups in realist evaluation are suggested, while exploring how qualitative data can support programme and middle-range theory development using the example of realist evaluation.