Participatory Systems Mapping Research Articles

Streamlining Complex Intervention Evaluation Through Participatory Systems Mapping and Contribution Analysis: A Comprehensive Framework for Actionable Complexity Evaluation

The use of complexity-based evaluation methods remains relatively underexplored in the field of evaluation. While increasingly employed to assess complex interventions, Contribution Analysis (CA) continues to suffer from a lack of operationalization. In this article, we propose enhancing the implementation of CA by leveraging Participatory Systems Mapping as a tool to delineate and scrutinize contribution narratives. The research has a dual objective. It aims to experiment with the recently introduced Participatory Systems Mapping method in the field of evaluation while providing a tool for examining contribution narratives. The combination of CA and Participatory Systems Mapping was tested by evaluating a youth employability project. This approach enabled a collaborative and in-depth examination of impact stories and alternative explanations. It proved valuable not only in managing the complexity of the intervention but also in strengthening the implementation of CA.

Navigating complexity in evaluation with participatory systems mapping: A systematic review

Navigating complexity in evaluation with participatory systems mapping: A systematic review

Using participatory geographic information systems (PGIS) mapping to describe household food access in Buffalo, New York

ABSTRACT Despite existing only blocks apart, neighborhoods in Buffalo, NY can have very different levels of food availability and access due to their local food environment. This study uses participatory geographic information systems (PGIS) mapping and qualitative interviewing to describe these food environments based on the lived experiences of Buffalo residents. PGIS mapping interviews were conducted with residents of the city who regularly used food pantries and focused on access to and availability of both free food resources (such as soup kitchens and food pantries) and purchased food resources (such as grocery stores). Participants were also asked about food access in their own neighborhood, their perceptions of food access in the city, and what develops they thought would contribute to greater food security for their neighborhoods. Results show cost of living and transportation were important barriers to food access for many participants. Findings suggest that residents of historically marginalized neighborhoods in Buffalo continue to have lower access to affordable healthy foods.

Mapping the service system that supports children and families in the context of place-based-disadvantage: Potential leverage points for intervention

There is strong evidence to suggest that children are negatively impacted by growing up in places where there are high levels of disadvantage present. However, these children can reap substantial developmental benefits (even more so than those who do not experience disadvantage) from access to and engagement with community and social services supporting health, education, and wellbeing. Yet, due to the complexity of service provision, access, and outcomes for children and families living in disadvantaged places, the service system in these contexts often is found to be ineffective in meeting the needs of the community. This study utilises a participatory approach, engaging service providers working with children and families in a disadvantaged place to identify key leverage points that have the potential to promote systems reform. Using participatory systems mapping, the findings illustrate aspirations (or the ideal state) of the service system that are characterised by early intervention, high levels of service coverage, and interconnected services, all of which enable wellbeing for children and families. User orientated and service orientated factors that act as barriers or enablers are also identified and key levers of service reform are discussed, particularly increasing accessibility of services and reducing vulnerability of service users.

Crises as incubators of sustainable mobility patterns? Evidence from two shock events

AbstractThis paper promotes our understanding of how crises accelerate systemic sustainability‐related changes in our transforming societies using the example of mobility. Not only is the magnitude of the mobility carbon footprint large, but its dynamics make reducing it very challenging. Our paper addresses the impact of crises on the transformation of mobility patterns, including short‐distance mobility and holiday tourism. A first study was conducted after the 2008–2010 crisis using focus‐group participatory systems mapping. This found that when people are forced to change their habits for financial reasons, they adapt holiday travel first. Nonetheless, participants were just as satisfied with domestic destinations, provided they could spend time with loved ones. The second study focused on the COVID‐19 crisis. Participants missed foreign travel, so some rebound seems inevitable. However, the crisis has been an incubator of changes in urban mobility that could reduce carbon footprints in the longer term and offset the prospective increase in tourism. Recent changes have been more profound and innovative than those during the 2008–2010 crisis.

Designing for a Healthier Indore, India: Participatory Systems Mapping

In Indore, India, BHC engaged 247 multi-sector stakeholders through a systems mapping approach to gather qualitative data across three workshops and four citizen town halls from 2018 to 2020. These data were synthesized with results from BHC’s 18 other city activities to build a systems map and identify high-impact areas for engagement. Contextual findings showed a tension at the heart of Indore’s growth—Indore’s great success as a city has spurred rapid population growth. This growth creates pressure on municipal systems as population outpaces service delivery capacity. This is central to the systems map that BHC developed and is expanded upon through additional patterns that fall within four main domains: (1) leadership, governance, and financing; (2) essential service delivery and workforce; (3) information systems; and (4) community infrastructure and education. Stakeholders found three key leverage opportunities within this context that, if included in every action, could help overcome barriers. These opportunities are: (1) improving data quality, use, and integration; (2) supporting accountability to, and enforcement of, policies and regulations; and (3) increasing community engagement. Brought together through a better understanding of the key patterns driving system behavior from the context map and leverage opportunities, BHC was able to co-create, with stakeholders, seven “coherent actions” to move Indore to a healthier, more equitable state. When COVID-19 regulations ease, BHC and city officials will reconvene to finalize an implementation plan for these actions.

Participatory Systems Mapping for Municipal Prioritization and Planning

Rapidly growing cities face new and compounding health challenges, leading governments and donors to seek innovative ways to support healthier, more resilient urban growth. One such approach is the systems mapping process developed by Engaging Inquiry (EI) for the USAID-funded Building Healthy Cities project (BHC) in four cities in Asia. This paper provides details on the theory and methods of the process. While systems mapping is not new, the approach detailed in this paper has been uniquely adapted to the purpose of municipal planning. Strategic stakeholder engagement, including participatory workshops with a diverse group of stakeholders, is at the core of this approach and led to deeper insights, greater buy-in, and shared understanding of the city’s unique opportunities and challenges. This innovative mapping process is a powerful tool for defining municipal priorities within growing cities across the globe, where the situation is rapidly evolving. It can be used to provide evidence-based information on where to invest to gain the biggest impact on specific goals. This paper is part of a collection in this issue providing a detailed accounting of BHC’s systems mapping approach across four project cities.

Bringing Sectors Together in Da Nang, Vietnam: Participatory Systems Mapping

The USAID-funded Building Healthy Cities (BHC) work in Da Nang, Vietnam, engaged 108 multi-sector stakeholders to gather qualitative data across two workshops and three citizen town halls from 2019 to 2021. These data were synthesized with the results from BHC’s seven other activities in Da Nang to build systems maps. Contextual findings showed that multi-sector, multi-level participation and collaboration have been the key to moving the city toward their smart and livable city goals. Currently, citizen, nongovernmental organization, and private sector collaboration are low for many government sectors, which results in policy and programs that are mismatched to actual needs and therefore have less powerful impacts. When these policies and programs are implemented, they struggle to demonstrate strong benefits to these stakeholder groups, further decreasing participation. This is central to the systems map that BHC developed, and is expanded upon through additional patterns that fall within four main areas: management quality; vision and leadership; workforce capacity; and community engagement. Stakeholders found four key leverage points within this context that, if included in every action, could help overcome barriers. These leverage opportunities are: (1) investing at all levels; (2) improving function and innovation of information technology; (3) increasing participation and feedback; and (4) creating more responsive policy. As BHC concludes activities in Da Nang, local university students will be trained on systems mapping techniques to embed systems thinking skills into the next generation of workforce, and a set of recommendations will be developed to share with the government to act on these findings.

Designing for a Healthier Makassar, Indonesia: Participatory Systems Mapping

In Makassar, Indonesia, the USAID-funded Building Healthy Cities (BHC) project engaged 240 multi-sector stakeholders to gather qualitative data across three workshops and two citizen town halls from 2019 to 2021. These data were synthesized with results from BHC’s nine other Makassar activities to build maps of the current system and identify high-impact areas for engagement. Contextual findings showed that Makassar leadership has actively innovated and used new technology to improve the city, resulting in improved connectivity and responsiveness. However, this drive toward innovation has strained existing infrastructure and workforce capacity. When this strain fails to meet promised results, citizens are less likely to engage and support the innovations. This is central to the systems map that BHC developed, and is expanded upon through additional patterns that fall within four main areas: (1) leadership, governance, and financing; (2) infrastructure and workforce; (3) collaboration and data; and (4) community cohesion and awareness. Stakeholders found three key leverage points within this context that, if included in every action, could help overcome barriers. These leverage opportunities are: (1) increasing data-driven decision-making; (2) ensuring equitable policy and leadership; and (3) increasing community participation. By combining key patterns discovered in the Context Map with the leverage opportunities, BHC was able to co-create with stakeholders six “coherent actions” that can move Makassar to a healthier, “Sombere (kind-hearted and hospitable) and Smart City.” BHC has been working with the city planning office to incorporate the map findings into its bottom-up planning processes and the 5-year mid-term plan for Makassar.

Adopting a Whole Systems Approach to Transport Decarbonisation, Air Quality and Health: An Online Participatory Systems Mapping Case Study in the UK

In a drive to achieve net zero emissions, U.K. transport decarbonisation policies are predominantly focussed on measures to promote the uptake and use of electric vehicles (EVs). This is reflected in the COP26 Transport Declaration signed by 38 national governments, alongside city region governments, vehicle manufacturers and investors. However, emerging evidence suggests that EVs present multiple challenges for air quality, mobility and health, including risks from non-exhaust emissions (NEEs) and increasing reliance on vehicles for short trips. Understanding the interconnected links between electric mobility, human health and the environment, including synergies and trade-offs, requires a whole systems approach to transport policymaking. In the present paper, we describe the use of Participatory Systems Mapping (PSM) in which a diverse group of stakeholders collaboratively constructed a causal model of the U.K. surface transport system through a series of interactive online workshops. We present the map and its analysis, with our findings illustrating how unintended consequences of EV-focussed transport policies may have an impact on air quality, human health and important social functions of the transport system. We conclude by considering how online participatory causal modelling techniques could be effectively integrated with empirical metrics to facilitate effective policy design and appraisal in the transport sector.

Participatory complexity in tourism policy: Understanding sustainability programmes with participatory systems mapping

Linear logic models are insufficient to understand how interventions work in complex areas such as sustainable tourism. We present Participatory Systems Mapping (PSM), a novel method to develop shared understandings and collective management of complex policy issues among stakeholders. We use PSM with stakeholders in Barcelona to support the design of an upcoming evaluation of an existing sustainability programme. Discussion during workshops, and analysis of the PSM map produced, suggest sharing best practices and improving peer-to-peer learning are pivotal to improving sustainability. We show how a complex systems approach, implemented via PSM, can provide a more holistic understanding of the contexts and interactions of tourism policy. We offer learning and guidance on how the method can be used by others.

A participatory systems mapping approach for sustainability transitions: Insights from an experience in the tourism sector in Portugal

The use of participatory modelling approaches in sustainability transition studies has been limited despite its potential contributions to transitions research. In this article, a methodological framework was designed based on a Participatory Systems Mapping (PSM) approach to structure and frame sustainability problems in transition management processes. The framework comprises three phases: 1) transition framing and actor selection, 2) PSM transition workshop, and 3) synthesis and evaluation. In a case study of the Portuguese tourism sector, participants created a shared systems view of tourism sustainability issues, based on the development of causal loop diagrams. Transition concepts, such as landscape-regime and niche-regime interactions, are specified in the diagrams. The PSM approach also provided a collaborative platform for co-creation of shared sustainability visions, thus fostering formalisation of a broad roadmap for desired transition pathways.

Participatory systems mapping for complex energy policy evaluation

The use of complexity science in evaluation has received growing attention over the last 20 years. We present the use of a novel complexity-appropriate method – Participatory Systems Mapping – in two real-world evaluation contexts and consider how this method can be applied more widely in evaluation. Participatory Systems Mapping involves the production of a causal map of a system by a diverse set of stakeholders. The map, once refined and validated, can be analysed and used in a variety of ways in an evaluation or in evaluation planning. The analysis approach combines network analysis with subjective information from stakeholders. We suggest Participatory Systems Mapping shows great potential to offer value to evaluators due to the unique insights it offers, the relative ease of its use, and its complementarity with existing evaluation approaches and methods.

Building a system-based Theory of Change using Participatory Systems Mapping

Theory of Change diagrams are commonly used within evaluation. Due to their popularity and flexibility, Theories of Change can vary greatly, from the nuanced and nested, through to simplified and linear. We present a methodology for building genuinely holistic, complexity-appropriate, system-based Theory of Change diagrams, using Participatory Systems Mapping as a starting point. Participatory System Maps provide a general-purpose resource that can be used in many ways; however, knowing how to turn their complex view of a system into something actionable for evaluation purposes is difficult. The methodology outlined in this article gives this starting point and plots a path through from systems mapping to a Theory of Change evaluators can use. It allows evaluators to develop practical Theories of Change that take into account feedbacks, wider context and potential negative or unexpected outcomes. We use the example of the energy trilemma map presented elsewhere in this special issue to demonstrate.

The Grounded Survey – An integrative mixed method for scrutinizing household energy behavior

Sustainable energy policy and tackling climate-change-related issues require exploring energy consumption patterns. This paper proposes an integrative methodological approach called grounded survey for understanding behavioral factors behind household energy consumption. The study aims to overcome the restrictions of both quantitative and qualitative studies by combining participatory-systems-mapping (PSM) based focus group research with a quantitative survey. Focus groups were used to highlight common patterns, which helped formulate survey questions specifically into understudied areas of energy-related behavior. The survey helped validate these qualitatively grounded questions, while generating generalizable quantitative results based on a representative sample. Finally, a comparative assessment contrasted the comprehensive qualitative analysis with the survey findings. Two causal loop diagrams of common patterns are employed to illustrate the methodological model. This integrative approach deepens understanding of behavioral factors behind energy consumption and provides policy recommendations to strengthen the relationship between heating-related behavior and heating costs. The grounded survey method can be utilized in studying wicked or paradox problems in which the relationship between behavioral and technical factors are complex and possibilities for intervention are limited. The application of the model is suggested in areas where development can only be achieved through behavioral change.

Participatory systems mapping for localised evidence and decision-making: helminth control, SSA

Abstract Background Evidence-informed decision-making to assist public health practitioners in local-level programme implementation requires adaptive approaches to research, policy and practice. To address these needs there is focus on using participatory methods. Adopting such methods, this research asks: what are the evidence needs of local public health practitioners? How do evidence and decision-making processes interact? We reflect on the process of using Participatory Systems Mapping (PSM) and implications for localising evidence-informed decision-making. Methods We conducted workshops with district and national-level MoH personnel in Uganda and Malawi using PSM to elicit insights into local modes of schistosomiasis transmission and control, and group discussions on evidence needs and use in implementing control programmes. PSM maps are analysed, triangulated with thematic analysis of group discussion transcripts. Results Analysing PSM outputs alongside discussions on evidence provides critical methodological and policy insights with implications for localised evidence and decision-making. Further insights into the local dynamics of public health decision-making are gained by triangulating PSM with discussions on the meanings and importance of 'factors' identified. Information which is accessible and useful for local practitioner's decision-making in implementing disease control measures does not always align with academic production and dissemination of evidence, nor across levels where policy is produced or implemented. Conclusions An array of factors influence local decision-making with implications for global health policies and practices such as for schistosomiasis control. Processes of decision-making and evidence needs of local practitioners need to be better understood within broader context. Evidence and knowledge production on health interventions rarely feedback or respond to local implementation needs, decision-making practices and public health practitioners. Key messages Processes of decision-making and evidence needs of local practitioners need to be better understood within broader context. Evidence and knowledge production on health interventions rarely feedback or respond to local implementation needs, decision-making practices and public health practitioners.

Localising evidence for decision-making: participatory approach to inform schistosomiasis control

Abstract Background The linear theories of change which ground many interventions do not account for the complex processes and systems in which they are implemented. This reductionist approach prioritises statistical methods which do not accommodate the stochastic, non-linear, dynamic interactions between humans and their environment. The inclusion of practitioners in the process of evidence development and utilisation of complex systems methods mitigates these issues and results in locally relevant, timely evidence for decision-making. Methods The aim of this work was to develop localised evidence for decision-making for schistosomiasis control in Uganda, Malawi, and Tanzania. Workshops were conducted with practitioners from the Ministries of Health at various levels and partner organisations to identify evidence needs for their decision-making processes and perceptions of disease transmission and control activities. Participatory systems mapping was used to identify factors directly and indirectly related to transmission. The maps were synthesised to a master complex systems map, which served as the blueprint for a generalised spatial agent-based model and specific ABMs tailored to the evidence needs of decision-makers. Results There was a gap in available evidence for practitioners to advocate for resources within the MoH and government budgets, as well as intervention efficacy and resource allocation. The adaptable and data-inclusive characteristics of the AMBs made them well-suited to produce localised outputs. Converted to NetLogo with a tailored user interface, these models were appropriate and responsive to the needs of decision-makers from village to national levels and across country contexts. Conclusions Used together, participatory and agent-based modelling resulted in the development of responsive and relevant evidence for practitioner decision-making. This process is generalisable and transferable to other diseases and locations outside of those in this study. Key messages The use of participatory systems mapping to develop agent-based models resulted in relevant and timely evidence for practitioner decision-making. The approach used here is transferable and generalisable outside schistosomiasis control and the contexts in this study.

A Participatory Systems Mapping (PSM) based approach towards analysis of business sustainability of rural Indian milk dairies

Drawing from the theories of Participatory Systems Mapping (PSM) this study presents an approach to analysing the business sustainability of entrepreneurial dairy ventures in India. The article begins with a general introduction to the small and medium scale dairy ventures in rural India, highlighting the prominent issues and challenges faced by the stakeholders. The second part demonstrates the use of the PSM framework in developing the Stock and flow diagram (SFD). Further, data from a local milk dairy is collected, and simulations are carried out between 2017–2025 using Vensim®. The outputs are analysed, and inferences are made. This study is expected to enable the policy makers towards the development of sustainable strategies for dairy businesses in general and enable the entrepreneur to analyse the future trends of the potential strategies under his consideration

Framing Sustainable Consumption in Different Ways: Policy Lessons from Two Participatory Systems Mapping Exercises in Hungary

Sustainable consumption as a complex phenomenon at the boundaries of different (ecological, economic, social) systems requires theoretical approaches that do justice to its complex causality and dynamism. Participatory systems mapping offers a tool to achieve this purpose. Its policy relevance lies in its ability to include diverse views, multiple actors, and offer options for policy intervention. The research reported here applied participatory systems mapping in order to define and identify system boundaries for sustainable consumption and uncover perceived causal relationships among the determining factors of sustainable consumption. By revealing the mental models of an expert and a conscious consumer panel on sustainable consumption in general, we can shed light on the cognitive constructions of sustainable consumption and identify most important boundaries that were chosen and their implications on policy-making. The expert panel framed the boundaries as lack of sustainable consumption, while the conscious consumer panel employed a positive framing as strong communities in sustainable consumption. The two panels also differed in their focus on scale: Experts targeted the national scale, while conscious consumers concentrated at the local scale.

Modelling feedback processes underpinning management of ecosystem services: The role of participatory systems mapping

Ecosystem services are dynamically interdependent. When conducting studies on ecosystem services valuation and assessment, the interdependencies and feedback structures underpinning ecosystem functioning should be identified and explicitly considered in management processes, especially when the goal is to pursue a plural and integrative approach that accounts for multiple values. This paper explores the role of a participatory system dynamics modelling approach – participatory systems mapping – as a tool to articulate different value dimensions of ecosystem services. The application of the tool is illustrated with a case study conducted in a protected area in Portugal, wherein inter-organisational stakeholder groups collaborated in the conceptualization of feedback processes characterizing ecosystem services during a group modelling workshop. The outcomes of the participatory workshop were submitted to a post-production process and returned to participants though an individual online survey aiming to validate the changes. Food production, recreation and ecotourism, biodiversity conservation and climate regulation were the ecosystem services explored. Results show that by accommodating the co-creation of causal system maps with stakeholders, the proposed approach fosters sharing of insights on the underlying cause–effect mechanisms and leverage points, supporting the identification of interrelationships between different ecosystem services and the selection of key indicators for management processes.