The value of mass-produced COVID-19 scenarios: A quality evaluation of development processes and scenario content

Abstract

Hundreds of scenarios were developed across the world in 2020, aimed at generating forward-looking conversations, better understanding for COVID-19 transmission rates, trialling economic outcomes, and stress-testing existing systems in light of the developing pandemic. In response, Cairns & Wright (2020) questioned the value of these mass-produced scenarios created retroactively to existing crises. We address their concerns by evaluating 213 COVID-19 scenarios developed in the first wave of the pandemic. We use two yardsticks as guiding maps against which we plot each scenario's profile and test for values of high-quality process and content. Our analyses reveal various points of high and low qualities, in both process and content. Though most reported processes fell towards lower quality standards, and content largely carried generic applications, the prolific levels of exploratory narratives reflected a mixture of high and low-quality values. Together, our papers develop and reinforce the message that scenario interventions, especially in times of crisis, should reflect more proactive efforts and ensure powerful stakeholders, decision-makers, and affected community members are included in the development of scenarios.