Intervention Tournaments: An Overview of Concept, Design, and Implementation

Abstract

A large portion of research in the social sciences is devoted to using interventions to combat societal and social problems, such as prejudice, discrimination, and intergroup conflict. However, these interventions are often developed using the theories and/or intuitions of the individuals who developed them and evaluated in isolation without comparing their efficacy with other interventions. Here, we make the case for an experimental design that addresses such issues: an intervention tournament—that is, a study that compares several different interventions against a single control and uses the same standardized outcome measures during assessment and participants drawn from the same population. We begin by highlighting the utility of intervention tournaments as an approach that complements other, more commonly used approaches to addressing societal issues. We then describe various approaches to intervention tournaments, which include crowdsourced, curated, and in-house-developed intervention tournaments, and their unique characteristics. Finally, we discuss practical recommendations and key design insights for conducting such research, given the existing literature. These include considerations of intervention-tournament deployment, characteristics of included interventions, statistical analysis and reporting, study design, longitudinal and underlying psychological mechanism assessment, and theoretical ramifications.