The past, present, and future of experimental methods in the social sciences

Abstract

In the midst of the current causal revolution, experimental methods are increasingly embraced across the social sciences. We first document the growth in the use of the experimental method and then overview the current state of the field along with suggestions for future research. Our review covers the core features of experiments that facilitate causal inference, and we offer numerous examples of different experimental designs and the types of research questions they are well-suited to test. We then harmonize popular but differing perspectives on validity in regard to experiments focused on theoretical considerations. Next, we detail a new framework of purposive sampling for social science experiments, suggesting researchers could benefit from moving beyond only two stock choices of representativeness or convenience. We then discuss issues of analysis unique to experimental data before ending with a critical discussion of null findings, open-science practices, social desirability, and other open debates in the experimental methods literature.