Can You Really Study an Army on the Internet? Comparing How Status Tasks Perform in the Laboratory and Online Settings

Abstract

Laboratory experiments have a long history within sociology, with their ability to test causality and their utility for directly observing behavior providing key advantages. One influential social psychological field, status characteristics and expectation states theory, has almost exclusively used laboratory experiments to test the theory. Unfortunately, laboratory experiments are resource intensive, requiring a research pool, laboratory space, and considerable amounts of time. For these and other reasons, social scientists are increasingly exploring the possibility of moving experiments from the lab to an online platform. Despite the advantages of the online setting, the transition from the lab is challenging, especially when studying behavior. In this project, we develop methods to translate the traditional status characteristics experimental setting from the laboratory to online. We conducted parallel laboratory and online behavioral experiments using three tasks from the status literature, comparing each task’s ability to differentiate on the basis of status distinctions. The tasks produce equivalent results in the online and laboratory environment; however, not all tasks are equally sensitive to status differences. Finally, we provide more general guidance on how to move vital aspects of laboratory studies, such as debriefing, suspicion checks, and scope condition checks, to the online setting.