Measurement equivalence in replications of experiments: when and why it matters and guidance on how to determine equivalence

Abstract

ABSTRACTReplications of experiments are typically conducted to verify initial findings, increase their external validity, or to study the boundary conditions of treatment effects. A crucial and implicitly made assumption is that outcome measures in experiments are sufficiently comparable (i.e., equivalent) across experimental settings. We argue that there are good reasons to believe that this equivalence assumption may not always be met and should therefore be tested empirically. Integrating the literature on experimental replication and survey measurement equivalence, we provide guidance when and how experimental replicators need to determine cross-replication equivalence.