Sampling biases and reproducibility: experimental design decisions affect behavioural responses in hermit crabs

Abstract

How important are sampling and experimental design decisions in shaping test subject behaviour under laboratory conditions? We examined the effects of circatidal rhythm, time held in captivity, sampling location (open or covered areas of habitat), acclimation period and water depth on activity and emergence latency in hermit crabs ( Pagurus bernhardus ). We found that subjects held in captivity for 1 month and those collected from the open were faster to emerge from their shells after disturbance compared, respectively, to those tested after 1 day in captivity or collected from beneath cover. We also found that subjects tested after shorter acclimation periods were more active than those tested following longer acclimation periods. Our findings reveal that sampling and study design decisions can have pronounced influences on subject behaviour measured under otherwise common conditions, with potentially important implications for interpretation and reproducibility of findings. As researchers we should take care to explicitly consider how sampling biases and effects arising from our experimental protocols might affect the behavioural responses of test subjects. Doing so can help us make more reasonable generalizations beyond our subject pool, draw better-informed comparisons between studies and achieve greater reproducibility of findings. • Do decisions we routinely make regarding experimental design affect outcomes? • Are animals we test representative of the wider populations we aim to understand? • We asked if subtle design decisions affected behaviour under laboratory conditions. • Time in captivity, acclimation time and location of collection affected behaviour. • We should declare and discuss potential for bias arising from experimental designs.