The Rise and Fall of the Dot-Probe Task: Opportunities for Metascientific Learning

Abstract

Much of the extensive literature on spatial attentional bias is built on measurements using the dot-probe task. In recent years, concerns have been raised about the psychometric properties of bias scores derived from this task. The goal of the current paper is to look ahead and evaluate possible responses of the field to this situation from a metascientific perspective. Therefore, educated guesses are made on foreseeable but preventable future (repeats of) errors. We discuss, first, the issue of overreactions to the disappointing findings, especially in the context of the potential of a new generation of promising variations on the traditional dot-probe task; second, concerns with competition between tasks; and third, the misuse of rationales to direct research efforts. Alternative directions are suggested that may be more productive. We argue that more adequately exploring and testing methods and adjusting scientific strategies will be critical to avoiding suboptimal research and potentially failing to learn from mistakes. The current articulation of arguments and concerns may therefore be of use in discussions arising around future behavioural research into spatial attentional bias and more broadly in psychological science.