One test, five scoring procedures: different ways of approaching the cognitive reflection test

Abstract

ABSTRACTAlthough the cognitive reflection test (CRT) represents a frequently used instrument within the field of judgement and decision-making, its scope and detailed characteristics are still not well understood. Therefore, the present article discusses 5 different ways of scoring the CRT that include the regular CRT scoring procedure (CRT-Regular), adding up the intuitive answers (CRT-Intuitive), calculating the proportion of intuitive in total incorrect answers (CRT-Proportion Intuitive), scoring only non-intuitive answers irrespective of their correctness (CRT-Reflection) and calculating the proportion of correct in total non-intuitive answers (CRT-Calculation). We conducted 2 studies aimed at investigating the associations among these scoring techniques and their relationships with thinking dispositions, specifically the need for cognition, faith in intuition, superstitious thinking, maximising and post-choice regret. The results indicate that thinking dispositions play a modest role in explaining the performance on the CRT. The specific associations among the investigated dispositions and different CRT scoring techniques are discussed.