Evaluation of 3 Cognitive Load Measures During Repeated Simulation Exercises for Novice Anesthesiology Residents

Abstract

Maintaining an appropriate level of cognitive load during simulations is crucial to optimize learning. We evaluated 3 subjective measures of cognitive load in a simulated operating room (OR) context across multiple scenarios of varying complexity. This observational study of 25 first-year anesthesiology residents took place during a 5-day simulation "Boot Camp." Each day, participants completed 2 different high-fidelity scenarios in a fully equipped simulated OR. After each simulation, participants completed 3 cognitive load measures: the Paas scale, NASA Task Load Index (TLX), and Cognitive Load Component (CLC) questionnaire. Two-way repeated-measures and mixed-design analyses of variance, with the cognitive load measures and scenarios as independent factors, were used to determine the effect of using different measures to report cognitive load. Cognitive load scores reported by all measures correlated significantly with one another (P < 0.01): TLX and Paas (r = 0.65); Paas and CLC (r = 0.63); and TLX and CLC (r = 0.61). The CLC subscale scores (intrinsic, extraneous, germane) also correlated significantly with composite TLX and Paas scores (P < 0.01). Scenarios and measures displayed significant interaction: F(10, 210) = 3.01, P = 0.001. Participants reported highest overall cognitive load using the Paas scale. All cognitive load measures were sensitive to scenario variability and showed similar fluctuation patterns across the 10 scenarios. The findings suggest that cognitive load measures can help create benchmarks based on learner perceptions of cognitive burden for different simulation scenarios.