Isolating red flags to enhance diagnosis (I-RED): An experimental vignette study.

Abstract

To investigate effects of a cognitive intervention based on isolation of red flags (I-RED) on diagnostic accuracy of 'do-not-miss diagnoses.' A 2×2 randomized case vignette-based experiment with manipulation of I-RED strategy between subjects and case complexity within subjects. Two university-based residency programs. One-hundred and nine pediatric residents from all levels of training. Participants were randomly assigned to the I-RED vs. control group, and within each group, they were further randomized to the order in which they saw simple and complex cases. The I-RED strategy involved an instruction to look for a constellation of symptoms, signs, clinical data or circumstances that should heighten suspicion for a serious condition. Primary outcome was diagnostic accuracy, scored as 1 if any of the three differentials given by participants included the correct diagnosis, and 0 if not. We analyzed effects of I-RED strategy on diagnostic accuracy using logistic regression. I-RED strategy did not yield statistically higher diagnostic accuracy compared to controls (62 vs. 48%, respectively; odd ratio=2.07 [95% confidence interval, 0.78-5.5], P=0.14) although participants reported higher decision confidence compared to controls (7.00 vs. 5.77 on a scale of 1 to 10, P<0.02) in simple but not complex cases. I-RED strategy significantly shortened time to decision (460 vs. 657s, P<0.001) and increased the number of red flags generated (3.04 vs. 2.09, P<0.001). A cognitive strategy of prompting red flag isolation prior to differential diagnosis did not improve diagnostic accuracy of 'do-not-miss diagnoses.' Given the paucity of evidence-based solutions to reduce diagnostic error and the intervention's potential effect on confidence, findings warrant additional exploration.