Lower Recall Rates Reduced Readers’ Sensitivity in Screening Mammography

Abstract

Higher recall rates have been related to increased false positive decisions, causing significant psychological and economical costs for both screened women and the mammography screening service respectively. This study compares breast readers' performance in a laboratory setting under varying levels of recall rates. Four experienced radiologists volunteered to read a single test set of 200 mammographic cases over three separate conditions. The test set contained of 180 normal and 20 abnormal cases and the participants were asked to identify each case that required to be recalled in line with three different target recall rates: control unspecified or free recall first read, 15i¾?% second read and 10i¾?% third read. Readers were required to mark the location of any malignancies using custom made detection software. The recall rates for the control condition ranged between 18.5i¾?% and 34i¾?%. Statistically significant differences were observed in sensitivity for control mediani¾?=i¾?0.85 vs 15i¾?% mediani¾?=i¾?0.65, zi¾?=i¾?-2.381, Pi¾?=i¾?0.017, 15i¾?% vs 10i¾?% mediani¾?=i¾?0.55, zi¾?=i¾?-2.428, Pi¾?=i¾?0.015 and control vs 10i¾?% zi¾?=i¾?-2.381, Pi¾?=i¾?0.017. ROC AUC was significantly different for control mediani¾?=i¾?0.84 vs 15i¾?% mediani¾?=i¾?0.79, zi¾?=i¾?-2.381, Pi¾?=i¾?0.017 and 15i¾?% vs 10i¾?% mediani¾?=i¾?0.75, zi¾?=i¾?-2.381, Pi¾?=i¾?0.017. Specificity significantly improved at lower recall rate of 10i¾?% mediani¾?=i¾?0.95 vs 15i¾?% mediani¾?=i¾?0.92, zi¾?=i¾?-2.428, Pi¾?=i¾?0.017. Setting specific target recall rates for readers significantly limited their performance in correctly identifying cancers. In this study, decreasing the number of recalled cases down to 10i¾?%, significantly reduced cancer detection, with a significant improvement in specificity Pi¾?≤i¾?0.05.