Computer-assisted detection for CT colonography: external validation

Abstract

To externally validate a computer-assisted detection (CAD) system for computed tomography (CT) colonography, using data from a single centre uninvolved with the software development. Twenty-five multi-detector CT colonography examinations of patients with validated polyps accumulated at a single centre were examined by two readers who used endoscopic and histopathological data to identify polyp coordinates. A CAD system that had been developed using data from elsewhere, and had not previously encountered the present data, was then applied to the data at sphericity filter settings of 0.75 and 0.50 and identified potential polyps. True-positive, false-negative, and false-positive counts were determined by comparison with the known polyp coordinates. Twenty-five patients had 57 polyps, median size 6mm (range 1-15mm). Per-patient sensitivity for the CAD system was 96% (24 of 25). The CAD system detected 44 (77%) polyps at sphericity setting 0.75 and 49 (86%) polyps at sphericity 0.50: the additional five polyps detected all measured 5mm or less. Sphericity of 0.75 resulted in a median of 10 (one to 34) easily dismissed false-positive prompts per patient and a median of 4 (zero to 15) that needed three-dimensional rendering before dismissal. This rose to 32 (16 to 99) and 11 (three to 35), respectively, at sphericity 0.5. A per-patient sensitivity of 96% was found for the CAD system (in patients with a median polyp diameter of 6mm) using external validation, a more stringent test than either internal cross-validation or temporal validation. Decreasing sphericity increases sensitivity for small polyps at the expense of decreased specificity.