The auxiliary diagnosis of thyroid echogenic foci based on a deep learning segmentation model: A two-center study

Abstract

ObjectiveThe aim of this study is to develop AI-assisted software incorporating a deep learning (DL) model based on static ultrasound images. The software aims to aid physicians in distinguishing between malignant and benign thyroid nodules with echogenic foci and to investigate how the AI-assisted DL model can enhance radiologists’ diagnostic performance. MethodsFor this retrospective study, a total of 2724 ultrasound (US) scans were collected from two independent institutions, encompassing 1038 echogenic foci nodules. All echogenic foci were confirmed by pathology. Three DL segmentation models (DeepLabV3+, U-Net, and PSPNet) were developed, with each model using two different backbones to extract features from the nodular regions with echogenic foci. Evaluation indexes such as Mean Intersection over Union (MIoU), Mean Pixel Accuracy (MPA), and Dice coefficients were employed to assess the performance of the segmentation model. The model demonstrating the best performance was selected to develop the AI-assisted diagnostic software, enabling radiologists to benefit from AI-assisted diagnosis. The diagnostic performance of radiologists with varying levels of seniority and beginner radiologists in assessing high-echo nodules was then compared, both with and without the use of auxiliary strategies. The area under the receiver operating characteristic curve (AUROC) was used as the primary evaluation index, both with and without the use of auxiliary strategies. ResultsIn the analysis of Institution 2, the DeepLabV3+ (backbone is MobileNetV2 exhibited optimal segmentation performance, with MIoU = 0.891, MPA = 0.945, and Dice = 0.919. The combined AUROC (0.693 [95% CI 0.595–0.791]) of radiology beginners using AI-assisted strategies was significantly higher than those without such strategies (0.551 [0.445–0.657]). Additionally, the combined AUROC of junior physicians employing adjuvant strategies improved from 0.674 [0.574–0.774] to 0.757 [0.666–0.848]. Similarly, the combined AUROC of senior physicians increased slightly, rising from 0.745 [0.652–0.838] to 0.813 [0.730–0.896]. With the implementation of AI-assisted strategies, the accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of both senior physicians and beginners in the radiology department underwent varying degrees of improvement. ConclusionsThis study demonstrates that the DL-based auxiliary diagnosis model using US static images can improve the performance of radiologists and radiology students in identifying thyroid echogenic foci.