Evaluation of deep learning algorithms in detecting moyamoya disease: a systematic review and single-arm meta-analysis.

Abstract

The diagnosis of Moyamoya disease (MMD) relies heavily on imaging, which could benefit from standardized machine learning tools. This study aims to evaluate the diagnostic efficacy of deep learning (DL) algorithms for MMD by analyzing sensitivity, specificity, and the area under the curve (AUC) compared to expert consensus. We conducted a systematic search of PubMed, Embase, and Web of Science for articles published from inception to February 2024. Eligible studies were required to report diagnostic accuracy metrics such as sensitivity, specificity, and AUC, excluding those not in English or using traditional machine learning methods. Seven studies were included, comprising a sample of 4,416 patients, of whom 1,358 had MMD. The pooled sensitivity for common and random effects models was 0.89 (95% CI: 0.85 to 0.92) and 0.92 (95% CI: 0.85 to 0.96), respectively. The pooled specificity was 0.89 (95% CI: 0.86 to 0.91) in the common effects model and 0.91 (95% CI: 0.75 to 0.97) in the random effects model. Two studies reported the AUC alongside their confidence intervals. A meta-analysis synthesizing these findings aggregated a mean AUC of 0.94 (95% CI: 0.92 to 0.96) for common effects and 0.89 (95% CI: 0.76 to 1.02) for random effects models. Deep learning models significantly enhance the diagnosis of MMD by efficiently extracting and identifying complex image patterns with high sensitivity and specificity. Trial registration: CRD42024524998 https://www.crd.york.ac.uk/prospero/displayrecord.php?RecordID=524998.