Development and validation of a CT-based deep learning algorithm to augment non-invasive diagnosis of idiopathic pulmonary fibrosis

Abstract

RationaleNon-invasive diagnosis of idiopathic pulmonary fibrosis (IPF) involves identification of usual interstitial pneumonia (UIP) pattern by computed tomography (CT) and exclusion of other known etiologies of interstitial lung disease (ILD). However, uncertainty in identification of radiologic UIP pattern leads to the continued need for invasive surgical biopsy. We thus developed and validated a machine learning algorithm using CT scans alone to augment non-invasive diagnosis of IPF. MethodsThe primary algorithm was a deep learning convolutional neural network (CNN) with model inputs of CT images only. The algorithm was trained to predict IPF among cases of ILD, with reference standard of multidisciplinary discussion (MDD) consensus diagnosis. The algorithm was trained using a multi-center dataset of more than 2000 cases of ILD. A US-based multi-site cohort (n = 295) was used for algorithm tuning, and external validation was performed with a separate dataset (n = 295) from European and South American sources. ResultsIn the tuning set, the model achieved an area under the receiver operating characteristic curve (AUC) of 0.87 (CI: 0.83–0.92) in differentiating IPF from other ILDs. Sensitivity and specificity were 0.67 (0.57–0.76) and 0.90 (0.83–0.95), respectively. By contrast, pre-recorded assessment prior to MDD diagnosis had sensitivity of 0.31 (0.23–0.42) and specificity of 0.92 (0.87–0.95). In the external test set, c-statistic was also 0.87 (0.83–0.91). Model performance was consistent across a variety of CT scanner manufacturers and slice thickness. ConclusionThe presented deep learning algorithm demonstrated consistent performance in identifying IPF among cases of ILD using CT images alone and suggests generalization across CT manufacturers.