Application of artificial intelligence using a convolutional neural network for detecting cholesteatoma in endoscopic enhanced images

Abstract

ObjectiveWe examined whether artificial intelligence (AI) used with the novel digital image enhancement system modalities (CLARA+CHROMA, SPECTRA A, and SPECTRA B) could distinguish the cholesteatoma matrix, cholesteatoma debris, and normal middle ear mucosa, and observe the middle ear cavity during middle ear cholesteatoma surgery. MethodsA convolutional neural network (CNN) was trained with a set of images chosen by an otologist. To evaluate the diagnostic accuracy of the constructed CNN, an independent test data set of middle ear images was collected from 14 consecutive patients with 26 cholesteatoma matrix lesions, who underwent transcanal endoscopic ear surgery at a single hospital from August 2018 to September 2019. The final test data set included 58 total images, with 1‒5 images from each modality for each case. ResultsThe CNN required only 10 s to analyze more than 58 test images. Using SPECTRA A and SPECTRA B, the CNN correctly diagnosed 15 and 15 of 26 cholesteatoma matrix lesions, with a sensitivity of 34.6% and 42.3%, and with a specificity of 81.3% and 87.5%, respectively. ConclusionOur preliminary study revealed that AI and novel imaging modalities are potentially useful tools for identifying and visualizing the cholesteatoma matrix during endoscopic ear surgery. The diagnostic ability of the CNN is not yet appropriate for implementation in daily clinical practice, based on our study findings. However, in the future, these techniques and AI tools could help to reduce the burden on surgeons and will facilitate telemedicine in remote and rural areas, as well as in developing countries where the number of surgeons is limited.