Pathologic Image Classification of Flat Urothelial Lesions Using Pathologic Criteria-Based Deep Learning

Abstract

Pathologic diagnosis of flat urothelial lesions is subject to high interobserver variability. We expected that deep learning could improve the accuracy and consistency of such pathologic diagnosis, although the learning process is a black box. We therefore propose a new approach for pathologic image classification incorporating the diagnostic process of the pathologist into a deep learning method. A total of 267 H&E-stained slides of normal urothelium and urothelial lesions from 127 cases were examined. Six independent convolutional neural networks were trained to classify pathologic images according to six pathologic criteria. We then used these networks in the main training for the final diagnosis. Compared with conventional manual analysis, our method significantly improved the classification accuracy of images of flat urothelial lesions. The automated classification showed almost perfect agreement (weighted κ = 0.98) with the consensus reading. In addition, our approach provides the advantages of reliable diagnosis corresponding to histologic interpretation. We used deep learning to establish an automated subtype classifier for flat urothelial lesions that successfully combines traditional morphologic approaches and complex deep learning to achieve a learning mechanism that seems plausible to the pathologist.