Abstract 1648: Deep learning tissue "fingerprints" to identify patients and predict clinical subtypes of breast cancer from digital pathology images

Abstract

Abstract Inspired by facial recognition, we define an analogous problem in digital pathology called tissue matching. The objective is to match histology image patches to the patient. Unlike many classification problems in pathology, tissue matching comes with its own ground truth, and does not require subjective annotation. Using tissue-matching via deep neural networks, we developed strategies to overcome common sources of noise in histology data, including H&E and slide scanner variability. We demonstrate that the typical approach of increasing the training set size, in the current study up to 12,000 tissue cores, yields only moderate gains in test accuracy, while including a loss term promoting style-invariance cooperatively improves the impact of scaling training set size. Our best neural network learned features that matched patients from the test set of H&E image patches with 93% accuracy (n=104 patients, baseline accuracy <1%). Leveraging this network’s identification ability, we applied its internal representation as a feature vector (tissue fingerprint) to apply to other problems in pathology. We found that a fingerprint-based classifier could predict estrogen receptor status from breast cancer whole-slides on two separate cohorts with high accuracy (AUCROC=0.89), a sizeable improvement over previous approaches. This work presents a novel, scalable, and transparent approach to train neural networks to identify distinctive features of pathology images. These features have demonstrated utility in classifying biomarkers from morphology and have the potential to assist in a number of difficult tasks in pathology, including tissue subtype classification and patient tumor similarity assessments based on morphometry. Citation Format: Rishi Rawat, Fei Sha, Darryl Shibata, Daniel Ruderman, David Agus. Deep learning tissue "fingerprints" to identify patients and predict clinical subtypes of breast cancer from digital pathology images [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2019; 2019 Mar 29-Apr 3; Atlanta, GA. Philadelphia (PA): AACR; Cancer Res 2019;79(13 Suppl):Abstract nr 1648.