Multi-level cancer profiling through joint cell-graph representations

Abstract

Listen

Translate article

Computer-aided analysis of digitized pathology samples has significantly advanced with the rapid progression of machine and Deep Learning (DL) methods. However, most existing approaches primarily focus on features extracted from patches due to the large image sizes. This focus limits the ability of Convolutional Neural Networks (CNNs) to capture global information from the samples, resulting in an incomplete phenotypical and topological representation and thereby restricting the diagnostic capabilities of these methods. The recent emergence of Graph Neural Networks (GNNs) offers new opportunities to overcome these limitations through graph-driven representations of pathological samples. This work introduces a graph-based framework that encompasses diverse cancer types and integrates different imaging modalities. In this framework, histopathology samples are represented as graphs, and a pipeline facilitating cell-wise and disease classification is developed. The results support this motivation: for cell-wise classification, we achieved an average accuracy of 88%, and for disease-wise classification, an average accuracy of 83%, outperforming reference models such as XGBoost and standard CNNs. This approach not only provides flexibility in combining various diseases but also extends to integrating different staining techniques.