Histopathological Slide Images Research Articles

A deep learning approach for ovarian cancer detection and classification based on fuzzy deep learning

Different oncologists make their own decisions about the detection and classification of the type of ovarian cancer from histopathological whole slide images. However, it is necessary to have an automated system that is more accurate and standardized for decision-making, which is essential for early detection of ovarian cancer. To help doctors, an automated detection and classification of ovarian cancer system is proposed. This model starts by extracting the main features from the histopathology images based on the ResNet-50 model to detect and classify the cancer. Then, recursive feature elimination based on a decision tree is introduced to remove unnecessary features extracted during the feature extraction process. Adam optimizers were implemented to optimize the network’s weights during training data. Finally, the advantages of combining deep learning and fuzzy logic are combined to classify the images of ovarian cancer. The dataset consists of 288 hematoxylin and eosin (H&E) stained whole slides with clinical information from 78 patients. H&E-stained Whole Slide Images (WSIs), including 162 effective and 126 invalid WSIs were obtained from different tissue blocks of post-treatment specimens. Experimental results can diagnose ovarian cancer with a potential accuracy of 98.99%, sensitivity of 99%, specificity of 98.96%, and F1-score of 98.99%. The results show promising results indicating the potential of using fuzzy deep-learning classifiers for predicting ovarian cancer.

Ensemble transformer-based multiple instance learning to predict pathological subtypes and tumor mutational burden from histopathological whole slide images of endometrial and colorectal cancer

In endometrial cancer (EC) and colorectal cancer (CRC), in addition to microsatellite instability, tumor mutational burden (TMB) has gradually gained attention as a genomic biomarker that can be used clinically to determine which patients may benefit from immune checkpoint inhibitors. High TMB is characterized by a large number of mutated genes, which encode aberrant tumor neoantigens, and implies a better response to immunotherapy. Hence, a part of EC and CRC patients associated with high TMB may have higher chances to receive immunotherapy. TMB measurement was mainly evaluated by whole-exome sequencing or next-generation sequencing, which was costly and difficult to be widely applied in all clinical cases. Therefore, an effective, efficient, low-cost and easily accessible tool is urgently needed to distinguish the TMB status of EC and CRC patients. In this study, we present a deep learning framework, namely Ensemble Transformer-based Multiple Instance Learning with Self-Supervised Learning Vision Transformer feature encoder (ETMIL-SSLViT), to predict pathological subtype and TMB status directly from the H&E stained whole slide images (WSIs) in EC and CRC patients, which is helpful for both pathological classification and cancer treatment planning. Our framework was evaluated on two different cancer cohorts, including an EC cohort with 918 histopathology WSIs from 529 patients and a CRC cohort with 1495 WSIs from 594 patients from The Cancer Genome Atlas. The experimental results show that the proposed methods achieved excellent performance and outperforming seven state-of-the-art (SOTA) methods in cancer subtype classification and TMB prediction on both cancer datasets. Fisher’s exact test further validated that the associations between the predictions of the proposed models and the actual cancer subtype or TMB status are both extremely strong (p<0.001). These promising findings show the potential of our proposed methods to guide personalized treatment decisions by accurately predicting the EC and CRC subtype and the TMB status for effective immunotherapy planning for EC and CRC patients.

Deep neural networks integrating genomics and histopathological images for predicting stages and survival time-to-event in colon cancer.

There exists an unexplained diverse variation within the predefined colon cancer stages using only features from either genomics or histopathological whole slide images as prognostic factors. Unraveling this variation will bring about improved staging and treatment outcomes. Hence, motivated by the advancement of Deep Neural Network (DNN) libraries and complementary factors within some genomics datasets, we aggregate atypia patterns in histopathological images with diverse carcinogenic expression from mRNA, miRNA and DNA methylation as an integrative input source into a deep neural network for colon cancer stages classification, and samples stratification into low or high-risk survival groups. The genomics-only and integrated input features return Area Under Curve-Receiver Operating Characteristic curve (AUC-ROC) of 0.97 compared with AUC-ROC of 0.78 obtained when only image features are used for the stage's classification. A further analysis of prediction accuracy using the confusion matrix shows that the integrated features have a weakly improved accuracy of 0.08% more than the accuracy obtained with genomics features. Also, the extracted features were used to split the patients into low or high-risk survival groups. Among the 2,700 fused features, 1,836 (68%) features showed statistically significant survival probability differences in aggregating samples into either low or high between the two risk survival groups. Availability and Implementation: https://github.com/Ogundipe-L/EDCNN.

Addressing data imbalance challenges in oral cavity histopathological whole slide images with advanced deep learning techniques

Addressing data imbalance challenges in oral cavity histopathological whole slide images with advanced deep learning techniques

Deep learning to assess microsatellite instability directly from histopathological whole slide images in endometrial cancer

Molecular classification, particularly microsatellite instability-high (MSI-H), has gained attention for immunotherapy in endometrial cancer (EC). MSI-H is associated with DNA mismatch repair defects and is a crucial treatment predictor. The NCCN guidelines recommend pembrolizumab and nivolumab for advanced or recurrent MSI-H/mismatch repair deficient (dMMR) EC. However, evaluating MSI in all cases is impractical due to time and cost constraints. To overcome this challenge, we present an effective and efficient deep learning-based model designed to accurately and rapidly assess MSI status of EC using H&E-stained whole slide images. Our framework was evaluated on a comprehensive dataset of gigapixel histopathology images of 529 patients from the Cancer Genome Atlas (TCGA). The experimental results have shown that the proposed method achieved excellent performances in assessing MSI status, obtaining remarkably high results with 96%, 94%, 93% and 100% for endometrioid carcinoma G1G2, respectively, and 87%, 84%, 81% and 94% for endometrioid carcinoma G3, in terms of F-measure, accuracy, precision and sensitivity, respectively. Furthermore, the proposed deep learning framework outperforms four state-of-the-art benchmarked methods by a significant margin (p < 0.001) in terms of accuracy, precision, sensitivity and F-measure, respectively. Additionally, a run time analysis demonstrates that the proposed method achieves excellent quantitative results with high efficiency in AI inference time (1.03 seconds per slide), making the proposed framework viable for practical clinical usage. These results highlight the efficacy and efficiency of the proposed model to assess MSI status of EC directly from histopathological slides.

Abstract PO4-07-05: Clinical evaluation of image-based risk profiling in breast cancer histopathology and comparison to an established gene expression assay

Abstract Background: Among oestrogen receptor (ER)-positive and human epidermal growth factor receptor 2 (HER2)-negative early breast cancer, a significant proportion of patients are categorised as intermediate risk, based on classic clinico-pathological variables, thus providing limited information to guide adjuvant chemotherapy decisions. Prognostic risk profiling is an integrated part of modern breast cancer diagnostics to provide additional risk information for this patient group. Among the established prognostic assays based on gene expression, the Prosigna assay is widely used and provides an individual risk of recurrence (ROR) score and identifies intrinsic subtypes with associated survival outcomes. Pioneering artificial intelligence-based precision diagnostics, Stratipath Breast, is a deep learning-based image analysis tool that utilises digitised histopathological whole slide images to stratify intermediate risk patients in terms of risk of recurrence. Materials and methods: The study included 234 invasive breast tumours from patients with early ER-positive HER2-negative breast cancer, clinically assessed as intermediate risk tumours and eligible for chemotherapy. All tumours had therefore previously been analysed by the Prosigna assay in clinical routine at point of diagnosis between 2020 and 2022 at the Karolinska University Hospital and Södersjukhuset, Stockholm, Sweden. Clinicopathological data including Prosigna results (ROR score, risk group and intrinsic subtype) were extracted from medical records, along with the corresponding archived haematoxylin and eosin (HE)-stained formalin-fixed paraffin-embedded tissue slides. The HE slides were subsequently digitised and analysed by the Stratipath Breast tool. The agreement between the two tests for risk stratification was evaluated in this real-world breast cancer case series. Results: The Prosigna assay classified 76 (32.5%), 110 (47.0%) and 48 (20.5%) tumours as low, intermediate and high risk, respectively. The Stratipath Breast analysis identified 116 (49.6%) tumours as low risk and 118 (50.4%) as high risk. Among Prosigna intermediate risk tumours, 52 (47.3%) were stratified as low risk and 58 (52.7%) as high risk by Stratipath Breast. The overall agreement between the two tests for low risk and high risk groups was 71.0%, with a Cohen’s linear kappa of 0.42. Twelve of the 48 Prosigna high risk cases were classified as Stratipath low risk. ROR scores were higher in the Stratipath high risk group compared to the low risk group (p &amp;lt; 0.001), across all cases as well as in the Prosigna intermediate group. Among the 176 histological grade (NHG) 2 tumours, 97 (55.1%) and 79 (44.9%) were stratified as Stratipath low risk and high risk, respectively, whereas 66 (37.5%), 83 (47.2%) and 27 (15.3%) were stratified as Prosigna low, intermediate and high risk, respectively. The majority of NHG1 (10 of 12) and NHG3 (37 of 46) tumours were stratified as Stratipath low risk and high risk, respectively. For both risk profiling tests, NHG and Ki67 proliferation index differed between risk groups. Conclusions: In this study of clinically assessed intermediate risk ER-positive HER2-negative breast cancer, we observed a moderate agreement between Prosigna and Stratipath Breast for low risk and high risk groups. In addition, image-based risk profiling stratified more of the NHG2 tumours as high risk. Citation Format: Stephanie Robertson, Yinxi Wang, Wenwen Sun, Emelie Karlsson, Sandy Kang Lövgren, Mattias Rantalainen, Johan Hartman. Clinical evaluation of image-based risk profiling in breast cancer histopathology and comparison to an established gene expression assay [abstract]. In: Proceedings of the 2023 San Antonio Breast Cancer Symposium; 2023 Dec 5-9; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2024;84(9 Suppl):Abstract nr PO4-07-05.

Abstract 2584: Decoding colon cancer recurrence: Unveiling accurate predictions with attention-guided deep neural networks on histopathological whole slide images

Abstract Background: Up to 40% of colon cancer patients are at high risk of cancer recurrence, yet accurate and timely prediction tools are lacking. Leveraging whole slide images (WSIs) and deep learning models, we aimed to develop precise algorithm for prediction of colon cancer recurrence. Thus, enables risk stratification for optimized therapeutic interventions and improved health outcomes. Design: We designed an attention-based deep learning model for predicting colon cancer recurrence on paraffin-embedded, hematoxylin and eosin-stained colon tissue biopsies of digital slides. The WSIs were downloaded from the TCGA dataset, and preprocessed for color normalization, tissue segmentation, tilling, and histopathological features extraction. The entire dataset was then labeled based on cancer recurrence status, and divided into training (70%), validation (15%), and testing sets (15%). The model's performance was then evaluated by standard evaluation metrics, including receiver operating characteristic Area Under the Curve (AUC) and accuracy, on the training, validation, and testing datasets, where interpretability attention heatmaps were applied to gain insights into specific histological features and patterns involved in the model's decision-making process. The study is supported by the NIH-NCI-T32 for Next Generation Pathologists Program at our institution. Results: A total of 350 WSIs were included and labeled into two classes: post-therapeutic colon cancer recurrence and no recurrence. The tissue segmentation process involved converting RGB images to HSV color space, applying a median blur filter (kernel size: 7), and performing thresholding using Otsu's method. The extracted features were utilized to train and construct a Clustering-constrained Attention Multiple Instance Learning (CLAM) model. The model demonstrated consistent performance across the validation and testing datasets, achieving an AUC of 0.85 with an accuracy of 0.83 on the validation set, and an identical AUC of 0.85 with an accuracy of 0.83 on the testing set, indicating the model's robust ability to identify patients at risk of cancer recurrence. Conclusion: The study demonstrates the strong performance of our deep learning model in accurately identifying patients at risk for colon cancer recurrence based on H&amp;E WSIs. This capability paves the way for optimizing therapeutic interventions and implementing effective surveillance strategies. Consequently, highlighting the crucial role of pathologists in collaborating with the oncologist for optimizing the management of colon cancer care in the era of personalized medicine. Citation Format: Mohammad K. Alexanderani, Mohamed Omar, Matthew Greenblatt, Ethel Cesarman, Maria T. Diaz-Meco, Jorge Moscat, Luigi Marchionni. Decoding colon cancer recurrence: Unveiling accurate predictions with attention-guided deep neural networks on histopathological whole slide images [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl):Abstract nr 2584.

Abstract 886: Integrated deep learning model for predicting DNA methylation and tumor types from histopathology in central nervous system tumors

Abstract Precision in diagnosis of diverse central nervous system (CNS) tumor types is crucial for optimal patient treatment. DNA methylation profiles, which capture the methylation status of thousands of individual CpG sites, are data-driven means to enhance diagnostic accuracy, but this technique is expensive, time-consuming, and not yet routinely available. To address this, we developed DEPLOY, a deep-learning model that predicts 10 major categories of CNS tumors from histopathology. DEPLOY integrates three distinct components: the first classifies CNS tumors directly from histopathology slide images (‘direct model’); the second initially generates predictions for DNA methylation beta values, which are subsequently used for tumor classification (‘indirect model’); and the third classifies tumor types directly from routinely available patient demographics. First, we find that DEPLOY accurately predicted beta values from histopathology images, suggesting that application of inferred methylation data is a promising approach for deep learning histopathology-based classifiers. Using a 10-class model trained on an internal dataset, we apply this model on two independent external test datasets of 1,522 and 348 cases, achieving top-1 accuracies of 96% and 94%, respectively on samples which are predicted with high confidence. Taken together, DEPLOY could assist pathologists in diagnosing CNS tumors, in an equitable very low-cost manner, within a clinically relevant short time frame. Citation Format: Eldad David Shulman, Danh-Tai Hoang, Rust Turakulov, Zied Abdullaev, Omkar Singh, Emma M. Campagnolo, Eric A. Stone, MacLean P. Nasrallah, Eytan Ruppin, Kenneth Aldape. Integrated deep learning model for predicting DNA methylation and tumor types from histopathology in central nervous system tumors [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl):Abstract nr 886.

A multi-class brain tumor grading system based on histopathological images using a hybrid YOLO and RESNET networks

Gliomas are primary brain tumors caused by glial cells. These cancers’ classification and grading are crucial for prognosis and treatment planning. Deep learning (DL) can potentially improve the digital pathology investigation of brain tumors. In this paper, we developed a technique for visualizing a predictive tumor grading model on histopathology pictures to help guide doctors by emphasizing characteristics and heterogeneity in forecasts. The proposed technique is a hybrid model based on YOLOv5 and ResNet50. The function of YOLOv5 is to localize and classify the tumor in large histopathological whole slide images (WSIs). The suggested technique incorporates ResNet into the feature extraction of the YOLOv5 framework, and the detection results show that our hybrid network is effective for identifying brain tumors from histopathological images. Next, we estimate the glioma grades using the extreme gradient boosting classifier. The high-dimensional characteristics and nonlinear interactions present in histopathology images are well-handled by this classifier. DL techniques have been used in previous computer-aided diagnosis systems for brain tumor diagnosis. However, by combining the YOLOv5 and ResNet50 architectures into a hybrid model specifically designed for accurate tumor localization and predictive grading within histopathological WSIs, our study presents a new approach that advances the field. By utilizing the advantages of both models, this creative integration goes beyond traditional techniques to produce improved tumor localization accuracy and thorough feature extraction. Additionally, our method ensures stable training dynamics and strong model performance by integrating ResNet50 into the YOLOv5 framework, addressing concerns about gradient explosion. The proposed technique is tested using the cancer genome atlas dataset. During the experiments, our model outperforms the other standard ways on the same dataset. Our results indicate that the proposed hybrid model substantially impacts tumor subtype discrimination between low-grade glioma (LGG) II and LGG III. With 97.2% of accuracy, 97.8% of precision, 98.6% of sensitivity, and the Dice similarity coefficient of 97%, the proposed model performs well in classifying four grades. These results outperform current approaches for identifying LGG from high-grade glioma and provide competitive performance in classifying four categories of glioma in the literature.

Deep learning model to differentiate Crohn's disease from intestinal tuberculosis using histopathological whole slide images from intestinal specimens.

Crohn's disease (CD) and intestinal tuberculosis (ITB) share similar histopathological characteristics, and differential diagnosis can be a dilemma for pathologists. This study aimed to apply deep learning (DL) to analyze whole slide images (WSI) of surgical resection specimens to distinguish CD from ITB. Overall, 1973 WSI from 85 cases from 3 centers were obtained. The DL model was established in internal training and validated in external test cohort, evaluated by area under receiver operator characteristic curve (AUC). Diagnostic results of pathologists were compared with those of the DL model using DeLong's test. DL model had case level AUC of 0.886, 0.893 and slide level AUC of 0.954, 0.827 in training and test cohorts. Attention maps highlighted discriminative areas and top 10 features were extracted from CD and ITB. DL model's diagnostic efficiency (AUC = 0.886) was better than junior pathologists (*1 AUC = 0.701, P = 0.088; *2 AUC = 0.861, P = 0.788) and inferior to senior GI pathologists (*3 AUC = 0.910, P = 0.800; *4 AUC = 0.946, P = 0.507) in training cohort. In the test cohort, model (AUC = 0.893) outperformed senior non-GI pathologists (*5 AUC = 0.782, P = 0.327; *6 AUC = 0.821, P = 0.516). We developed a DL model for the classification of CD and ITB, improving pathological diagnosis accuracy effectively.

Deep Multi-Dictionary Learning for Survival Prediction With Multi-Zoom Histopathological Whole Slide Images.

Survival prediction based on histopathological whole slide images (WSIs) is of great significance for risk-benefit assessment and clinical decision. However, complex microenvironments and heterogeneous tissue structures in WSIs bring challenges to learning informative prognosis-related representations. Additionally, previous studies mainly focus on modeling using mono-scale WSIs, which commonly ignore useful subtle differences existed in multi-zoom WSIs. To this end, we propose a deep multi-dictionary learning framework for cancer survival prediction with multi-zoom histopathological WSIs. The framework can recognize and learn discriminative clusters (i.e., microenvironments) based on multi-scale deep representations for survival analysis. Specifically, we learn multi-scale features based on multi-zoom tiles from WSIs via stacked deep autoencoders network followed by grouping different microenvironments by cluster algorithm. Based on multi-scale deep features of clusters, a multi-dictionary learning method with a post-pruning strategy is devised to learn discriminative representations from selected prognosis-related clusters in a task-driven manner. Finally, a survival model (i.e., EN-Cox) is constructed to estimate the risk index of an individual patient. The proposed model is evaluated on three datasets derived from The Cancer Genome Atlas (TCGA), and the experimental results demonstrate that it outperforms several state-of-the-art survival analysis approaches.

Roadmap for providing and leveraging annotated data by cytologists in the PDAC domain as open data: support for AI-based pathology image analysis development and data utilization strategies.

Pancreatic cancer is one of the most lethal cancers worldwide, with a 5-year survival rate of less than 5%, the lowest of all cancer types. Pancreatic ductal adenocarcinoma (PDAC) is the most common and aggressive pancreatic cancer and has been classified as a health emergency in the past few decades. The histopathological diagnosis and prognosis evaluation of PDAC is time-consuming, laborious, and challenging in current clinical practice conditions. Pathological artificial intelligence (AI) research has been actively conducted lately. However, accessing medical data is challenging; the amount of open pathology data is small, and the absence of open-annotation data drawn by medical staff makes it difficult to conduct pathology AI research. Here, we provide easily accessible high-quality annotation data to address the abovementioned obstacles. Data evaluation is performed by supervised learning using a deep convolutional neural network structure to segment 11 annotated PDAC histopathological whole slide images (WSIs) drawn by medical staff directly from an open WSI dataset. We visualized the segmentation results of the histopathological images with a Dice score of 73% on the WSIs, including PDAC areas, thus identifying areas important for PDAC diagnosis and demonstrating high data quality. Additionally, pathologists assisted by AI can significantly increase their work efficiency. The pathological AI guidelines we propose are effective in developing histopathological AI for PDAC and are significant in the clinical field.

Deep synergetic spiking neural P systems for the overall survival time prediction of glioblastoma patients

Histopathological whole slide images (WSIs) are the gold standard for cancer diagnosis. In prognosis, WSIs can also help predict the overall survival (OS) time of cancer (such as glioblastoma (GBM) patients). However, current region of interest (ROI)-based supervised learning methods for GBM patients are unsatisfactory in accuracy and efficiency. To mitigate the issues, we propose a novel deep synergetic spiking neural (DSSN) P system to perform ROI-free prediction of OS time in GBM patients. Specifically, a dual-task attention network is designed by different synergistic firing mechanisms on new types of neurons to predict OS time and classify genotype simultaneously. The network can not only capture useful cell features but also enrich and share features between the two tasks to improve performance. Four triggering rules are also proposed to cluster pathological images into different phenotypes related to survival to implement ROI-free prediction. Since P systems are highly parallel, multiple preprocessing and ensemble learning of dual-task attention networks with different initial configurations are conducted to further improve OS time prediction accuracy and reduce time complexity. Experimental results show that the DSSN P system outperforms ten other state-of-the-art models, demonstrating the ability of the DSSN P system to predict OS time in GBM patients.

Explainable AI and its instantiation in Computational Pathology for a better understanding of Alzheimer’s disease

AbstractBackgroundEXplainable Artificial Intelligence (XAI) has an essential role to accelerate the AI adoption by empowering biomedical experts and catalyzing modern research through the emergence of a new generation of virtual actors, enabling traceable knowledge‐based quantification, as a guided qualification support. XAI instantiation is shown through our study, hypothesizing that rapid Alzheimer’s Disease (rAD) brains display subtle histological changes that would be undercovered by high‐throughput automated microscopic analysis. We study the topography and morphology of tau lesions’ aggregates to better understand the morphological substratum of Alzheimer’s Disease (AD) heterogeneity.MethodTo address this question at a large scale, we designed, tested and implemented a software for automatic segmentation, annotation and quantitation of brain lesions in histopathological whole slide images (WSI). A dataset of 15 whole slide images of postmortem human brain tissue is used in this study. These are fully annotated by neuropathologists yielding a set of more than 30,000 annotated plaques and tangle objects. A deep learning pipeline consisting of an attention‐UNet model with explainability features is trained for segmentation of tau aggregates in WSIs. The attention maps corresponding to segmentation predictions from the model are used by pathologists as a comparable reference to assist their decision making process.ResultThe DL‐based WSI analysis framework allows detecting a majority of the tau aggregates and refining tau aggregate boundaries with higher accuracy compared to manual annotations. Besides, with such a DL model based tau identification, the pathologist needs to annotate only a few samples for the DL model training. Overall, DL assisted analysis of tau aggregates could ease the effort of pathologists and facilitate analysis of hundreds of WSIs which are vital in AD research areas such as identifying different AD forms and AD patient stratification.ConclusionXAI is not only providing traceability by opening the way to an effective adoption, but also allows optimizing the ML/DL design, by keeping high performances. The green footprint is, therefore, considered, as well as the GDPR (European General Data Protection Regulation), towards Responsible Artificial Intelligence.

Revolutionizing Oral Cancer Detection: An Approach Using Aquila and Gorilla Algorithms Optimized Transfer Learning-Based CNNs.

The early detection of oral cancer is pivotal for improving patient survival rates. However, the high cost of manual initial screenings poses a challenge, especially in resource-limited settings. Deep learning offers an enticing solution by enabling automated and cost-effective screening. This study introduces a groundbreaking empirical framework designed to revolutionize the accurate and automatic classification of oral cancer using microscopic histopathology slide images. This innovative system capitalizes on the power of convolutional neural networks (CNNs), strengthened by the synergy of transfer learning (TL), and further fine-tuned using the novel Aquila Optimizer (AO) and Gorilla Troops Optimizer (GTO), two cutting-edge metaheuristic optimization algorithms. This integration is a novel approach, addressing bias and unpredictability issues commonly encountered in the preprocessing and optimization phases. In the experiments, the capabilities of well-established pre-trained TL models, including VGG19, VGG16, MobileNet, MobileNetV3Small, MobileNetV2, MobileNetV3Large, NASNetMobile, and DenseNet201, all initialized with 'ImageNet' weights, were harnessed. The experimental dataset consisted of the Histopathologic Oral Cancer Detection dataset, which includes a 'normal' class with 2494 images and an 'OSCC' (oral squamous cell carcinoma) class with 2698 images. The results reveal a remarkable performance distinction between the AO and GTO, with the AO consistently outperforming the GTO across all models except for the Xception model. The DenseNet201 model stands out as the most accurate, achieving an astounding average accuracy rate of 99.25% with the AO and 97.27% with the GTO. This innovative framework signifies a significant leap forward in automating oral cancer detection, showcasing the tremendous potential of applying optimized deep learning models in the realm of healthcare diagnostics. The integration of the AO and GTO in our CNN-based system not only pushes the boundaries of classification accuracy but also underscores the transformative impact of metaheuristic optimization techniques in the field of medical image analysis.

Histopathologic brain age estimation via multiple instance learning

Understanding age acceleration, the discordance between biological and chronological age, in the brain can reveal mechanistic insights into normal physiology as well as elucidate pathological determinants of age-related functional decline and identify early disease changes in the context of Alzheimer’s and other disorders. Histopathological whole slide images provide a wealth of pathologic data on the cellular level that can be leveraged to build deep learning models to assess age acceleration. Here, we used a collection of digitized human post-mortem hippocampal sections to develop a histological brain age estimation model. Our model predicted brain age within a mean absolute error of 5.45 ± 0.22 years, with attention weights corresponding to neuroanatomical regions vulnerable to age-related changes. We found that histopathologic brain age acceleration had significant associations with clinical and pathologic outcomes that were not found with epigenetic based measures. Our results indicate that histopathologic brain age is a powerful, independent metric for understanding factors that contribute to brain aging.

High-Order Correlation-Guided Slide-Level Histology Retrieval With Self-Supervised Hashing.

Histopathological Whole Slide Images (WSIs) play a crucial role in cancer diagnosis. It is of significant importance for pathologists to search for images sharing similar content with the query WSI, especially in the case-based diagnosis. While slide-level retrieval could be more intuitive and practical in clinical applications, most methods are designed for patch-level retrieval. A few recently unsupervised slide-level methods only focus on integrating patch features directly, without perceiving slide-level information, and thus severely limits the performance of WSI retrieval. To tackle the issue, we propose a High-Order Correlation-Guided Self-Supervised Hashing-Encoding Retrieval (HSHR) method. Specifically, we train an attention-based hash encoder with slide-level representation in a self-supervised manner, enabling it to generate more representative slide-level hash codes of cluster centers and assign weights for each. These optimized and weighted codes are leveraged to establish a similarity-based hypergraph, in which a hypergraph-guided retrieval module is adopted to explore high-order correlations in the multi-pairwise manifold to conduct WSI retrieval. Extensive experiments on multiple TCGA datasets with over 24,000 WSIs spanning 30 cancer subtypes demonstrate that HSHR achieves state-of-the-art performance compared with other unsupervised histology WSI retrieval methods.

Valuing vicinity: Memory attention framework for context-based semantic segmentation in histopathology.

The segmentation of histopathological whole slide images into tumourous and non-tumourous types of tissue is a challenging task that requires the consideration of both local and global spatial contexts to classify tumourous regions precisely. The identification of subtypes of tumour tissue complicates the issue as the sharpness of separation decreases and the pathologist's reasoning is even more guided by spatial context. However, the identification of detailed tissue types is crucial for providing personalized cancer therapies. Due to the high resolution of whole slide images, existing semantic segmentation methods, restricted to isolated image sections, are incapable of processing context information beyond. To take a step towards better context comprehension, we propose a patch neighbour attention mechanism to query the neighbouring tissue context from a patch embedding memory bank and infuse context embeddings into bottleneck hidden feature maps. Our memory attention framework (MAF) mimics a pathologist's annotation procedure - zooming out and considering surrounding tissue context. The framework can be integrated into any encoder-decoder segmentation method. We evaluate the MAF on two public breast cancer and liver cancer data sets and an internal kidney cancer data set using famous segmentation models (U-Net, DeeplabV3) and demonstrate the superiority over other context-integrating algorithms - achieving a substantial improvement of up to 17% on Dice score. The code is publicly available at https://github.com/tio-ikim/valuing-vicinity.

Cancer Survival Prediction From Whole Slide Images With Self-Supervised Learning and Slide Consistency

Histopathological Whole Slide Images (WSIs) at giga-pixel resolution are the gold standard for cancer analysis and prognosis. Due to the scarcity of pixel- or patch-level annotations of WSIs, many existing methods attempt to predict survival outcomes based on a three-stage strategy that includes patch selection, patch-level feature extraction and aggregation. However, the patch features are usually extracted by using truncated models (e.g. ResNet) pretrained on ImageNet without fine-tuning on WSI tasks, and the aggregation stage does not consider the many-to-one relationship between multiple WSIs and the patient. In this paper, we propose a novel survival prediction framework that consists of patch sampling, feature extraction and patient-level survival prediction. Specifically, we employ two kinds of self-supervised learning methods, i.e. colorization and cross-channel, as pretext tasks to train convnet-based models that are tailored for extracting features from WSIs. Then, at the patient-level survival prediction we explicitly aggregate features from multiple WSIs, using consistency and contrastive losses to normalize slide-level features at the patient level. We conduct extensive experiments on three large-scale datasets: TCGA-GBM, TCGA-LUSC and NLST. Experimental results demonstrate the effectiveness of our proposed framework, as it achieves state-of-the-art performance in comparison with previous studies, with concordance index of 0.670, 0.679 and 0.711 on TCGA-GBM, TCGA-LUSC and NLST, respectively.

Histopathologic Brain Age Estimation via Deep Multiple Instance Learning (P3-6.008)

<h3>Objective:</h3> To identify features of histologic brain aging and clinical correlates of brain age acceleration. <h3>Background:</h3> The discordance between cellular and chronologic aging is useful for understanding diseases in the brain and biology at large. One established method for analyzing the factors that contribute to brain aging is to train machine learning models that predict an individual’s age based on an MRI image of their brain. While this approach has yielded important insights, it is inherently constrained by the information provided by an MRI. However, age-dependent pathologic change has the potential to be assessed at greater detail histologically. Histopathological whole slide images provide more granular information regarding cellular structure, injury, dysfunction, and morphology. Recent technological advances in whole slide image digitization has paved the way for large scale analysis of histologic data via artificially intelligent based computer vision techniques. <h3>Design/Methods:</h3> We leveraged a large novel collection of uniformly processed digitized human post-mortem brain tissue sections to create a histological brain age estimation model. We further investigated the effect of cognitive impairment and exogenous stress on the model. This was accomplished by developing a context-aware attention-based deep multiple instance learning model on 702 human brain tissues sections (ages 50–110 yr) from the hippocampus stained with Luxol Fast Blue counterstained with hematoxylin and eosin on a brain age estimation task. <h3>Results:</h3> This model estimated brain age within a mean absolute error of 5.2 years. Learned attention weights corresponded to neuroanatomical regions vulnerable to age-related change. We found that histopathologic brain age acceleration had significant associations with cognitive impairment, MMSE, p-tau burden, chronic traumatic encephalopathy, and cerebrovascular disease. These associations were not found when using epigenetic-based measures of age acceleration. <h3>Conclusions:</h3> These data indicate that estimated histopathologic brain age can be used as a reliable pathologic correlate to identify factors that contribute to accelerated or decelerated brain aging. <b>Disclosure:</b> Mr. Marx has nothing to disclose. Dr. McKenzie has nothing to disclose. Mr. Kauffman has nothing to disclose. Mr. Koenigsberg has nothing to disclose. The institution of Dr. Farrell has received research support from NIH. Dr. Crary has nothing to disclose.