Histopathological Image Analysis Research Articles

Machine Learning Models for the Classification of Histopathological Images of Colorectal Cancer

The aim of this study was to explore the application of computational models for the analysis of histopathological images in the context of colon cancer. A comprehensive dataset of colon cancer images annotated into eight distinct categories based on their representation of cancerous cell portions was used. The primary objective was to employ various image classification algorithms to assess their efficacy in the context of cancer classification. Additionally, this study investigated the use of feature extraction techniques to derive meaningful data from the images, contributing to a more nuanced understanding of cancerous tissues, comparing the performance of different image classification algorithms in the context of colon cancer image analysis. The findings of this research suggested that XGboost provides the highest accuracy (89.79%) and could contribute to the growing body of knowledge in computational pathology. Other algorithms, such as the random forest, SVM, and CNN, also provided satisfactory results, offering insights into the effectiveness of image classification algorithms in distinguishing between different categories of cancerous cells. This work holds implications for the development of more accurate and efficient tools, underscoring the potential of computational models in enhancing the analysis of histopathological images and improving diagnostic capabilities in cancer research.

QuPath Edu and OpenMicroanatomy: Open‐source virtual microscopy tools for medical education

AbstractVirtual microscopy is becoming increasingly common in both medical education and routine clinical practice. Virtual microscopy software is typically designed either for (1) training students in anatomy, histology, and histopathology, or (2) quantitative analysis—but not both simultaneously. QuPath is one of the most widely used software applications for histopathology image analysis in research and provides a comprehensive set of computational tools to evaluate histology slides. We have enhanced QuPath by developing a new extension, QuPath Edu, which adapts the software to function as an intuitive microanatomy learning environment. Additionally, we have created an entirely new, complementary software platform called OpenMicroanatomy, which provides an alternative way to access QuPath Edu teaching content through a web interface. These tools have been used in teaching of first year medical and dentistry students at the University of Oulu Medical Faculty, and we conducted a user survey for the Class of 2023 to assess the usability and student experience. In general, the introduced annotation and quiz features were appreciated by the students and the system usability of OpenMicroanatomy was considered excellent (SUS score 84.8). Together, these freely available tools enable teachers to develop and deploy innovative training material for anatomy, histopathology, quantitative analysis, and artificial intelligence in a wide range of contexts. This unique combination can provide the next generation of students with essential multidisciplinary skills.

Deep learning analysis of histopathological images predicts immunotherapy prognosis and reveals tumour microenvironment features in non-small cell lung cancer.

Non-small cell lung cancer (NSCLC) is one of the leading causes of cancer mortality worldwide. Immune checkpoint inhibitors (ICIs) have emerged as a crucial treatment option for patients with advanced NSCLC. However, only a subset of patients experience clinical benefit from ICIs. Therefore, identifying biomarkers that can predict response to ICIs is imperative for optimising patient selection. Hematoxylin and eosin (H&E) images of NSCLC patients were obtained from the local cohort (n = 106) and The Cancer Genome Atlas (TCGA) (n = 899). We developed an ICI-related pathological prognostic signature (ir-PPS) based on H&E stained histopathology images to predict prognosis in NSCLC patients treated with ICIs using deep learning. To accomplish this, we employed a modified ResNet model (ResNet18-PG), a widely-used deep learning architecture well-known for its effectiveness in handling complex image recognition tasks. Our modifications include a progressive growing strategy to improve the stability of model training and the use of the AdamW optimiser, which enhances the optimisation process by adjusting the learning rate based on training dynamics. The deep learning model, ResNet18-PG, achieved an area under the receiver operating characteristic curve (AUC) of 0.918 and a recall of 0.995 on the local cohort. The ir-PPS effectively risk-stratified NSCLC patients. Patients in the low-risk group (n = 40) had significantly improved progression-free survival (PFS) after ICI treatment compared to those in the high-risk group (n = 66, log-rank P = 0.004, hazard ratio (HR) = 3.65, 95%CI: 1.75-7.60). The ir-PPS demonstrated good discriminatory power for predicting 6-month PFS (AUC = 0.750), 12-month PFS (AUC = 0.677), and 18-month PFS (AUC = 0.662). The low-risk group exhibited increased expression of immune checkpoint molecules, cytotoxicity-related genes, an elevated abundance of tumour-infiltrating lymphocytes, and enhanced activity in immune stimulatory pathways. The ir-PPS signature derived from H&E images using deep learning could predict ICIs prognosis in NSCLC patients. The ir-PPS provides a novel imaging biomarker that may help select optimal candidates for ICIs therapy in NSCLC.

Deep transfer learning with improved crayfish optimization algorithm for oral squamous cell carcinoma cancer recognition using histopathological images

Oral Squamous Cell Carcinoma (OSCC) causes a severe challenge in oncology due to the lack of diagnostic devices, leading to delays in detecting the disorder. The OSCC diagnosis through histopathology demands a pathologist expert because the cellular presentation is variable and highly complex. Existing diagnostic approaches for OSCC have specific efficiency and accuracy restrictions, highlighting the necessity for more reliable techniques. The increase of deep neural networks (DNN) model and their applications in medical imaging have been instrumental in disease diagnosis and detection. Automatic detection systems using deep learning (DL) approaches show tremendous promise in investigating medical imagery with speed, efficiency, and accuracy. In terms of OSCC, this system allows the diagnostic method to be streamlined, facilitating earlier diagnosis and enhancing survival rates. Automatic analysis of histopathological image (HI) can assist in accurately detecting and identifying tumorous tissue, reducing diagnostic turnaround times and increasing the efficacy of pathologists. This study presents a Squeeze-Excitation with Hybrid Deep Learning for Oral Squamous Cell Carcinoma Recognition (SEHDL-OSCCR) on HIs. The presented SEHDL-OSCCR technique mainly focuses on detecting oral cancer (OC) using hybrid DL models. The bilateral filtering (BF) technique is initially used to remove the noise. Next, the SEHDL-OSCCR technique employs the SE-CapsNet model to recognize the feature extractors. An improved crayfish optimization algorithm (ICOA) technique is utilized to improve the performance of the SE-CapsNet model. At last, the classification of the OSCC technique is performed by employing a convolutional neural network with a bidirectional long short-term memory (CNN-BiLSTM) model. The simulation results obtained using the SEHDL-OSCCR technique are investigated using a benchmark medical image dataset. The experimental validation of the SEHDL-OSCCR technique illustrated a greater accuracy outcome of 98.75% compared to recent approaches.

Efficient feature selection for histopathological image classification with improved multi-objective WOA

The difficulty of selecting features efficiently in histopathology image analysis remains unresolved. Furthermore, the majority of current approaches have approached feature selection as a single objective issue. This research presents an enhanced multi-objective whale optimisation algorithm-based feature selection technique as a solution. To mine optimal feature sets, the suggested technique makes use of a unique variation known as the enhanced multi-objective whale optimisation algorithm. To verify the optimisation capability, the suggested variation has been evaluated on 10 common multi-objective CEC2009 benchmark functions. Furthermore, by comparing five classifiers in terms of accuracy, mean number of selected features, and calculation time, the effectiveness of the suggested strategy is verified against three other feature-selection techniques already in use. The experimental findings show that, when compared to the other approaches under consideration, the suggested method performed better on the assessed parameters.

The integrated molecular and histological analysis defines subtypes of esophageal squamous cell carcinoma

Esophageal squamous cell carcinoma (ESCC) is highly heterogeneous. Our understanding of full molecular and immune landscape of ESCC remains limited, hindering the development of personalised therapeutic strategies. To address this, we perform genomic-transcriptomic characterizations and AI-aided histopathological image analysis of 120 Chinese ESCC patients. Here we show that ESCC can be categorized into differentiated, metabolic, immunogenic and stemness subtypes based on bulk and single-cell RNA-seq, each exhibiting specific molecular and histopathological features based on an amalgamated deep-learning model. The stemness subgroup with signature genes, such as WFDC2, SFRP1, LGR6 and VWA2, has the poorest prognosis and is associated with downregulated immune activities, a high frequency of EP300 mutation/activation, functional mutation enrichment in Wnt signalling and the highest level of intratumoural heterogeneity. The immune profiling by transcriptomics and immunohistochemistry reveals ESCC cells overexpress natural killer cell markers XCL1 and CD160 as immune evasion. Strikingly, XCL1 expression also affects the sensitivity of ESCC cells to common chemotherapy drugs. This study opens avenues for ESCC treatment and provides a valuable public resource to better understand ESCC.

Comparative Study of GPT-4Vision and Convolutional Neural Networks in Histopathological Image Analysis

Abstract Introduction/Objective Recent advancements in artificial intelligence (AI), particularly with Large Language Models like ChatGPT-4Vision (GPT-4V), have expanded the potential for automated interpretation of medical images. This study evaluates the diagnostic accuracy of GPT-4V in histopathological analysis of neurodegenerative diseases and compares its performance with traditional Convolutional Neural Networks (CNNs). Methods/Case Report We utilized 1515 histopathological images, including hematoxylin and eosin (H&E) staining and tau immunohistochemistry, from patients with various neurodegenerative diseases, such as Alzheimer’s disease, progressive supranuclear palsy, and corticobasal degeneration. GPT-4V’s performance was assessed through multi- step prompts to assess how textual context influences the image interpretation. In the quantitative analysis, the diagnostic accuracy of GPT-4V and the CNN-based model YOLOv8 was assessed for classifying three tau lesions—astrocytic plaques, neuritic plaques, and tufted astrocytes. The analysis used both zero-shot and few-shot learning methods, where GPT-4V and YOLOv8 were evaluated on their ability to distinguish these lesions using ten hold-out test images and 490 training images per lesion. Results (if a Case Study enter NA) GPT-4V accurately recognized Lewy bodies in all cases, but it showed limited accuracy in identifying neurofibrillary tangles (20%) and Pick bodies (0%) on H&E slides. Notably, GPT-4V often suggested Alzheimer’s disease as a potential diagnosis, relying more on contextual clues, such as the prevalence of certain diseases, rather than direct image analysis. In the tau immunohistochemical analysis, GPT-4V’s diagnoses were strongly influenced by additional information about staining and brain region. However, few-shot learning markedly improved GPT-4V’s diagnostic capabilities from 40% accuracy with zero-shot learning to 90% with few-shot learning, reaching best accuracy with 20-shot learning. This performance compared favorably against YOLOv8, which also achieved 90% accuracy but required 100-shot learning. Conclusion While GPT-4V faces challenges in independently interpreting histopathological images, few-shot learning significantly improves its accuracy. This approach is particularly promising for neuropathology, where acquiring extensive labeled datasets is challenging. The findings highlight the need for ongoing refinement of AI applications in pathology, emphasizing balanced integration of textual and visual data to optimize diagnostic efficacy and reliability.

Precision and speed: The AI revolution in oral squamous cell carcinoma detection

Oral Squamous Cell Carcinoma (OSCC) is a highly aggressive tumor with a poor prognosis and is most frequent histological neoplasm of head and neck cancers, and although it is localized in a region that is accessible to see and can be detected very early, this usually does not occur. The standard procedure for the diagnosis of oral cancer is based on histopathological examination, however, the main problem in this kind of procedure is tumor heterogeneity where a subjective component of the examination could directly impact patient-specific treatment intervention. AI can precisely analyze a vast dataset of various imaging modalities, such as fluorescent, hyperspectral, cytological, histological, radiological, endoscopic, clinical, and infrared thermal modalities. In this review, we discuss digital histopathological image analysis, computer vision and radiological analysis for the early detection of OSCC.

Image Analysis in Histopathology and Cytopathology: From Early Days to Current Perspectives.

Both pathology and cytopathology still rely on recognizing microscopical morphologic features, and image analysis plays a crucial role, enabling the identification, categorization, and characterization of different tissue types, cell populations, and disease states within microscopic images. Historically, manual methods have been the primary approach, relying on expert knowledge and experience of pathologists to interpret microscopic tissue samples. Early image analysis methods were often constrained by computational power and the complexity of biological samples. The advent of computers and digital imaging technologies challenged the exclusivity of human eye vision and brain computational skills, transforming the diagnostic process in these fields. The increasing digitization of pathological images has led to the application of more objective and efficient computer-aided analysis techniques. Significant advancements were brought about by the integration of digital pathology, machine learning, and advanced imaging technologies. The continuous progress in machine learning and the increasing availability of digital pathology data offer exciting opportunities for the future. Furthermore, artificial intelligence has revolutionized this field, enabling predictive models that assist in diagnostic decision making. The future of pathology and cytopathology is predicted to be marked by advancements in computer-aided image analysis. The future of image analysis is promising, and the increasing availability of digital pathology data will invariably lead to enhanced diagnostic accuracy and improved prognostic predictions that shape personalized treatment strategies, ultimately leading to better patient outcomes.

Palette‐based colour normalization for histopathology images

AbstractWith the emergence of computer‐aided diagnostic (CAD) systems, the speed of histopathological image analysis and the accuracy of cancer detection have considerably improved. However, the appearance of histopathological slides can vary depending on the consistency of tissue thickness, stain concentrations, and equipment, thus affecting the judgment of CAD systems. This study proposes a palette‐based colour normalization method for histopathology images is proposed to solve the problem of colour differences between histopathology images. The method builds a graphical user interface based on an improved palette generation algorithm and colour transfer definitions, through which the user can complete the corresponding colour modification to achieve colour normalization. The evaluation of the metrics on histopathological images shows that our method is able to achieve higher image quality and better preservation of structural information of the source image compared with four other colour normalization algorithms. The peak signal‐to‐noise ratio values obtained by the proposed method on two publicly available datasets were 24.1914 and 21.3666, and the structural similarity index matrix values were 0.9871 and 0.9760. The proposed method provides new ideas for the development and design of CAD systems.

WSSS-CRAM: precise segmentation of histopathological images via class region activation mapping.

Fast, accurate, and automatic analysis of histopathological images using digital image processing and deep learning technology is a necessary task. Conventional histopathological image analysis algorithms require the manual design of features, while deep learning methods can achieve fast prediction and accurate analysis, but rely on the drive of a large amount of labeled data. In this work, we introduce WSSS-CRAM a weakly-supervised semantic segmentation that can obtain detailed pixel-level labels from image-level annotated data. Specifically, we use a discriminative activation strategy to generate category-specific image activation maps via class labels. The category-specific activation maps are then post-processed using conditional random fields to obtain reliable regions that are directly used as ground-truth labels for the segmentation branch. Critically, the two steps of the pseudo-label acquisition and training segmentation model are integrated into an end-to-end model for joint training in this method. Through quantitative evaluation and visualization results, we demonstrate that the framework can predict pixel-level labels from image-level labels, and also perform well when testing images without image-level annotations. Future, we consider extending the algorithm to different pathological datasets and types of tissue images to validate its generalization capability.

Deep learning-based analysis of EGFR mutation prevalence in lung adenocarcinoma H&E whole slide images.

EGFR mutations are a major prognostic factor in lung adenocarcinoma. However, current detection methods require sufficient samples and are costly. Deep learning is promising for mutation prediction in histopathological image analysis but has limitations in that it does not sufficiently reflect tumor heterogeneity and lacks interpretability. In this study, we developed a deep learning model to predict the presence of EGFR mutations by analyzing histopathological patterns in whole slide images (WSIs). We also introduced the EGFR mutation prevalence (EMP) score, which quantifies EGFR prevalence in WSIs based on patch-level predictions, and evaluated its interpretability and utility. Our model estimates the probability of EGFR prevalence in each patch by partitioning the WSI based on multiple-instance learning and predicts the presence of EGFR mutations at the slide level. We utilized a patch-masking scheduler training strategy to enable the model to learn various histopathological patterns of EGFR. This study included 868 WSI samples from lung adenocarcinoma patients collected from three medical institutions: Hallym University Medical Center, Inha University Hospital, and Chungnam National University Hospital. For the test dataset, 197 WSIs were collected from Ajou University Medical Center to evaluate the presence of EGFR mutations. Our model demonstrated prediction performance with an area under the receiver operating characteristic curve of 0.7680 (0.7607-0.7720) and an area under the precision-recall curve of 0.8391 (0.8326-0.8430). The EMP score showed Spearman correlation coefficients of 0.4705 (p = 0.0087) for p.L858R and 0.5918 (p = 0.0037) for exon 19 deletions in 64 samples subjected to next-generation sequencing analysis. Additionally, high EMP scores were associated with papillary and acinar patterns (p = 0.0038 and p = 0.0255, respectively), whereas low EMP scores were associated with solid patterns (p = 0.0001). These results validate the reliability of our model and suggest that it can provide crucial information for rapid screening and treatment plans.

Nuclei Detection and Segmentation of Histopathological Images Using a Feature Pyramidal Network Variant of a Mask R-CNN.

Cell nuclei interpretation is crucial in pathological diagnostics, especially in tumor specimens. A critical step in computational pathology is to detect and analyze individual nuclear properties using segmentation algorithms. Conventionally, a semantic segmentation network is used, where individual nuclear properties are derived after post-processing a segmentation mask. In this study, we focus on showing that an object-detection-based instance segmentation network, the Mask R-CNN, after integrating it with a Feature Pyramidal Network (FPN), gives mature and reliable results for nuclei detection without the need for additional post-processing. The results were analyzed using the Kumar dataset, a public dataset with over 20,000 nuclei annotations from various organs. The dice score of the baseline Mask R-CNN improved from 76% to 83% after integration with an FPN. This was comparable with the 82.6% dice score achieved by modern semantic-segmentation-based networks. Thus, evidence is provided that an end-to-end trainable detection-based instance segmentation algorithm with minimal post-processing steps can reliably be used for the detection and analysis of individual nuclear properties. This represents a relevant task for research and diagnosis in digital pathology, which can improve the automated analysis of histopathological images.

Colorectal cancer histopathology image analysis: A comparative study of prognostic values of automatically extracted morphometric nuclear features in multispectral and red-blue-green imagery.

Multispectral imaging (MSI) has been utilized to predict the prognosis of colorectal cancer (CRC) patients, however, our understanding of the prognostic value of nuclear morphological parameters of bright-field MSI in CRC is still limited. This study was designed to compare the efficiency of MSI and standard red-green-blue (RGB) images in predicting the prognosis of CRC. We compared the efficiency of MS and conventional RGB images on the quantitative assessment of hematoxylin-eosin (HE) stained histopathology images. A pipeline was developed using a pixel-wise support vector machine (SVM) classifier for gland-stroma segmentation, and a marker-controlled watershed algorithm was used for nuclei segmentation. The correlation between extracted morphological parameters and the five-year disease-free survival (5-DFS) was analyzed. Forty-seven nuclear morphological parameters were extracted in total. Based on Kaplan-Meier analysis, eight features derived from MS images and seven featured derived from RGB images were significantly associated with 5-DFS, respectively. Compared with RGB images, MSI showed higher accuracy, precision, and Dice index in nuclei segmentation. Multivariate analysis indicated that both integrated parameters 1 (factors negatively correlated with CRC prognosis including nuclear number, circularity, eccentricity, major axis length) and 2 (factors positively correlated with CRC prognosis including nuclear average area, area perimeter, total area/total perimeter ratio, average area/perimeter ratio) in MS images were independent prognostic factors of 5-DFS, in contrast with only integrated parameter 1 (P<0.001) in RGB images. More importantly, the quantification of HE-stained MS images displayed higher accuracy in predicting 5-DFS compared with RGB images (76.9% vs 70.9%). Quantitative evaluation of HE-stained MS images could yield more information and better predictive performance for CRC prognosis than conventional RGB images, thereby contributing to precision oncology.

Re-identification from histopathology images

In numerous studies, deep learning algorithms have proven their potential for the analysis of histopathology images, for example, for revealing the subtypes of tumors or the primary origin of metastases. These models require large datasets for training, which must be anonymized to prevent possible patient identity leaks. This study demonstrates that even relatively simple deep learning algorithms can re-identify patients in large histopathology datasets with substantial accuracy. In addition, we compared a comprehensive set of state-of-the-art whole slide image classifiers and feature extractors for the given task. We evaluated our algorithms on two TCIA datasets including lung squamous cell carcinoma (LSCC) and lung adenocarcinoma (LUAD). We also demonstrate the algorithm’s performance on an in-house dataset of meningioma tissue. We predicted the source patient of a slide with F1 scores of up to 80.1% and 77.19% on the LSCC and LUAD datasets, respectively, and with 77.09% on our meningioma dataset. Based on our findings, we formulated a risk assessment scheme to estimate the risk to the patient’s privacy prior to publication.

Confocal laser endomicroscopy for gastric neoplasm.

Confocal laser endomicroscopy (CLE) is a novel endoscopic modality that provides real-time histological information via high-resolution magnified view of the mucosa. CLE has a higher sensitivity, specificity, and diagnostic accuracy in detecting atrophic gastritis as compared to chromoendoscopy and narrow-band imaging. It can even predict low-grade and high-grade intraepithelial neoplasia by analyzing gastric pit patterns. CLE may have some advantages over the standard biopsy protocol, such as higher diagnostic yield and fewer biopsy requirements. Its diagnostic accuracy in detecting superficial gastric cancer is higher than that of white-light endoscopy. Inherent limitations, such as a narrow field of vision, can be surpassed by technological advancements and integration with other detection methods. Artificial intelligence holds promise in automated analysis of histopathological images. Thus, CLE can be helpful in screening for early gastric cancer and may help reduce the risk of complications from repeated biopsies, such as mucosal damage, bleeding, and infection.

Deep Learning-Based Image Classification and Segmentation on Digital Histopathology for Oral Squamous Cell Carcinoma: A Systematic Review and Meta-Analysis.

Artificial intelligence (AI)-based tools have shown promise in histopathology image analysis in improving the accuracy of oral squamous cell carcinoma (OSCC) detection with intent to reduce human error. This systematic review and meta-analysis evaluated deep learning (DL) models for OSCC detection on histopathology images by assessing common diagnostic performance evaluation metrics for AI-based medical image analysis studies. Diagnostic accuracy studies that used DL models for the analysis of histopathological images of OSCC compared to the reference standard were analyzed. Six databases (PubMed, Google Scholar, Scopus, Embase, ArXiv, and IEEE) were screened for publications without any time limitation. The QUADAS-2 tool was utilized to assess quality. The meta-analyses included only studies that reported true positives (TP), true negatives (TN), false positives (FP), and false negatives (FN) in their test sets. Of 1267 screened studies, 17 studies met the final inclusion criteria. DL methods such as image classification (n = 11) and segmentation (n = 3) were used, and some studies used combined methods (n = 3). On QUADAS-2 assessment, only three studies had a low risk of bias across all applicability domains. For segmentation studies, 0.97 was reported for accuracy, 0.97 for sensitivity, 0.98 for specificity, and 0.92 for Dice. For classification studies, accuracy was reported as 0.99, sensitivity 0.99, specificity 1.0, Dice 0.95, F1 score 0.98, and AUC 0.99. Meta-analysis showed pooled estimates of 0.98 sensitivity and 0.93 specificity. Application of AI-based classification and segmentation methods on image analysis represents a fundamental shift in digital pathology. DL approaches demonstrated significantly high accuracy for OSCC detection on histopathology, comparable to that of human experts in some studies. Although AI-based models cannot replace a well-trained pathologist, they can assist through improving the objectivity and repeatability of the diagnosis while reducing variability and human error as a consequence of pathologist burnout.

Structure Embedded Nucleus Classification for Histopathology Images.

Nuclei classification provides valuable information for histopathology image analysis. However, the large variations in the appearance of different nuclei types cause difficulties in identifying nuclei. Most neural network based methods are affected by the local receptive field of convolutions, and pay less attention to the spatial distribution of nuclei or the irregular contour shape of a nucleus. In this paper, we first propose a novel polygon-structure feature learning mechanism that transforms a nucleus contour into a sequence of points sampled in order, and employ a recurrent neural network that aggregates the sequential change in distance between key points to obtain learnable shape features. Next, we convert a histopathology image into a graph structure with nuclei as nodes, and build a graph neural network to embed the spatial distribution of nuclei into their representations. To capture the correlations between the categories of nuclei and their surrounding tissue patterns, we further introduce edge features that are defined as the background textures between adjacent nuclei. Lastly, we integrate both polygon and graph structure learning mechanisms into a whole framework that can extract intra and inter-nucleus structural characteristics for nuclei classification. Experimental results show that the proposed framework achieves significant improvements compared to the previous methods. Code and data are made available via https://github.com/lhaof/SENC.

DB-FCN: An end-to-end dual-branch fully convolutional nucleus detection model

Detecting cells or nuclei in histopathological image analysis is a crucial prerequisite for subsequent cancer diagnosis. By precisely locating cell nuclei, pathologists can quantitatively analyze the morphology of each cell nucleus. This enables accurate cancer grading, allowing for the implementation of tailored treatment plans based on distinct cancer stages. Manual nucleus detection methods are labor-intensive, making the development of automatic cell nucleus detection algorithms highly necessary. However, due to the small size of the nucleus and increased adhesions between cells, tissue staining may be uneven, leading to a higher occurrence of false positives in the results of the current automatic nucleus detection algorithm. This paper introduces an end-to-end dual-branch-based fully convolutional neural network (DB-FCN) that effectively addresses the aforementioned challenges, thereby enhancing the accuracy of automatic nucleus detection. This algorithm introduces for the first time the use of two detection branches, namely the coarse detection branch and the fine detection branch, to accomplish the detection task. The role of the coarse detection branch is to identify all cell regions in the pathological image as comprehensively as possible and then transmit the detection results as prior information to the fine detection branch. The fine detection branch is necessary solely to conduct more precise detection based on the coarse detection results. Given that the coarse detection branch has already eliminated interference from many background regions, the fine detection branch can focus on detecting the nucleus region, thereby significantly enhancing the efficiency and accuracy of model detection. The detection model proposed in this paper was evaluated on three classic datasets and compared with many existing detection algorithms. Compared with other algorithms, the detection algorithm proposed in this paper has made significant progress in detecting cell nuclei in histopathological images.

An efficient colorectal cancer detection network using atrous convolution with coordinate attention transformer and histopathological images

The second most common type of malignant tumor worldwide is colorectal cancer. Histopathology image analysis offers crucial data for the clinical diagnosis of colorectal cancer. Currently, deep learning techniques are applied to enhance cancer classification and tumor localization in histopathological image analysis. Moreover, traditional deep learning techniques might loss integrated information in the image while evaluating thousands of patches recovered from whole slide images (WSIs). This research proposes a novel colorectal cancer detection network (CCDNet) that combines coordinate attention transformer with atrous convolution. CCDNet first denoises the input histopathological image using a Wiener based Midpoint weighted non-local means filter (WMW-NLM) for guaranteeing precise diagnoses and maintain image features. Also, a novel atrous convolution with coordinate attention transformer (AConvCAT) is introduced, which successfully combines the advantages of two networks to classify colorectal tissue at various scales by capturing local and global information. Further, coordinate attention model is integrated with a Cross-shaped window (CrSWin) transformer for capturing tiny changes in colorectal tissue from multiple angles. The proposed CCDNet achieved accuracy rates of 98.61% and 98.96%, on the colorectal histological image and NCT-CRC-HE-100 K datasets correspondingly. The comparison analysis demonstrates that the suggested framework performed better than the most advanced methods already in use. In hospitals, clinicians can use the proposed CCDNet to verify the diagnosis.