Segmentation Of Whole Slide Images Research Articles

Semi-Supervised Instance Segmentation in Whole Slide Images via Dense Spatial Variability Enhancing.

Current whole slide image (WSI) segmentation aims at extracting tumor regions from the background. Unlike this, segmenting distinct tumor areas (instances) within a WSI driven by limited annotated data remains under-explored. In this paper, we formally propose semisupervised instance segmentation (Semi-IS) in WSIs. We address a key challenge: learning intra-class similarity and inter-class dissimilarity driven by unlabeled data. Specifically, we generally perceive the patch as composed of tokens (together), not the patch alone. We employ contrastive learning to develop a segmentation framework. In the SemiIS, we find that the boundaries of segmented instances are usually disturbed by noise. We jointly eliminate and preserve noise features to address this problem. We conduct extensive experiments to evaluate the effectiveness and generalizability of Semi-IS, including histopathology and cellular pathology. The results show that in clinical multi instance segmentation tasks, Semi-IS achieves almost fullsupervised state-of-the-art results with only 30% annotated data. Semi-IS can improve segmentation accuracy by about 2% on public cell pathology datasets.

A Semi-Supervised Learning Approach for Tissue Semantic Segmentation in Whole Slide Images

A Semi-Supervised Learning Approach for Tissue Semantic Segmentation in Whole Slide Images

A joint Multi-decoder Dual-attention U-Net framework for tumor segmentation in Whole Slide Images

Despite the recent increasing interest in digital pathology, efficient analysis of Whole Slide Images (WSIs) faces many challenges that hinder performance, such as their massive size, high heterogeneity, and imbalance distribution. This paper proposes a Joint Multi-decoder Dual-attention U-Net (JMDU-Net) framework for tumor segmentation in WSIs to address these issues. JMDU-Net is an end-to-end framework that consists of a single encoder with a main and four supportive decoder branches. JMDU-Net incorporates the design of multiple novel blocks that adaptively acquire diversified contextual channel-wise features and progressively utilize knowledge from multi-perspective hierarchical feature fusion. Moreover, a multi-magnification majority-voting ensemble is proposed to jointly consider the multi-scale representations of different magnifications in the WSIs. The experimental results and statistical tests performed on the public PAIP 2019 dataset demonstrate the efficiency of JMDU-Net by obtaining an average of 88.0% dice score with 77.4% clipped Jaccard index value for 5-fold cross-validation on training data, while the proposed ensemble succeeded in obtaining a 86.4% dice score with 79.8% clipped Jaccard index value for the official validation set. Furthermore, the generalizability is assessed against DigestPath 2019 and PAIP 2023 datasets. JMDU-Net achieved average dice of 84.9% and 75.3% and Jaccard values of 74.4% and 63.0% on these datasets, respectively. The main aim of JMDU-Net is to provide a complementary assessment to medical professionals to enhance the level of care introduced to the patients by harnessing the powerfulness of deep learning in the cancer diagnosis task. The code will be available publicly at https://github.com/Heba-AbdeNabi/JMDU-Net.

RGSB-UNet: Hybrid Deep Learning Framework for Tumour Segmentation in Digital Pathology Images.

Colorectal cancer (CRC) is a prevalent gastrointestinal tumour with high incidence and mortality rates. Early screening for CRC can improve cure rates and reduce mortality. Recently, deep convolution neural network (CNN)-based pathological image diagnosis has been intensively studied to meet the challenge of time-consuming and labour-intense manual analysis of high-resolution whole slide images (WSIs). Despite the achievements made, deep CNN-based methods still suffer from some limitations, and the fundamental problem is that they cannot capture global features. To address this issue, we propose a hybrid deep learning framework (RGSB-UNet) for automatic tumour segmentation in WSIs. The framework adopts a UNet architecture that consists of the newly-designed residual ghost block with switchable normalization (RGS) and the bottleneck transformer (BoT) for downsampling to extract refined features, and the transposed convolution and 1 × 1 convolution with ReLU for upsampling to restore the feature map resolution to that of the original image. The proposed framework combines the advantages of the spatial-local correlation of CNNs and the long-distance feature dependencies of BoT, ensuring its capacity of extracting more refined features and robustness to varying batch sizes. Additionally, we consider a class-wise dice loss (CDL) function to train the segmentation network. The proposed network achieves state-of-the-art segmentation performance under small batch sizes. Experimental results on DigestPath2019 and GlaS datasets demonstrate that our proposed model produces superior evaluation scores and state-of-the-art segmentation results.

A multi-scale 3-stacked-layer coned U-net framework for tumor segmentation in whole slide images

The contribution of deep learning in medical image diagnosis has gained extensive interest due to its excellent performance. Furthermore, the interest has also grown in digital pathology since it is considered the golden standard for tumor detection and diagnosis in digital Whole Slide Images (WSIs). This paper proposes an end-to-end cone-shaped encoder-decoder framework called a Multi-scale 3-stacked-Layer coned U-Net (Ms3LcU-Net) framework. It boosts performance by using many enhancements and integrating techniques such as blended mutual attention, dilated fusion, edge enhancement, and atrous pooling. Furthermore, the morphological post-processing and test time augmentation techniques are used in Ms3LcU-Net to refine and smooth the generated segmentations. The experimental results from a quantitative perspective using multiple evaluation metrics and from a qualitative viewpoint by visualizing the generated segmentation predictions conducted on the public PAIP 2019 and DigestPath datasets demonstrated the effectiveness and competitiveness of the proposed model for tumor segmentation in WSIs. The proposed framework yielded an average clipped Jaccard Index value of 0.7211 on the validation set of the PAIP 2019 dataset. In contrast, the DigestPath dataset achieved an average dice coefficient and F1-score of 0.833 and 0.897, respectively. The code will be available publicly upon acceptance of the paper at https://github.com/Heba-AbdeNabi/Ms3LcU-Net-.

Multi-tissue segmentation model of whole slide image of pancreatic cancer based on multi task and attention mechanism

Accurate segmentation of whole slide images is of great significance for the diagnosis of pancreatic cancer. However, developing an automatic model is challenging due to the complex content, limited samples, and high sample heterogeneity of pathological images. This paper presented a multi-tissue segmentation model for whole slide images of pancreatic cancer. We introduced an attention mechanism in building blocks, and designed a multi-task learning framework as well as proper auxiliary tasks to enhance model performance. The model was trained and tested with the pancreatic cancer pathological image dataset from Shanghai Changhai Hospital. And the data of TCGA, as an external independent validation cohort, was used for external validation. The F1 scores of the model exceeded 0.97 and 0.92 in the internal dataset and external dataset, respectively. Moreover, the generalization performance was also better than the baseline method significantly. These results demonstrate that the proposed model can accurately segment eight kinds of tissue regions in whole slide images of pancreatic cancer, which can provide reliable basis for clinical diagnosis.

A user-friendly tool for cloud-based whole slide image segmentation with examples from renal histopathology

BackgroundImage-based machine learning tools hold great promise for clinical applications in pathology research. However, the ideal end-users of these computational tools (e.g., pathologists and biological scientists) often lack the programming experience required for the setup and use of these tools which often rely on the use of command line interfaces.MethodsWe have developed Histo-Cloud, a tool for segmentation of whole slide images (WSIs) that has an easy-to-use graphical user interface. This tool runs a state-of-the-art convolutional neural network (CNN) for segmentation of WSIs in the cloud and allows the extraction of features from segmented regions for further analysis.ResultsBy segmenting glomeruli, interstitial fibrosis and tubular atrophy, and vascular structures from renal and non-renal WSIs, we demonstrate the scalability, best practices for transfer learning, and effects of dataset variability. Finally, we demonstrate an application for animal model research, analyzing glomerular features in three murine models.ConclusionsHisto-Cloud is open source, accessible over the internet, and adaptable for segmentation of any histological structure regardless of stain.

Histopathological Tissue Segmentation of Lung Cancer with Bilinear CNN and Soft Attention.

Automatic tissue segmentation in whole-slide images (WSIs) is a critical task in hematoxylin and eosin- (H&E-) stained histopathological images for accurate diagnosis and risk stratification of lung cancer. Patch classification and stitching the classification results can fast conduct tissue segmentation of WSIs. However, due to the tumour heterogeneity, large intraclass variability and small interclass variability make the classification task challenging. In this paper, we propose a novel bilinear convolutional neural network- (Bilinear-CNN-) based model with a bilinear convolutional module and a soft attention module to tackle this problem. This method investigates the intraclass semantic correspondence and focuses on the more distinguishable features that make feature output variations relatively large between interclass. The performance of the Bilinear-CNN-based model is compared with other state-of-the-art methods on the histopathological classification dataset, which consists of 107.7 k patches of lung cancer. We further evaluate our proposed algorithm on an additional dataset from colorectal cancer. Extensive experiments show that the performance of our proposed method is superior to that of previous state-of-the-art ones and the interpretability of our proposed method is demonstrated by Grad-CAM.

A cloud-based tool for federated segmentation of whole slide images.

It is commonly known that diverse datasets of WSIs are beneficial when training convolutional neural networks, however sharing medical data between institutions is often hindered by regulatory concerns. We have developed a cloud-based tool for federated WSI segmentation, allowing collaboration between institutions without the need to directly share data. To show the feasibility of federated learning on pathology data in the real world, We demonstrate this tool by segmenting IFTA from three institutions and show that keeping the three datasets separate does not hinder segmentation performance. This pipeline is deployed in the cloud for easy access for data viewing and annotation by each site's respective constituents.

Dual Encoder Attention U-net for Nuclei Segmentation.

Nuclei segmentation in whole slide images (WSIs) stained with Hematoxylin and Eosin (H&E) dye, is a key step in computational pathology which aims to automate the laborious process of manual counting and segmentation. Nuclei segmentation is a challenging problem that involves challenges such as touching nuclei resolution, small-sized nuclei, size, and shape variations. With the advent of deep learning, convolution neural networks (CNNs) have shown a powerful ability to extract effective representations from microscopic H&E images. We propose a novel dual encoder Attention U-net (DEAU) deep learning architecture and pseudo hard attention gating mechanism, to enhance the attention to target instances. We added a new secondary encoder to the attention U-net to capture the best attention for a given input. Since H captures nuclei information, we propose a stain-separated H channel as input to the secondary encoder. The role of the secondary encoder is to transform attention prior to different spatial resolutions while learning significant attention information. The proposed DEAU performance was evaluated on three publicly available H&E data sets for nuclei segmentation from different research groups. Experimental results show that our approach outperforms other attention-based approaches for nuclei segmentation.

A deep learning based multiscale approach to segment the areas of interest in whole slide images.

This paper addresses the problem of liver cancer segmentation in Whole Slide Images (WSIs). We propose a multi-scale image processing method based on an automatic end-to-end deep neural network algorithm for the segmentation of cancerous areas. A seven-level gaussian pyramid representation of the histopathological image was built to provide the texture information at different scales. In this work, several neural architectures were compared using the original image level for the training procedure. The proposed method is based on U-Net applied to seven levels of various resolutions (pyramidal subsampling). The predictions in different levels are combined through a voting mechanism. The final segmentation result is generated at the original image level. Partial color normalization and the weighted overlapping method were applied in preprocessing and prediction separately. The results show the effectiveness of the proposed multi-scale approach which achieved better scores than state-of-the-art methods.

A novel method for tissue segmentation in high-resolution H&E-stained histopathological whole-slide images

Tissue segmentation in whole-slide images is an important task in digital pathology, required for efficient and accurate computer-aided diagnostics. Precise tissue segmentation is particularly significant for a correct diagnosis in cases, when tissue structure of a specimen is very porous, such as skin specimens. In this paper, we addressed the problem of fore- and background segmentation in histopatological images of skin specimens stained with hematoxylin and eosin (H&E), which has not been solved yet, by a novel method based on a combination of statistical analysis, color thresholding, and binary morphology. We validated our algorithm on large extracts from 60 high-resolution whole slide images, with differing staining quality and captured under varying imaging conditions, from three laboratories. The size of extracts varies from 2000×1500 to 20000×30000 pixels and the number of images used in our study matches the number of H&E images used by other research teams. We compared our method to the published ones (GrabCut and FESI) and showed that our approach outperforms its counterparts (Jaccard index of 0.929 vs. 0.776 and 0.695).

Fast and accurate tumor segmentation of histology images using persistent homology and deep convolutional features.

Tumor segmentation in whole-slide images of histology slides is an important step towards computer-assisted diagnosis. In this work, we propose a tumor segmentation framework based on the novel concept of persistent homology profiles (PHPs). For a given image patch, the homology profiles are derived by efficient computation of persistent homology, which is an algebraic tool from homology theory. We propose an efficient way of computing topological persistence of an image, alternative to simplicial homology. The PHPs are devised to distinguish tumor regions from their normal counterparts by modeling the atypical characteristics of tumor nuclei. We propose two variants of our method for tumor segmentation: one that targets speed without compromising accuracy and the other that targets higher accuracy. The fast version is based on a selection of exemplar image patches from a convolution neural network (CNN) and patch classification by quantifying the divergence between the PHPs of exemplars and the input image patch. Detailed comparative evaluation shows that the proposed algorithm is significantly faster than competing algorithms while achieving comparable results. The accurate version combines the PHPs and high-level CNN features and employs a multi-stage ensemble strategy for image patch labeling. Experimental results demonstrate that the combination of PHPs and CNN features outperform competing algorithms. This study is performed on two independently collected colorectal datasets containing adenoma, adenocarcinoma, signet, and healthy cases. Collectively, the accurate tumor segmentation produces the highest average patch-level F1-score, as compared with competing algorithms, on malignant and healthy cases from both the datasets. Overall the proposed framework highlights the utility of persistent homology for histopathology image analysis.