Abdominal Organ Segmentation Research Articles

Automated abdominal organ segmentation algorithms for non-enhanced CT for volumetry and 3D radiomics analysis

Abstract Purpose To develop fully-automated abdominal organ segmentation algorithms from non-enhanced abdominal CT and low-dose chest CT and assess their feasibility for automated CT volumetry and 3D radiomics analysis of abdominal solid organs. Methods Fully-automated nnU-Net-based models were developed to segment the liver, spleen, and both kidneys in non-enhanced abdominal CT, and the liver and spleen in low-dose chest CT. 105 abdominal CTs and 60 low-dose chest CTs were used for model development, and 55 abdominal CTs and 10 low-dose chest CTs for external testing. The segmentation performance for each organ was assessed using the Dice similarity coefficients, with manual segmentation results serving as the ground truth. Agreements between ground-truth measurements and model estimates of organ volume and 3D radiomics features were assessed using the Bland–Altman analysis and intraclass correlation coefficients (ICC). Results The models accurately segmented the liver, spleen, right kidney, and left kidney in abdominal CT and the liver and spleen in low-dose chest CT, showing mean Dice similarity coefficients in the external dataset of 0.968, 0.960, 0.952, and 0.958, respectively, in abdominal CT, and 0.969 and 0.960, respectively, in low-dose chest CT. The model-estimated and ground truth volumes of these organs exhibited mean differences between − 0.7% and 2.2%, with excellent agreements. The automatically extracted mean and median Hounsfield units (ICCs, 0.970–0.999 and 0.994–0.999, respectively), uniformity (ICCs, 0.985–0.998), entropy (ICCs, 0.931–0.993), elongation (ICCs, 0.978–0.992), and flatness (ICCs, 0.973–0.997) showed excellent agreement with ground truth measurements for each organ; however, skewness (ICCs, 0.210–0.831), kurtosis (ICCs, 0.053–0.933), and sphericity (ICCs, 0.368–0.819) displayed relatively low and inconsistent agreement. Conclusion Our nnU-Net-based models accurately segmented abdominal solid organs in non-enhanced abdominal and low-dose chest CT, enabling reliable automated measurements of organ volume and specific 3D radiomics features.

Deep Learning Models for Abdominal CT Organ Segmentation in Children: Development and Validation in Internal and Heterogeneous Public Datasets.

BACKGROUND. Deep learning abdominal organ segmentation algorithms have shown excellent results in adults; validation in children is sparse. OBJECTIVE. The purpose of this article is to develop and validate deep learning models for liver, spleen, and pancreas segmentation on pediatric CT examinations. METHODS. This retrospective study developed and validated deep learning models for liver, spleen, and pancreas segmentation using 1731 CT examinations (1504 training, 221 testing), derived from three internal institutional pediatric (age ≤ 18 years) datasets (n = 483) and three public datasets comprising pediatric and adult examinations with various pathologies (n = 1248). Three deep learning model architectures (SegResNet, DynUNet, and SwinUNETR) from the Medical Open Network for Artificial Intelligence (MONAI) framework underwent training using native training (NT), relying solely on institutional datasets, and transfer learning (TL), incorporating pretraining on public datasets. For comparison, TotalSegmentator, a publicly available segmentation model, was applied to test data without further training. Segmentation performance was evaluated using mean Dice similarity coefficient (DSC), with manual segmentations as reference. RESULTS. For internal pediatric data, the DSC for TotalSegmentator, NT models, and TL models for normal liver was 0.953, 0.964-0.965, and 0.965-0.966, respectively; for normal spleen, 0.914, 0.942-0.945, and 0.937-0.945; for normal pancreas, 0.733, 0.774-0.785, and 0.775-0.786; and for pancreas with pancreatitis, 0.703, 0.590-0.640, and 0.667-0.711. For public pediatric data, the DSC for TotalSegmentator, NT models, and TL models for liver was 0.952, 0.871-0.908, and 0.941-0.946, respectively; for spleen, 0.905, 0.771-0.827, and 0.897-0.926; and for pancreas, 0.700, 0.577-0.648, and 0.693-0.736. For public primarily adult data, the DSC for TotalSegmentator, NT models, and TL models for liver was 0.991, 0.633-0.750, and 0.926-0.952, respectively; for spleen, 0.983, 0.569-0.604, and 0.923-0.947; and for pancreas, 0.909, 0.148-0.241, and 0.699-0.775. The DynUNet TL model was selected as the best-performing NT or TL model considering DSC values across organs and test datasets and was made available as an open-source MONAI bundle (https://github.com/cchmc-dll/pediatric_abdominal_segmentation_bundle.git). CONCLUSION. TL models trained on heterogeneous public datasets and fine-tuned using institutional pediatric data outperformed internal NT models and Total-Segmentator across internal and external pediatric test data. Segmentation performance was better in liver and spleen than in pancreas. CLINICAL IMPACT. The selected model may be used for various volumetry applications in pediatric imaging.

Evaluating Sex-specific Differences in Abdominal Fat Volume and Proton Density Fat Fraction at MRI Using Automated nnU-Net-based Segmentation.

Sex-specific abdominal organ volume and proton density fat fraction (PDFF) in people with obesity during a weight loss intervention was assessed with automated multiorgan segmentation of quantitative water-fat MRI. An nnU-Net architecture was employed for automatic segmentation of abdominal organs, including visceral and subcutaneous adipose tissue, liver, and psoas and erector spinae muscle, based on quantitative chemical shift-encoded MRI and using ground truth labels generated from participants of the Lifestyle Intervention (LION) study. Each organ's volume and fat content were examined in 127 participants (73 female and 54 male participants; body mass index, 30-39.9 kg/m2) and in 81 (54 female and 32 male participants) of these participants after an 8-week formula-based low-calorie diet. Dice scores ranging from 0.91 to 0.97 were achieved for the automatic segmentation. PDFF was found to be lower in visceral adipose tissue compared with subcutaneous adipose tissue in both male and female participants. Before intervention, female participants exhibited higher PDFF in subcutaneous adipose tissue (90.6% vs 89.7%; P < .001) and lower PDFF in liver (8.6% vs 13.3%; P < .001) and visceral adipose tissue (76.4% vs 81.3%; P < .001) compared with male participants. This relation persisted after intervention. As a response to caloric restriction, male participants lost significantly more visceral adipose tissue volume (1.76 L vs 0.91 L; P < .001) and showed a higher decrease in subcutaneous adipose tissue PDFF (2.7% vs 1.5%; P < .001) than female participants. Automated body composition analysis on quantitative water-fat MRI data provides new insights for understanding sex-specific metabolic response to caloric restriction and weight loss in people with obesity. Keywords: Obesity, Chemical Shift-encoded MRI, Abdominal Fat Volume, Proton Density Fat Fraction, nnU-Net ClinicalTrials.gov registration no. NCT04023942 Supplemental material is available for this article. Published under a CC BY 4.0 license.

Semi-supervised segmentation of abdominal organs and liver tumor: uncertainty rectified curriculum labeling meets X-fuse

Precise liver tumors and associated organ segmentation hold immense value for surgical and radiological intervention, enabling anatomical localization for pre-operative planning and intra-operative guidance. Modern deep learning models for medical image segmentation have evolved from convolution neural networks to transformer architectures, significantly boosting global context understanding. However, accurate delineation especially of hepatic lesions remains an enduring challenge due to models’ predominant focus solely on spatial feature extraction failing to adequately characterize complex medical anatomies. Moreover, the relative paucity of expertly annotated medical imaging data restricts model exposure to diverse pathological presentations. In this paper, we present a three-phrased cascaded segmentation framework featuring an X-Fuse model that synergistically integrates spatial and frequency domain’s complementary information in dual encoders to enrich latent feature representation. To enhance model generalizability, building upon X-Fuse topology and taking advantage of additional unlabeled pathological data, our proposed integration of curriculum pseudo-labeling with Jensen–Shannon variance-based uncertainty rectification promotes optimized pseudo supervision in the context of semi-supervised learning. We further introduce a tumor-focus augmentation technique including training-free copy-paste and knowledge-based synthesis that show efficacy in simplicity, contributing to the substantial elevation of model adaptability on diverse lesional morphologies. Extensive experiments and modular evaluations on a holdout test set demonstrate that our methods significantly outperform existing state-of-the-art segmentation models in both supervised and semi-supervised settings, as measured by the Dice similarity coefficient, achieving superior delineation of bones (95.42%), liver (96.26%), and liver tumors (89.53%) with 16.41% increase comparing to V-Net on supervised-only and augmented-absent scenario. Our method marks a significant step toward the realization of more reliable and robust AI-assisted diagnostic tools for liver tumor intervention. We have made the codes publicly available [https://github.com/lyupengju/X-Fuse].

View adaptive unified self-supervised technique for abdominal organ segmentation

Automatic abdominal organ segmentation is an essential prerequisite for accurate volumetric analysis, disease diagnosis, and tracking by medical practitioners. However, the deformable shapes, variable locations, overlapping with nearby organs, and similar contrast make the segmentation challenging. Moreover, the requirement of a large manually labeled dataset makes it harder. Hence, a semi-supervised contrastive learning approach is utilized to perform the automatic abdominal organ segmentation. Existing 3D deep learning models based on contrastive learning are not able to capture the 3D context of medical volumetric data along three planes/views: axial, sagittal, and coronal views. In this work, a semi-supervised view-adaptive unified model (VAU-model) is proposed to make the 3D deep learning model as view-adaptive to learn 3D context along each view in a unified manner. This method utilizes the novel optimization function that assists the 3D model to learn the 3D context of volumetric medical data along each view in a single model. The effectiveness of the proposed approach is validated on the three types of datasets: BTCV, NIH, and MSD quantitatively and qualitatively. The results demonstrate that the VAU model achieves an average Dice score of 81.61% which is a 3.89% improvement compared to the previous best results for pancreas segmentation in multi-organ dataset BTCV. It also achieves an average Dice score of 77.76% and 76.76% for the pancreas under the single organ non-pathological NIH dataset, and pathological MSD dataset.

Many birds, one stone: Medical image segmentation with multiple partially labeled datasets

Medical image segmentation is fundamental in the field of medical image analysis and has wide clinical applications in disease diagnosis and surgical planning etc. Current prevalent solution is to train a deep network in a fully supervised way with a large-scale fully labeled dataset. However, due to the high labor cost and requirement on medical expertise, such dataset is always absent. Instead, there are multiple partially labeled datasets which are originally established for specific purposes. To make full use of these partially labeled datasets, we propose a novel partially supervised segmentation network, named PSSNet, which consists of a task-specific feature learning network followed by a cross-task attention module (xTA) to exploit task dependencies to enhance task-specific features. To solve the challenges raised by unlabeled classes and domain shift across datasets, we propose an adversarial self-training strategy. We conduct experiments on two medical image segmentation tasks. One is the fine-grained fundus image segmentation aiming to simultaneously segment four-class lesions, OD and OC, and vessels. Validation on seven datasets demonstrates that our PSSNet performs the best among three baselines and three state-of-the-arts. The other is the multiple abdominal organ segmentation in CT images. Our PSSNet is trained on three partially labeled datasets, i.e., LiTS, KiTS and Spleen. Validation on one fully labeled dataset, i.e., BTCV, demonstrates that our PSSNet achieves better performances than four state-of-the-arts. The code is publicly available at https://github.com/CVIU-CSU/PSSNet.

Recurrent feature propagation and edge skip-connections for automatic abdominal organ segmentation

Automatic segmentation of abdominal organs in computed tomography (CT) images can support radiation therapy and image-guided surgery workflows. Development of such automatic solutions remains challenging mainly owing to complex organ interactions and blurry boundaries in CT images. To address these issues, we focus on effective spatial context modeling and explicit edge segmentation priors. Accordingly, we propose a 3D network with four main components trained end-to-end including shared encoder, edge detector, decoder with edge skip-connections (ESCs) and recurrent feature propagation head (RFP-Head). To capture wide-range spatial dependencies, the RFP-Head propagates and harvests local features through directed acyclic graphs (DAGs) formulated with recurrent connections in an efficient slice-wise manner, with regard to spatial arrangement of image units. To leverage edge information, the edge detector learns edge prior knowledge specifically tuned for semantic segmentation by exploiting intermediate features from the encoder with the edge supervision. The ESCs then aggregate the edge knowledge with multi-level decoder features to learn a hierarchy of discriminative features explicitly modeling complementarity between organs’ interiors and edges for segmentation. We conduct extensive experiments on challenging abdominal CT datasets with eight annotated organs. Experimental results show that the proposed network outperforms several state-of-the-art models, especially for the segmentation of small and complicated structures (gallbladder, esophagus, stomach, pancreas and duodenum).

A Robust Network for Multi-Label Abdominal Organs Segmentation

The paper proposes a robust and efficient model designed for multi-label abdominal organ segmentation, featuring a substantially reduced number of parameters. The model focuses on the effectiveness of edge guidance in segmentation and leverages a 3D-Unet architecture with deep supervision, incorporating the robust deep thinking gate (DTG) architecture. Our DTG-incorporated model architecture excels in both efficiency and effectiveness, demonstrating notable enhancements in multi-label abdominal organ segmentation performance. A comprehensive evaluation of the model employed on two datasets of MRI scan of BTCV and FLARE 2022, comparing its performance against state-of-the-art counterparts. The outcomes revealed that the proposed model achieved the highest dice score in the esophagus (0.795), gallbladder (0.945), and pancreas (0.87) while maintaining a most significantly reduced parameter count (13.3 million parameters count). This achievement underscores the model’s efficiency and its suitability for seamless integration into real-world applications, offering promising prospects for enhanced medical image analysis.

Adversarial deep learning for improved abdominal organ segmentation in CT scans

Adversarial deep learning for improved abdominal organ segmentation in CT scans

Multi-residual 2D network integrating spatial correlation for whole heart segmentation

Whole heart segmentation (WHS) has significant clinical value for cardiac anatomy, modeling, and analysis of cardiac function. This study aims to address the WHS accuracy on cardiac CT images, as well as the fast inference speed and low graphics processing unit (GPU) memory consumption required by practical clinical applications. Thus, we propose a multi-residual two-dimensional (2D) network integrating spatial correlation for WHS. The network performs slice-by-slice segmentation on three-dimensional cardiac CT images in a 2D encoder–decoder manner. In the network, a convolutional long short-term memory skip connection module is designed to perform spatial correlation feature extraction on the feature maps at different resolutions extracted by the sub-modules of the pre-trained ResNet-based encoder. Moreover, a decoder based on the multi-residual module is designed to analyze the extracted features from the perspectives of multi-scale and channel attention, thereby accurately delineating the various substructures of the heart. The proposed method is verified on a dataset of the multi-modality WHS challenge, an in-house WHS dataset, and a dataset of the abdominal organ segmentation challenge. The dice, Jaccard, average symmetric surface distance, Hausdorff distance, inference time, and maximum GPU memory of the WHS are 0.914, 0.843, 1.066 mm, 15.778 mm, 9.535 s, and 1905 MB, respectively. The proposed network has high accuracy, fast inference speed, minimal GPU memory consumption, strong robustness, and good generalization. It can be deployed to clinical practical applications for WHS and can be effectively extended and applied to other multi-organ segmentation fields. The source code is publicly available at https://github.com/nancy1984yan/MultiResNet-SC.

Unsupervised Domain Adaptation for Medical Image Segmentation Using Transformer With Meta Attention.

Image segmentation is essential to medical image analysis as it provides the labeled regions of interest for the subsequent diagnosis and treatment. However, fully-supervised segmentation methods require high-quality annotations produced by experts, which is laborious and expensive. In addition, when performing segmentation on another unlabeled image modality, the segmentation performance will be adversely affected due to the domain shift. Unsupervised domain adaptation (UDA) is an effective way to tackle these problems, but the performance of the existing methods is still desired to improve. Also, despite the effectiveness of recent Transformer-based methods in medical image segmentation, the adaptability of Transformers is rarely investigated. In this paper, we present a novel UDA framework using a Transformer for building a cross-modality segmentation method with the advantages of learning long-range dependencies and transferring attentive information. To fully utilize the attention learned by the Transformer in UDA, we propose Meta Attention (MA) and use it to perform a fully attention-based alignment scheme, which can learn the hierarchical consistencies of attention and transfer more discriminative information between two modalities. We have conducted extensive experiments on cross-modality segmentation using three datasets, including a whole heart segmentation dataset (MMWHS), an abdominal organ segmentation dataset, and a brain tumor segmentation dataset. The promising results show that our method can significantly improve performance compared with the state-of-the-art UDA methods.

Multi-phase CT synthesis-assisted segmentation of abdominal organs

To propose a method for abdominal multi-organ segmentation assisted by multi-phase CT synthesis. Multi-phase CT synthesis for synthesizing high-quality CT images was used to increase the information details for image segmentation. A transformer block was introduced to help to capture long-range semantic information in cooperation with perceptual loss to minimize the differences between the real image and synthesized image. The model was trained using multi-phase CT dataset of 526 total cases from Nanfang Hospital. The mean maximum absolute error (MAE) of the synthesized non-contrast CT, venous phase contrast- enhanced CT (CECT), and delay phase CECT images from arterial phase CECT was 19.192±3.381, 20.140±2.676 and 22.538±2.874, respectively, which were better than those of images synthesized using other methods. Validation of the multi-phase CT synthesis-assisted abdominal multi-organ segmentation method showed an average dice coefficient of 0.847 for the internal validation set and 0.823 for the external validation set. The propose method is capable of synthesizing high-quality multi-phase CT images to effectively reduce the errors in registration between different phase CT images and improve the performance for segmentation of 13 abdominal organs.

TSCA-Net: Transformer based spatial-channel attention segmentation network for medical images

Deep learning architectures based on convolutional neural network (CNN) and Transformer have achieved great success in medical image segmentation. Models based on the encoder–decoder framework like U-Net have been successfully employed in many realistic scenarios. However, due to the low contrast between object and background, various shapes and scales of objects, and complex background in medical images, it is difficult to locate targets and obtain better segmentation performance by extracting effective information from images. In this paper, an encoder–decoder architecture based on spatial and channel attention modules built by Transformer is proposed for medical image segmentation. Concretely, spatial and channel attention modules based on Transformer are utilized to extract spatial and channel global complementary information at different layers in U-shape network, which is beneficial to learn the detail features in different scales. To fuse better spatial and channel information from Transformer features, a spatial and channel feature fusion block is designed for the decoder. The proposed network inherits the advantages of both CNN and Transformer with the local feature representation and long-range dependency for medical images. Qualitative and quantitative experiments demonstrate that the proposed method outperforms against eight state-of-the-art segmentation methods on five publicly medical image datasets including different modalities, such as 80.23% and 93.56% Dice value, 67.13% and 88.94% Intersection over Union (IoU) value on the Multi-organ Nucleus Segmentation (MoNuSeg) and Combined Healthy Abdominal Organ Segmentation with Computed Tomography scans (CHAOS-CT) datasets.

SEF-UNet: advancing abdominal multi-organ segmentation with SEFormer and depthwise cascaded upsampling.

The abdomen houses multiple vital organs, which are associated with various diseases posing significant risks to human health. Early detection of abdominal organ conditions allows for timely intervention and treatment, preventing deterioration of patients' health. Segmenting abdominal organs aids physicians in more accurately diagnosing organ lesions. However, the anatomical structures of abdominal organs are relatively complex, with organs overlapping each other, sharing similar features, thereby presenting challenges for segmentation tasks. In real medical scenarios, models must demonstrate real-time and low-latency features, necessitating an improvement in segmentation accuracy while minimizing the number of parameters. Researchers have developed various methods for abdominal organ segmentation, ranging from convolutional neural networks (CNNs) to Transformers. However, these methods often encounter difficulties in accurately identifying organ segmentation boundaries. MetaFormer abstracts the framework of Transformers, excluding the multi-head Self-Attention, offering a new perspective for solving computer vision problems and overcoming the limitations of Vision Transformers and CNN backbone networks. To further enhance segmentation effectiveness, we propose a U-shaped network, integrating SEFormer and depthwise cascaded upsampling (dCUP) as the encoder and decoder, respectively, into the UNet structure, named SEF-UNet. SEFormer combines Squeeze-and-Excitation modules with depthwise separable convolutions, instantiating the MetaFormer framework, enhancing the capture of local details and texture information, thereby improving edge segmentation accuracy. dCUP further integrates shallow and deep information layers during the upsampling process. Our model significantly improves segmentation accuracy while reducing the parameter count and exhibits superior performance in segmenting organ edges that overlap each other, thereby offering potential deployment in real medical scenarios.

3D Multi-Organ and Tumor Segmentation Based on Re-Parameterize Diverse Experts

Automated segmentation of abdominal organs and tumors in medical images is a challenging yet essential task in medical image analysis. Deep learning has shown excellent performance in many medical image segmentation tasks, but most prior efforts were fragmented, addressing individual organ and tumor segmentation tasks with specialized networks. To tackle the challenges of abdominal organ and tumor segmentation using partially labeled datasets, we introduce Re-parameterizing Mixture-of-Diverse-Experts (RepMode) to abdominal organ and tumor segmentation. Within the RepMode framework, the Mixture-of-Diverse-Experts (MoDE) block forms the foundation, learning generalized parameters applicable across all tasks. We seamlessly integrate the MoDE block into a U-shaped network with dynamic heads, addressing multi-scale challenges by dynamically combining experts with varying receptive fields for each organ and tumor. Our framework incorporates task encoding in both the encoder–decoder section and the segmentation head, enabling the network to adapt throughout the entire system based on task-related information. We evaluate our approach on the multi-organ and tumor segmentation (MOTS) dataset. Experiments show that DoDRepNet outperforms previous methods, including multi-head networks and single-network approaches, giving a highly competitive performance compared with the original single network with dynamic heads. DoDRepNet offers a promising approach to address the complexities of abdominal organ and tumor segmentation using partially labeled datasets, enhancing segmentation accuracy and robustness.

Deep Learning Framework for Liver Segmentation from T1-Weighted MRI Images.

The human liver exhibits variable characteristics and anatomical information, which is often ambiguous in radiological images. Machine learning can be of great assistance in automatically segmenting the liver in radiological images, which can be further processed for computer-aided diagnosis. Magnetic resonance imaging (MRI) is preferred by clinicians for liver pathology diagnosis over volumetric abdominal computerized tomography (CT) scans, due to their superior representation of soft tissues. The convenience of Hounsfield unit (HoU) based preprocessing in CT scans is not available in MRI, making automatic segmentation challenging for MR images. This study investigates multiple state-of-the-art segmentation networks for liver segmentation from volumetric MRI images. Here, T1-weighted (in-phase) scans are investigated using expert-labeled liver masks from a public dataset of 20 patients (647 MR slices) from the Combined Healthy Abdominal Organ Segmentation grant challenge (CHAOS). The reason for using T1-weighted images is that it demonstrates brighter fat content, thus providing enhanced images for the segmentation task. Twenty-four different state-of-the-art segmentation networks with varying depths of dense, residual, and inception encoder and decoder backbones were investigated for the task. A novel cascaded network is proposed to segment axial liver slices. The proposed framework outperforms existing approaches reported in the literature for the liver segmentation task (on the same test set) with a dice similarity coefficient (DSC) score and intersect over union (IoU) of 95.15% and 92.10%, respectively.

Abdominal organ segmentation via deep diffeomorphic mesh deformations

Abdominal organ segmentation from CT and MRI is an essential prerequisite for surgical planning and computer-aided navigation systems. It is challenging due to the high variability in the shape, size, and position of abdominal organs. Three-dimensional numeric representations of abdominal shapes with point-wise correspondence to a template are further important for quantitative and statistical analyses thereof. Recently, template-based surface extraction methods have shown promising advances for direct mesh reconstruction from volumetric scans. However, the generalization of these deep learning-based approaches to different organs and datasets, a crucial property for deployment in clinical environments, has not yet been assessed. We close this gap and employ template-based mesh reconstruction methods for joint liver, kidney, pancreas, and spleen segmentation. Our experiments on manually annotated CT and MRI data reveal limited generalization capabilities of previous methods to organs of different geometry and weak performance on small datasets. We alleviate these issues with a novel deep diffeomorphic mesh-deformation architecture and an improved training scheme. The resulting method, UNetFlow, generalizes well to all four organs and can be easily fine-tuned on new data. Moreover, we propose a simple registration-based post-processing that aligns voxel and mesh outputs to boost segmentation accuracy.

ADNet++: A few-shot learning framework for multi-class medical image volume segmentation with uncertainty-guided feature refinement.

A major barrier to applying deep segmentation models in the medical domain is their typical data-hungry nature, requiring experts to collect and label large amounts of data for training. As a reaction, prototypical few-shot segmentation (FSS) models have recently gained traction as data-efficient alternatives. Nevertheless, despite the recent progress of these models, they still have some essential shortcomings that must be addressed. In this work, we focus on three of these shortcomings: (i) the lack of uncertainty estimation, (ii) the lack of a guiding mechanism to help locate edges and encourage spatial consistency in the segmentation maps, and (iii) the models' inability to do one-step multi-class segmentation. Without modifying or requiring a specific backbone architecture, we propose a modified prototype extraction module that facilitates the computation of uncertainty maps in prototypical FSS models, and show that the resulting maps are useful indicators of the model uncertainty. To improve the segmentation around boundaries and to encourage spatial consistency, we propose a novel feature refinement module that leverages structural information in the input space to help guide the segmentation in the feature space. Furthermore, we demonstrate how uncertainty maps can be used to automatically guide this feature refinement. Finally, to avoid ambiguous voxel predictions that occur when images are segmented class-by-class, we propose a procedure to perform one-step multi-class FSS. The efficiency of our proposed methodology is evaluated on two representative datasets for abdominal organ segmentation (CHAOS dataset and BTCV dataset) and one dataset for cardiac segmentation (MS-CMRSeg dataset). The results show that our proposed methodology significantly (one-sided Wilcoxon signed rank test, p<0.05) improves the baseline, increasing the overall dice score with +5.2, +5.1, and +2.8 percentage points for the CHAOS dataset, the BTCV dataset, and the MS-CMRSeg dataset, respectively.

Efficient Multi-Organ Segmentation From 3D Abdominal CT Images With Lightweight Network and Knowledge Distillation.

Accurate segmentation of multiple abdominal organs from Computed Tomography (CT) images plays an important role in computer-aided diagnosis, treatment planning and follow-up. Currently, 3D Convolution Neural Networks (CNN) have achieved promising performance for automatic medical image segmentation tasks. However, most existing 3D CNNs have a large set of parameters and huge floating point operations (FLOPs), and 3D CT volumes have a large size, leading to high computational cost, which limits their clinical application. To tackle this issue, we propose a novel framework based on lightweight network and Knowledge Distillation (KD) for delineating multiple organs from 3D CT volumes. We first propose a novel lightweight medical image segmentation network named LCOV-Net for reducing the model size and then introduce two knowledge distillation modules (i.e., Class-Affinity KD and Multi-Scale KD) to effectively distill the knowledge from a heavy-weight teacher model to improve LCOV-Net's segmentation accuracy. Experiments on two public abdominal CT datasets for multiple organ segmentation showed that: 1) Our LCOV-Net outperformed existing lightweight 3D segmentation models in both computational cost and accuracy; 2) The proposed KD strategy effectively improved the performance of the lightweight network, and it outperformed existing KD methods; 3) Combining the proposed LCOV-Net and KD strategy, our framework achieved better performance than the state-of-the-art 3D nnU-Net with only one-fifth parameters. The code is available at https://github.com/HiLab-git/LCOVNet-and-KD.

A novel one-to-multiple unsupervised domain adaptation framework for abdominal organ segmentation.

Abdominal multi-organ segmentation in multi-sequence magnetic resonance images (MRI) is of great significance in many clinical scenarios, e.g., MRI-oriented pre-operative treatment planning. Labeling multiple organs on a single MR sequence is a time-consuming and labor-intensive task, let alone manual labeling on multiple MR sequences. Training a model by one sequence and generalizing it to other domains is one way to reduce the burden of manual annotation, but the existence of domain gap often leads to poor generalization performance of such methods. Image translation-based unsupervised domain adaptation (UDA) is a common way to address this domain gap issue. However, existing methods focus less on keeping anatomical consistency and are limited by one-to-one domain adaptation, leading to low efficiency for adapting a model to multiple target domains. This work proposes a unified framework called OMUDA for one-to-multiple unsupervised domain-adaptive segmentation, where disentanglement between content and style is used to efficiently translate a source domain image into multiple target domains. Moreover, generator refactoring and style constraint are conducted in OMUDA for better maintaining cross-modality structural consistency and reducing domain aliasing. The average Dice Similarity Coefficients (DSCs) of OMUDA for multiple sequences and organs on the in-house test set, the AMOS22 dataset and the CHAOS dataset are 85.51%, 82.66% and 91.38%, respectively, which are slightly lower than those of CycleGAN(85.66% and 83.40%) in the first two data sets and slightly higher than CycleGAN(91.36%) in the last dataset. But compared with CycleGAN, OMUDA reduces floating-point calculations by about 87 percent in the training phase and about 30 percent in the inference stage respectively. The quantitative results in both segmentation performance and training efficiency demonstrate the usability of OMUDA in some practical scenes, such as the initial phase of product development.