Automatic Brain Tumor Segmentation Research Articles

CFNet: Automatic multi-modal brain tumor segmentation through hierarchical coarse-to-fine fusion and feature communication

Automatic segmentation of brain tumors employing images from multi-modalities is important for preoperative diagnosis and prognostic assessment. The rich complementary information contained within multi-modal images allows for improved brain tumor segmentation performance when models are trained on multi-modal data. However, accurate segmentation of small lesion regions from medical images remains challenging, due to the irregular shapes and low boundary contrast of brain gliomas. To address these challenges, we propose a coarse-to-fine feature fusion network (CFNet) that effectively incorporates multi-modal image features through modal interaction, semantic perception, and feature fusion. Specifically, the modality cross-attention fusion module is proposed introducing complementary features and mapping them into a unified semantic space to learn complementary representations between modalities. Furthermore, the multi-scale context perception module enables the model to focus on multi-scale lesion fine-grained information while capturing deep semantics. Moreover, the further fusion of fine-grained features with coarse-grained features enhances edge features and the complementary of features. We evaluate the proposed CFNet on two public brain tumor segmentation datasets BraTS2019 and BraTS2020. Experimental results show that the proposed framework outperforms state-of-the-art methods in Dice score, HD95, Sensitivity, demonstrating the effectiveness of CFNet on brain tumor segmentation. Code will be available at https://github.com/YaruC/CFNet.

A Novel Approach for Detection, Segmentation, and Classification of Brain Tumors in MRI Images Using Neural Network and Special C Means Fuzzy Clustering Techniques

Brain tumors present a significant health challenge globally, necessitating advanced techniques for accurate detection, segmentation, and classification. This paper presents a comprehensive study focused on the development and evaluation of innovative methodologies for brain tumor analysis using medical imaging data. The primary objective of this research is to enhance the accuracy and efficiency of brain tumor detection, segmentation, and classification processes. To achieve this goal, a multi-step approach is proposed, integrating various computational techniques and machine learning algorithms. First, the study explores novel methods for preprocessing medical imaging data to enhance image quality and reduce noise artifacts. This preprocessing step plays a crucial role in improving the subsequent analysis stages' accuracy and reliability. Next, a robust tumor detection algorithm is developed, leveraging advanced image processing techniques and deep learning models. The proposed algorithm effectively identifies tumor regions within brain images with high accuracy and minimal false positives. Following tumor detection, a segmentation framework is introduced to precisely delineate tumor boundaries from surrounding healthy tissues. The segmentation algorithm combines traditional image processing methods with state-of-the-art deep learning architectures to achieve accurate and efficient tumor delineation. In this paper, we proposed three novel methods for automatic detection, classification, and segmentation of brain tumors. Comprehensive experiments are conducted on the BRATS dataset and show that the proposed model obtains competitive results. The parameters under study are Accuracy rate, Specificity, and Sensitivity. First approach focuses on classifying cancerous and non-cancerous brain tumors in MRI scans. The system first reads the images and employs a novel fusion method to combine information from various modalities (Flair, T1, T1C, T2) for a more comprehensive picture. This enhances the accuracy of tumor characterization. Following this fusion, the images undergo preprocessing, feature extraction, and classification. The preprocessing stage involves grayscale conversion, binarization, wavelet analysis, and region-of-interest (ROI) calculation. Finally, a robust Neural Network (NN) classification method effectively differentiates cancerous and non-cancerous brain tissue. Performance is evaluated by metrics like accuracy, sensitivity, and specificity. Compared to existing methods, this research system demonstrates superior results, achieving a classification accuracy of 96.61%, sensitivity of 96.66%, and specificity of 96.55%. The Second approach combines Backpropagation Neural Networks (BPNN) with Spatial Fuzzy C-Means (SFCM) clustering for brain tumor analysis. The BPNN classifies brains into normal, benign (non-cancerous abnormality), or malignant (cancerous) categories. SFCM helps pinpoint the exact tumor location and size within the MRI scan through segmentation. A dual-tree complex wavelet transform is employed to extract image features efficiently. This method achieved exceptional results: 99.77% classification accuracy, 99.87% sensitivity (correctly identifying tumors), and 98.69% specificity (correctly identifying healthy tissue). Additionally, the over 90% precision demonstrates the effectiveness of this technique in feature extraction and classification. The experiments demonstrate that BPNN-SFCM successfully segment, and extracts brain tumors from MRI scans. The overall accuracy of BPNN-SFCM is better as compared to other proposed methods and existing methods.

IMG-28. AUTOMATIC BRAIN TUMOR VOLUMETRIC ANALYSIS IN MAGNETIC RESONANCE IMAGING GENERALIZABLE TO PEDIATRIC NEURO-ONCOLOGY

Abstract BACKGROUND The prognosis of brain tumors is variable in clinical practice if it only relies on human interpretation of magnetic resonance imaging (MRI). The automatic segmentation of brain tumors in MRI enables quantitative analysis in support of clinical trials and personalized patient care. We developed benchmarked deep learning-based tools that are generalizable to the volumetric quantification of various tumor types across diverse populations. METHODS We participated in the well-established international brain tumor segmentation challenge (BraTS 2023) and benchmarking competition. The challenge made available 4,500 multi-national brain tumor cases with multi-sequence MRIs, including pediatric high-grade gliomas (PED), i.e., high-grade astrocytoma and diffuse midline glioma, and adult gliomas, brain metastases (MET) and intracranial meningiomas (MEN). Each case comprises four MRI volumes: T1, contrast-enhanced T1, T2, and T2-FLAIR. Manual segmentations were provided to establish ground truth for enhancing tumor (ET), tumor core (TC), and whole tumor (WT). Our framework used a model ensemble strategy based on two state-of-the-art deep learning models: a convolutional neural network (nnU-Net) and a vision transformer (Swin UNETR) and was tested for broader applicability across multiple tumor types. The framework was trained on 99, 1,000, and 165 cases and validated on 45, 141, and 31 unseen cases for PED, MEN, and MET, respectively. Automatic segmentations were evaluated by lesion-wise volume overlap (Dice similarity score, DSC) and Hausdorff distance (HD). RESULTS In the evaluation on independent unseen test datasets, our automatic tool was ranked first for PED, third for MEN, and fourth for MET volumetric analysis. Our method resulted in PED lesion-wise DSC of 0.733, 0.782, 0.817 and HD (mm) of 75.93, 25.54, 24.18 for ET, TC, and WT, respectively. CONCLUSIONS These brain tumor volumetric analysis tools are readily available to be efficiently tested on diverse datasets. Automatic MRI analysis provides consistent quantitative data for multi-institutional protocols and clinical trials.

GMAlignNet: multi-scale lightweight brain tumor image segmentation with enhanced semantic information consistency

Although the U-shaped architecture, represented by UNet, has become a major network model for brain tumor segmentation, the repeated convolution and sampling operations can easily lead to the loss of crucial information. Additionally, directly fusing features from different levels without distinction can easily result in feature misalignment, affecting segmentation accuracy. On the other hand, traditional convolutional blocks used for feature extraction cannot capture the abundant multi-scale information present in brain tumor images. This paper proposes a multi-scale feature-aligned segmentation model called GMAlignNet that fully utilizes Ghost convolution to solve these problems. Ghost hierarchical decoupled fusion unit and Ghost hierarchical decoupled unit are used instead of standard convolutions in the encoding and decoding paths. This transformation replaces the holistic learning of volume structures by traditional convolutional blocks with multi-level learning on a specific view, facilitating the acquisition of abundant multi-scale contextual information through low-cost operations. Furthermore, a feature alignment unit is proposed that can utilize semantic information flow to guide the recovery of upsampled features. It performs pixel-level semantic information correction on misaligned features due to feature fusion. The proposed method is also employed to optimize three classic networks, namely DMFNet, HDCNet, and 3D UNet, demonstrating its effectiveness in automatic brain tumor segmentation. The proposed network model was applied to the BraTS 2018 dataset, and the results indicate that the proposed GMAlignNet achieved Dice coefficients of 81.65%, 90.07%, and 85.16% for enhancing tumor, whole tumor, and tumor core segmentation, respectively. Moreover, with only 0.29 M parameters and 26.88G FLOPs, it demonstrates better potential in terms of computational efficiency and possesses the advantages of lightweight. Extensive experiments on the BraTS 2018, BraTS 2019, and BraTS 2020 datasets suggest that the proposed model exhibits better potential in handling edge details and contour recognition.

Two-headed UNetEfficientNets for parallel execution of segmentation and classification of brain tumors: incorporating postprocessing techniques with connected component labelling.

The purpose of this study is to develop accurate and automated detection and segmentation methods for brain tumors, given their significant fatality rates, with aggressive malignant tumors like Glioblastoma Multiforme (GBM) having a five-year survival rate as low as 5 to 10%. This underscores the urgent need to improve diagnosis and treatment outcomes through innovative approaches in medical imaging and deep learning techniques. In this work, we propose a novel approach utilizing the two-headed UNetEfficientNets model for simultaneous segmentation and classification of brain tumors from Magnetic Resonance Imaging (MRI) images. The model combines the strengths of EfficientNets and a modified two-headed Unet model. We utilized a publicly available dataset consisting of 3064 brain MR images classified into three tumor classes: Meningioma, Glioma, and Pituitary. To enhance the training process, we performed 12 types of data augmentation on the training dataset. We evaluated the methodology using six deep learning models, ranging from UNetEfficientNet-B0 to UNetEfficientNet-B5, optimizing the segmentation and classification heads using binary cross entropy (BCE) loss with Dice and BCE with focal loss, respectively. Post-processing techniques such as connected component labeling (CCL) and ensemble models were applied to improve segmentation outcomes. The proposed UNetEfficientNet-B4 model achieved outstanding results, with an accuracy of 99.4% after postprocessing. Additionally, it obtained high scores for DICE (94.03%), precision (98.67%), and recall (99.00%) after post-processing. The ensemble technique further improved segmentation performance, with a global DICE score of 95.70% and Jaccard index of 91.20%. Our study demonstrates the high efficiency and accuracy of the proposed UNetEfficientNet-B4 model in the automatic and parallel detection and segmentation of brain tumors from MRI images. This approach holds promise for improving diagnosis and treatment planning for patients with brain tumors, potentially leading to better outcomes and prognosis.

A Novel Deep Learning Approach for Brain Tumor Segmentation and Classification

Automated brain tumor detection and segmentation are crucial in medical diagnostics as they give details about functional structures and also potential unusual tissue that is required to define surgical strategies. Segmentation of images is one of the most difficult issues in the area of MRI scan analysis research. However, due to low contrast, automatic tumor segmentation, accuracy issues, and ill-defined boundaries remain difficult. For the prevention of brain tumors, an investigation was developed for implementing a novel framework. To overcome the problem faced by traditional existing techniques, this paper proposed an automatic brain tumor segmentation and detection system using the proposed dense convolution neural network without human intervention, where an intrinsic set of features are extracted to perform the classification task. The main aim of this paper is to segment the tumor portion from the affected MRI using a novel clustering approach. Moreover, a lot of scholars have researched the diagnosis of brain tumors, yet the accuracy-based performance metric in diagnosis results is low. A deep learning framework is proposed to evaluate brain disease more accurately using a Black Widow Optimization driven Dense Convolution Neural Network (BW-DCNN). The various performances are assessed, and the results are compared to those of other existing classifiers and approaches.

Multi-scale features and attention guided for brain tumor segmentation

Brain tumor segmentation supplies a credible reference for clinical treatment and pathological research and facilitates practitioners to diagnose more accurately. However, since the randomness and complexity of tumor shape and location, automatic brain tumor segmentation remains an extremely challenging assignment. In this study, we build an end-to-end convolutional neural network with a U-shaped structure to implement the segmentation of three lesion regions. We propose a multi-scale context block and an attention guidance block to focus on the spatial information at different scales and the interdependence between feature channels to enhance network representations and boost the learning capability of the model. Specifically, the multi-scale context block draws rich feature information through 3D dilated convolution. The attention guidance block reduces the impact of learned redundant features and eliminates the interference of irrelevant regions in the overall global information. Our recommended approach is evaluated on the brain tumor segmentation 2020 validation data. The Dice scores of the enhancing tumor (ET), whole tumor (WT), and tumor core (TC) are 78.19%, 90.10%, and 83.98%, respectively. In addition, the practice is also carried out in 2019 online validation data, and the Dice scores of ET, WT, and TC are 77.31%, 89.64%, and 82.55%, respectively. Experimental results reveal that the recommended approach gains favorable performance in comparison with representative brain tumor segmentation approaches. Our present study would accurately and efficaciously segment the three brain lesion regions and has clinical practice value.

Improved MRI Brain Tumor Segmentation Method Based on UNet++

Brain tumors are one of the most common tumors with high mortality. Accurate detection and quantitative evaluation of brain tumors are necessary for patient treatment. A reliable and effective method for automatic segmentation of brain tumors by magnetic resonance imaging (MRI) plays a crucial role in patient treatment. In recent years, the Unet++ network structure has shown better performance in image segmentation. However, it is deficient in small-scale feature extraction and segmentation accuracy. In this study, the AC-ResUnet++ network was proposed to address the problems of Unet++ network mentioned above, which combined residual module, convolutional block attention module (CBAM) and Atrous spatial pyramidal pooling (ASPP). The residual module can solve the problem of gradient explosion in the deep network, CBAM can focus on local feature information and enhance the feature learning ability of the network for the target range, and ASPP module can generate different receptive fields and obtain multi-scale contextual feature information. The BraTS 2018 and BraTS 2019 datasets were used to test the proposed network. The Dice similarity coefficient of AC-ResUnet++ in whole tumor, tumor core and enhanced tumor are 0.8521, 0.8696 and 0.7868, respectively. Compared with Unet++ network, the Dice similarity coefficient increased by 1.22%, 5.08% and 2.03% on the baselines. The comprehensive results demonstrate that AC-ResUnet++ performs more effectively in improving the segmentation accuracy of brain tumor.

Fully Automatic Glioma Segmentation Algorithm of Magnetic Resonance Imaging Based on 3D-UNet With More Global Contextual Feature Extraction: An Improvement on Insufficient Extraction of Global Features

The fully automatic segmentation of glioma and its subregions is fundamental for computer-aided clinical diagnosis of tumors. In the segmentation process of brain magnetic resonance imaging (MRI), convolutional neural networks with small convolutional kernels can only capture local features and are ineffective at integrating global features, which narrows the receptive field and leads to insufficient segmentation accuracy. This study aims to use dilated convolution to address the problem of inadequate global feature extraction in 3D-UNet. 1) Algorithm construction: A 3D-UNet model with three pathways for more global contextual feature extraction, or 3DGE-UNet, was proposed in the paper. By using publicly available datasets from the Brain Tumor Segmentation Challenge (BraTS) of 2019 (335 patient cases), a global contextual feature extraction (GE) module was designed. This module was integrated at the first, second, and third skip connections of the 3D UNet network. The module was utilized to fully extract global features at different scales from the images. The global features thus extracted were then overlaid with the upsampled feature maps to expand the model's receptive field and achieve deep fusion of features at different scales, thereby facilitating end-to-end automatic segmentation of brain tumors. 2) Algorithm validation: The image data were sourced from the BraTs 2019 dataset, which included the preoperative MRI images of 335 patients across four modalities (T1, T1ce, T2, and FLAIR) and a tumor image with annotations made by physicians. The dataset was divided into the training, the validation, and the testing sets at an 8∶1∶1 ratio. Physician-labelled tumor images were used as the gold standard. Then, the algorithm's segmentation performance on the whole tumor (WT), tumor core (TC), and enhancing tumor (ET) was evaluated in the test set using the Dice coefficient (for overall effectiveness evaluation), sensitivity (detection rate of lesion areas), and 95% Hausdorff distance (segmentation accuracy of tumor boundaries). The performance was tested using both the 3D-UNet model without the GE module and the 3DGE-UNet model with the GE module to internally validate the effectiveness of the GE module setup. Additionally, the performance indicators were evaluated using the 3DGE-UNet model, ResUNet, UNet++, nnUNet, and UNETR, and the convergence of these five algorithm models was compared to externally validate the effectiveness of the 3DGE-UNet model. 1) In internal validation, the enhanced 3DGE-UNet model achieved Dice mean values of 91.47%, 87.14%, and 83.35% for segmenting the WT, TC, and ET regions in the test set, respectively, producing the optimal values for comprehensive evaluation. These scores were superior to the corresponding scores of the traditional 3D-UNet model, which were 89.79%, 85.13%, and 80.90%, indicating a significant improvement in segmentation accuracy across all three regions (P<0.05). Compared with the 3D-UNet model, the 3DGE-UNet model demonstrated higher sensitivity for ET (86.46% vs. 80.77%) (P<0.05) , demonstrating better performance in the detection of all the lesion areas. When dealing with lesion areas, the 3DGE-UNet model tended to correctly identify and capture the positive areas in a more comprehensive way, thereby effectively reducing the likelihood of missed diagnoses. The 3DGE-UNet model also exhibited exceptional performance in segmenting the edges of WT, producing a mean 95% Hausdorff distance superior to that of the 3D-UNet model (8.17 mm vs. 13.61 mm, P<0.05). However, its performance for TC (8.73 mm vs. 7.47 mm) and ET (6.21 mm vs. 5.45 mm) was similar to that of the 3D-UNet model. 2) In the external validation, the other four algorithms outperformed the 3DGE-UNet model only in the mean Dice for TC (87.25%), the mean sensitivity for WT (94.59%), the mean sensitivity for TC (86.98%), and the mean 95% Hausdorff distance for ET (5.37 mm). Nonetheless, these differences were not statistically significant (P>0.05). The 3DGE-UNet model demonstrated rapid convergence during the training phase, outpacing the other external models. The 3DGE-UNet model can effectively extract and fuse feature information on different scales, improving the accuracy of brain tumor segmentation.

Proportion Estimation and Multi-Class Classification of Abnormal Brain Cells

Vagueness in the determination of the tumor size creates significant hindrances in planning and quantitatively assessing brain tumor (BT) treatments. Non-invasive magnetic resonance imaging (MRI) has become a primary non-ionizing radiation diagnostic tool for brain cancers. It takes a long time to manually segment the extent of a BT from 3D MRI volumes, and the performance heavily depends on the operator’s skill. A precise and automated BT segmentation tool is needed desperately. In this case, an accurate assessment of the tumor’s extent requires a reliable automated segmentation method for the BT. The multimodal BT image segmentation (BRATS 2020) dataset is used in this paper to demonstrate an automated deep convolutional network, or U-Net, method for BT segmentation. Deep learning and transfer learning are utilized to improve the accuracy and effectiveness in detecting and recognizing different types of brain cancers. The unobserved images’ F1 scores were 98% and 99%, respectively.

Joint Brain Tumor Segmentation from Multi-magnetic Resonance Sequences through a Deep Convolutional Neural Network.

Brain tumor segmentation is highly contributive in diagnosing and treatment planning. Manual brain tumor delineation is a time-consuming and tedious task and varies depending on the radiologist's skill. Automated brain tumor segmentation is of high importance and does not depend on either inter- or intra-observation. The objective of this study is to automate the delineation of brain tumors from the Fluid-attenuated inversion recovery (FLAIR), T1-weighted (T1W), T2-weighted (T2W), and T1W contrast-enhanced (T1ce) magnetic resonance (MR) sequences through a deep learning approach, with a focus on determining which MR sequence alone or which combination thereof would lead to the highest accuracy therein. The BraTS-2020 challenge dataset, containing 370 subjects with four MR sequences and manually delineated tumor masks, is applied to train a residual neural network. This network is trained and assessed separately for each one of the MR sequences (single-channel input) and any combination thereof (dual- or multi-channel input). The quantitative assessment of the single-channel models reveals that the FLAIR sequence would yield higher segmentation accuracy compared to its counterparts with a 0.77 ± 0.10 Dice index. As to considering the dual-channel models, the model with FLAIR and T2W inputs yields a 0.80 ± 0.10 Dice index, exhibiting higher performance. The joint tumor segmentation on the entire four MR sequences yields the highest overall segmentation accuracy with a 0.82 ± 0.09 Dice index. The FLAIR MR sequence is considered the best choice for tumor segmentation on a single MR sequence, while the joint segmentation on the entire four MR sequences would yield higher tumor delineation accuracy.

EDLNet: ensemble deep learning network model for automatic brain tumor classification and segmentation

The brain’s abnormal and uncontrollable cell partitioning is a severe cancer disease. The tissues around the brain or the skull induce this tumor to develop spontaneously. For the treatment of a brain tumor, surgical techniques are typically preferred. Deep learning models in the biomedical field have recently attracted a lot of attention for detecting and treating diseases. This article proposes a new Ensemble Deep Learning Network (EDLNet) model. This research uses the Modified Faster RCNN approach to classify brain MRI scan images into cancerous and non-cancerous. A deep recurrent convolutional neural network (DRCNN)-based diagnostic method for early-stage brain tumor segmentation is presented. The evaluation outcomes show that the proposed tumor classification and segmentation model’s performance accurately segments tissues from MRI images. For the analysis of the proposed model, two different publicly available datasets (D1&D2) are used. For D1 and D2 datasets, a total of 99.76% and 99.87% accuracies are achieved by the proposed model. The performance results of the proposed model are more effective than the state-of-the-art network models as per the experimental results. Communicated by Ramaswamy H. Sarma

A deep convolutional neural network for the automatic segmentation of glioblastoma brain tumor: Joint spatial pyramid module and attention mechanism network

This study proposes a deep convolutional neural network for the automatic segmentation of glioblastoma brain tumors, aiming sat replacing the manual segmentation method that is both time-consuming and labor-intensive. There are many challenges for automatic segmentation to finely segment sub-regions from multi-sequence magnetic resonance images because of the complexity and variability of glioblastomas, such as the loss of boundary information, misclassified regions, and subregion size. To overcome these challenges, this study introduces a spatial pyramid module and attention mechanism to the automatic segmentation algorithm, which focuses on multi-scale spatial details and context information. The proposed method has been tested in the public benchmarks BraTS 2018, BraTS 2019, BraTS 2020 and BraTS 2021 datasets. The Dice score on the enhanced tumor, whole tumor, and tumor core were respectively 79.90 %, 89.63 %, and 85.89 % on the BraTS 2018 dataset, respectively 77.14 %, 89.58 %, and 83.33 % on the BraTS 2019 dataset, and respectively 77.80 %, 90.04 %, and 83.18 % on the BraTS 2020 dataset, and respectively 83.48 %, 90.70 %, and 88.94 % on the BraTS 2021 dataset offering performance on par with that of state-of-the-art methods with only 1.90 M parameters. In addition, our approach significantly reduced the requirements for experimental equipment, and the average time taken to segment one case was only 1.48 s; these two benefits rendered the proposed network intensely competitive for clinical practice.

Using a generative adversarial network to generate synthetic MRI images for multi-class automatic segmentation of brain tumors.

Challenging tasks such as lesion segmentation, classification, and analysis for the assessment of disease progression can be automatically achieved using deep learning (DL)-based algorithms. DL techniques such as 3D convolutional neural networks are trained using heterogeneous volumetric imaging data such as MRI, CT, and PET, among others. However, DL-based methods are usually only applicable in the presence of the desired number of inputs. In the absence of one of the required inputs, the method cannot be used. By implementing a generative adversarial network (GAN), we aim to apply multi-label automatic segmentation of brain tumors to synthetic images when not all inputs are present. The implemented GAN is based on the Pix2Pix architecture and has been extended to a 3D framework named Pix2PixNIfTI. For this study, 1,251 patients of the BraTS2021 dataset comprising sequences such as T1w, T2w, T1CE, and FLAIR images equipped with respective multi-label segmentation were used. This dataset was used for training the Pix2PixNIfTI model for generating synthetic MRI images of all the image contrasts. The segmentation model, namely DeepMedic, was trained in a five-fold cross-validation manner for brain tumor segmentation and tested using the original inputs as the gold standard. The inference of trained segmentation models was later applied to synthetic images replacing missing input, in combination with other original images to identify the efficacy of generated images in achieving multi-class segmentation. For the multi-class segmentation using synthetic data or lesser inputs, the dice scores were observed to be significantly reduced but remained similar in range for the whole tumor when compared with evaluated original image segmentation (e.g. mean dice of synthetic T2w prediction NC, 0.74 ± 0.30; ED, 0.81 ± 0.15; CET, 0.84 ± 0.21; WT, 0.90 ± 0.08). A standard paired t-tests with multiple comparison correction were performed to assess the difference between all regions (p < 0.05). The study concludes that the use of Pix2PixNIfTI allows us to segment brain tumors when one input image is missing.

Multi-modal brain tumor segmentation via disentangled representation learning and region-aware contrastive learning

Brain tumors are threatening the life and health of people in the world. Automatic brain tumor segmentation using multiple MR images is challenging in medical image analysis. It is known that accurate segmentation relies on effective feature learning. Existing methods address the multi-modal MR brain tumor segmentation by explicitly learning a shared feature representation. However, these methods fail to capture the relationship between MR modalities and the feature correlation between different target tumor regions. In this paper, I propose a multi-modal brain tumor segmentation network via disentangled representation learning and region-aware contrastive learning. Specifically, a feature fusion module is first designed to learn the valuable multi-modal feature representation. Subsequently, a novel disentangled representation learning is proposed to decouple the fused feature representation into multiple factors corresponding to the target tumor regions. Furthermore, contrastive learning is presented to help the network extract tumor region-related feature representations. Finally, the segmentation results are obtained using the segmentation decoders. Quantitative and qualitative experiments conducted on the public datasets, BraTS 2018 and BraTS 2019, justify the importance of the proposed strategies, and the proposed approach can achieve better performance than other state-of-the-art approaches. In addition, the proposed strategies can be extended to other deep neural networks.

Automated Brain Tumor Segmentation and Classification in MRI Using YOLO-Based Deep Learning

Automated Brain Tumor Segmentation and Classification in MRI Using YOLO-Based Deep Learning

Meta-transfer Learning for Brain Tumor Segmentation: Within and Beyond Glioma.

In recent years, numerous algorithms have emerged for the segmentation of brain tumors, propelled by both the advancements of deep learning techniques and the influential open benchmark set by the BraTS challenge. This chapter provides an overview of the background that gave rise to automated brain tumor segmentation algorithms, reviews representative deep learning-based approaches, and reflects their limits on clinical applicability. While these algorithms showcase promising results in fully supervised settings, they may not perform well to other types of brain tumors without substantial samples for model re-training or fine-tuning. Recognizing this limitation, we explore a new learning framework designed to facilitate fast adaptation to new tumor types with only a few labeled data samples.

QMLS: quaternion mutual learning strategy for multi-modal brain tumor segmentation

Objective. Due to non-invasive imaging and the multimodality of magnetic resonance imaging (MRI) images, MRI-based multi-modal brain tumor segmentation (MBTS) studies have attracted more and more attention in recent years. With the great success of convolutional neural networks in various computer vision tasks, lots of MBTS models have been proposed to address the technical challenges of MBTS. However, the problem of limited data collection usually exists in MBTS tasks, making existing studies typically have difficulty in fully exploring the multi-modal MRI images to mine complementary information among different modalities. Approach. We propose a novel quaternion mutual learning strategy (QMLS), which consists of a voxel-wise lesion knowledge mutual learning mechanism (VLKML mechanism) and a quaternion multi-modal feature learning module (QMFL module). Specifically, the VLKML mechanism allows the networks to converge to a robust minimum so that aggressive data augmentation techniques can be applied to expand the limited data fully. In particular, the quaternion-valued QMFL module treats different modalities as components of quaternions to sufficiently learn complementary information among different modalities on the hypercomplex domain while significantly reducing the number of parameters by about 75%. Main results. Extensive experiments on the dataset BraTS 2020 and BraTS 2019 indicate that QMLS achieves superior results to current popular methods with less computational cost. Significance. We propose a novel algorithm for brain tumor segmentation task that achieves better performance with fewer parameters, which helps the clinical application of automatic brain tumor segmentation.

Evaluating synthetic neuroimaging data augmentation for automatic brain tumour segmentation with a deep fully-convolutional network

Gliomas observed in medical images require expert neuro-radiologist evaluation for treatment planning and monitoring, motivating development of intelligent systems capable of automating aspects of tumour evaluation. Deep learning models for automatic image segmentation rely on the amount and quality of training data. In this study we developed a neuroimaging synthesis technique to augment data for training fully-convolutional networks (U-nets) to perform automatic glioma segmentation. We used StyleGAN2-ada to simultaneously generate fluid-attenuated inversion recovery (FLAIR) magnetic resonance images and corresponding glioma segmentation masks. Synthetic data were successively added to real training data (n = 2751) in fourteen rounds of 1000 and used to train U-nets that were evaluated on held-out validation (n = 590) and test sets (n = 588). U-nets were trained with and without geometric augmentation (translation, zoom and shear), and Dice coefficients were computed to evaluate segmentation performance. We also monitored the number of training iterations before stopping, total training time, and time per iteration to evaluate computational costs associated with training each U-net. Synthetic data augmentation yielded marginal improvements in Dice coefficients (validation set +0.0409, test set +0.0355), whereas geometric augmentation improved generalization (standard deviation between training, validation and test set performances of 0.01 with, and 0.04 without geometric augmentation). Based on the modest performance gains for automatic glioma segmentation we find it hard to justify the computational expense of developing a synthetic image generation pipeline. Future work may seek to optimize the efficiency of synthetic data generation for augmentation of neuroimaging data.

MFD-Net: Modality Fusion Diffractive Network for Segmentation of Multimodal Brain Tumor Image.

Automatic brain tumor segmentation using multi-parametric magnetic resonance imaging (mpMRI) holds substantial importance for brain diagnosis, monitoring, and therapeutic strategy planning. Given the constraints inherent to manual segmentation, adopting deep learning networks for accomplishing accurate and automated segmentation emerges as an essential advancement. In this article, we propose a modality fusion diffractive network (MFD-Net) composed of diffractive blocks and modality feature extractors for the automatic and accurate segmentation of brain tumors. The diffractive block, designed based on Fraunhofer's single-slit diffraction principle, emphasizes neighboring high-confidence feature points and suppresses low-quality or isolated feature points, enhancing the interrelation of features. Adopting a global passive reception mode overcomes the issue of fixed receptive fields. Through a self-supervised approach, the modality feature extractor effectively utilizes the inherent generalization information of each modality, enabling the main segmentation branch to focus more on multimodal fusion feature information. We apply the diffractive block on nn-UNet in the MICCAI BraTS 2022 challenge, ranked first in the pediatric population data and third in the BraTS continuous evaluation data, proving the superior generalizability of our network. We also train separately on the BraTS 2018, 2019, and 2021 datasets. Experiments demonstrate that the proposed network outperforms state-of-the-art methods.