Dice Similarity Coefficient Values Research Articles

Deep Learning-Based Segmentation and Risk Stratification for Gastrointestinal Stromal Tumors in Transabdominal Ultrasound Imaging.

To develop a deep neural network system for the automatic segmentation and risk stratification prediction of gastrointestinal stromal tumors (GISTs). A total of 980 ultrasound (US) images from 245 GIST patients were retrospectively collected. These images were randomly divided (6:2:2) into a training set, a validation set, and an internal test set. Additionally, 188 US images from 47 prospective GIST patients were collected to evaluate the segmentation and diagnostic performance of the model. Five deep learning-based segmentation networks, namely, UNet, FCN, DeepLabV3+, Swin Transformer, and SegNeXt, were employed, along with the ResNet 18 classification network, to select the most suitable network combination. The performance of the segmentation models was evaluated using metrics such as the intersection over union (IoU), Dice similarity coefficient (DSC), recall, and precision. The classification performance was assessed based on accuracy and the area under the receiver operating characteristic curve (AUROC). Among the compared models, SegNeXt-ResNet18 exhibited the best segmentation and classification performance. On the internal test set, the proposed model achieved IoU, DSC, precision, and recall values of 82.1, 90.2, 91.7, and 88.8%, respectively. The accuracy and AUC for GIST risk prediction were 87.4 and 92.0%, respectively. On the external test set, the segmentation models exhibited IoU, DSC, precision, and recall values of 81.0, 89.5, 92.8, and 86.4%, respectively. The accuracy and AUC for GIST risk prediction were 86.7 and 92.5%, respectively. This two-stage SegNeXt-ResNet18 model achieves automatic segmentation and risk stratification prediction for GISTs and demonstrates excellent segmentation and classification performance.

Diffeomorphic transformer-based abdomen MRI-CT deformable image registration.

Stereotactic body radiotherapy (SBRT) is a well-established treatment modality for liver metastases in patients unsuitable for surgery. Both CT and MRI are useful during treatment planning for accurate target delineation and to reduce potential organs-at-risk (OAR) toxicity from radiation. MRI-CT deformable image registration (DIR) is required to propagate the contours defined on high-contrast MRI to CT images. An accurate DIR method could lead to more precisely defined treatment volumes and superior OAR sparing on the treatment plan. Therefore, it is beneficial to develop an accurate MRI-CT DIR for liver SBRT. To create a new deep learning model that can estimate the deformation vector field (DVF) for directly registering abdominal MRI-CT images. The proposed method assumed a diffeomorphic deformation. By using topology-preserved deformation features extracted from the probabilistic diffeomorphic registration model, abdominal motion can be accurately obtained and utilized for DVF estimation. The model integrated Swin transformers, which have demonstrated superior performance in motion tracking, into the convolutional neural network (CNN) for deformation feature extraction. The model was optimized using a cross-modality image similarity loss and a surface matching loss. To compute the image loss, a modality-independent neighborhood descriptor (MIND) was used between the deformed MRI and CT images. The surface matching loss was determined by measuring the distance between the warped coordinates of the surfaces of contoured structures on the MRI and CT images. To evaluate the performance of the model, a retrospective study was carried out on a group of 50 liver cases that underwent rigid registration of MRI and CT scans. The deformed MRI image was assessed against the CT image using the target registration error (TRE), Dice similarity coefficient (DSC), and mean surface distance (MSD) between the deformed contours of the MRI image and manual contours of the CT image. When compared to only rigid registration, DIR with the proposed method resulted in an increase of the mean DSC values of the liver and portal vein from 0.850±0.102 and 0.628±0.129 to 0.903±0.044 and 0.763±0.073, a decrease of the mean MSD of the liver from 7.216±4.513mm to 3.232±1.483mm, and a decrease of the TRE from 26.238±2.769mm to 8.492±1.058mm. The proposed DIR method based on a diffeomorphic transformer provides an effective and efficient way to generate an accurate DVF from an MRI-CT image pair of the abdomen. It could be utilized in the current treatment planning workflow for liver SBRT.

Assessing the radiofrequency shielding effect of titanium mesh on diffusion-weighted imaging: a comparative study of the twice-refocused spin-echo and Stejskal-Tanner sequences.

This study compared twice-refocused spin-echo sequence (TRSE) and Stejskal-Tanner sequence (ST) to evaluate their respective effects on the image quality of magnetic resonance (MR) diffusion-weighted imaging in the presence of radiofrequency (RF) shielding effect of titanium mesh in cranioplasty. A 1.5-T MR scanner with a Head/Neck coil 20 channels and a phantom simulating the T2 and apparent diffusion coefficient (ADC) value of the human brain were used. Imaging was performed with and without titanium mesh placed on the phantom in TRSE and ST, and normalized absolute average deviation (NAAD), Dice similarity coefficient (DSC), and ADC values were calculated. The NAAD values were significantly lower for TRSE than for ST in the area below the titanium mesh, and the drop rates due to titanium mesh were 14.1% for TRSE and 9.8% for ST. The DSC values were significantly lower for TRSE than for ST. The ADC values were significantly higher for TRSE than for ST without titanium mesh. The ADC values showed no significant difference between TRSE and ST with titanium mesh. The ST had a lower RF shielding effect of titanium mesh than the TRSE.

Brain Tumor Prediction and Segmentation with Morphological Region-based Active Contour Model and Refinement using Boltzmann Monte Carlo Method in MRI Images

Objectives: The primary goal of the research work is to accurately detect the precise location of the brain tumor in the radiological Magnetic Resonance Imaging (MRI) images of human brain using segmentation method. Methods: In this research work, we introduce mainly the Morphological Region-based Active Contour model and Boltzmann Monte Carlo method (MACB model), involving a comprehensive three-step methodology for the segmentation of the brain, MRI images in order to detect brain tumor. The initial step involves pre-processing which includes Gaussian filtering for noise reduction and Contrast Limited Adaptive Histogram Equalization (CLAHE) technique to enhance image features. In the second step, we identify tumor-related clusters using morphological operations and delineate the tumor regions using Active Contour (Snake) model to get a segmented image. In the final step, the Boltzmann Monte Carlo method is used to refine the edges of the segmented image. To evaluate the effectiveness of this approach, the 2D brain tumor datasets, available in the public domain, are used. The first dataset is taken from Kaggle website and has 3064 MRI human brain images and its respective ground truth images which is used for segmentation. The second dataset is used for visualization of segmented tumor, available in the same Kaggle website. Findings: The Performance metrics for finding similarity between the segmented images generated using the proposed MACB model and the ground truth images, available in the first dataset, exhibit higher values. That is, the proposed method has achieved higher values of Dice Similarity Coefficient (DSC): 93.26%, Jaccard Co-efficient: 86.44%, Sensitivity: 97.27%, Specificity: 99.43% and Pixel accuracy: 98.95%. Novelty: In this research work, MACB model is proposed for the detection, segmentation, and refinement process of brain tumor by incorporating Boltzmann Monte Carlo method with Morphological Region-Based Active Contour model. This novel approach has resulted in enhanced precision and efficiency in the brain tumor segmentation process. Keywords: Brain Tumor Segmentation, Morphological Operation, Active Contour, Boltzmann Monte Carlo Method, Magnetic Resonance Imaging

A Prostate Boundary Localization and Edge Denoising Algorithm

This research aimed at presenting a two-step method for prostate segmentation in TRUS images. The research used a prostate boundary localization and prostate edge denoising approach. The proposed method contribution is the use of the optimized Hodge’s method as the boundary operator and the use of the Bidirectional Exponential moving average to perform edge denoising. The results showed that the proposed method is effective in completing the prostate segmentation task. (1) The prostate region is effectively initialized and localized. (2) The recovery of noise points is accomplished and the segmentation result being consistent with the general shape of the prostate. The experimental results showed that this method can improve the overall segmentation accuracy. The process uses a combination of traditional and unsupervised methods, eliminating the need to rely on large data sets compared to current deep learning methods. The proposed method achieved excellent segmentation accuracy, with the Dice similarity coefficient (DICE) value of 0.9679, an average Intersection over Union (IoU) value of 0.9377, and an average False Positive Rate (FPR) of 0.0399. The results obtained from this study have significant implications for clinical practice. Accurate prostate segmentation is crucial for various applications, including radiation therapy planning, image-guided interventions, and computer-aided diagnosis. The proposed method has the potential to improve these applications by providing more precise and reliable prostate segmentations. However, it is important to acknowledge some limitations of this study. First, the proposed method was evaluated on a limited dataset, which may not fully represent the diversity of prostate images encountered in clinical practice. Further validation on larger datasets is necessary to assess its generalizability. Additionally, the proposed method relied on manual annotations for training, which can introduce inter-observer variability. Incorporating automated or semi-automated annotation techniques could enhance the robustness of the method

A Deep Learning Framework for Analysis of the Eustachian Tube and the Internal Carotid Artery.

Obtaining automated, objective 3-dimensional (3D) models of the Eustachian tube (ET) and the internal carotid artery (ICA) from computed tomography (CT) scans could provide useful navigational and diagnostic information for ET pathologies and interventions. We aim to develop a deep learning (DL) pipeline to automatically segment the ET and ICA and use these segmentations to compute distances between these structures. Retrospective cohort. Tertiary referral center. From a database of 30 CT scans, 60 ET and ICA pairs were manually segmented and used to train an nnU-Net model, a DL segmentation framework. These segmentations were also used to develop a quantitative tool to capture the magnitude and location of the minimum distance point (MDP) between ET and ICA. Performance metrics for the nnU-Net automated segmentations were calculated via the average Hausdorff distance (AHD) and dice similarity coefficient (DSC). The AHD for the ET and ICA were 0.922 and 0.246 mm, respectively. Similarly, the DSC values for the ET and ICA were 0.578 and 0.884. The mean MDP from ET to ICA in the cartilaginous region was 2.6 mm (0.7-5.3 mm) and was located on average 1.9 mm caudal from the bony cartilaginous junction. This study describes the first end-to-end DL pipeline for automated ET and ICA segmentation and analyzes distances between these structures. In addition to helping to ensure the safe selection of patients for ET dilation, this method can facilitate large-scale studies exploring the relationship between ET pathologies and the 3D shape of the ET.

A deep learning-based 3D Prompt-nnUnet model for automatic segmentation in brachytherapy of postoperative endometrial carcinoma.

To create and evaluate a three-dimensional (3D) Prompt-nnUnet module that utilizes the prompts-based model combined with 3D nnUnet for producing the rapid and consistent autosegmentation of high-risk clinical target volume (HR CTV) and organ at risk (OAR) in high-dose-rate brachytherapy (HDR BT) for patients with postoperative endometrial carcinoma (EC). On two experimental batches, a total of 321 computed tomography (CT) scans were obtained for HR CTV segmentation from 321 patients with EC, and 125 CT scans for OARs segmentation from 125 patients. The numbers of training/validation/test were 257/32/32 and 87/13/25 for HR CTV and OARs respectively. A novel comparison of the deep learning neural network 3D Prompt-nnUnet and 3D nnUnet was applied for HR CTV and OARs segmentation. Three-fold cross validation and several quantitative metrics were employed, including Dice similarity coefficient (DSC), Hausdorff distance (HD), 95th percentile of Hausdorff distance (HD95%), and intersection over union (IoU). The Prompt-nnUnet included two forms of parameters Predict-Prompt (PP) and Label-Prompt (LP), with the LP performing most similarly to the experienced radiation oncologist and outperforming the less experienced ones. During the testing phase, the mean DSC values for the LP were 0.96±0.02, 0.91±0.02, and 0.83±0.07 for HR CTV, rectum and urethra, respectively. The mean HD values (mm) were 2.73±0.95, 8.18±4.84, and 2.11±0.50, respectively. The mean HD95% values (mm) were 1.66±1.11, 3.07±0.94, and 1.35±0.55, respectively. The mean IoUs were 0.92±0.04, 0.84±0.03, and 0.71±0.09, respectively. A delineation time<2.35s per structure in the new model was observed, which was available to save clinician time. The Prompt-nnUnet architecture, particularly the LP, was highly consistent with ground truth (GT) in HR CTV or OAR autosegmentation, reducing interobserver variability and shortening treatment time.

Comparison of commercial atlas-based automatic segmentation software for prostate radiotherapy treatment planning.

This study aims to assess the accuracy of automatic atlas-based contours for various key anatomical structures in prostate radiotherapy treatment planning. The evaluated structures include the bladder, rectum, prostate, seminal vesicles, femoral heads and penile bulb. CT images from 20 patients who underwent intensity-modulated radiotherapy were randomly chosen to create an atlas library. Atlas contours of the seven anatomical structures were generated using four software packages: ABAS, Eclipse, MIM, and RayStation. These contours were then compared to manual delineations performed by oncologists, which served as the ground truth. Evaluation metrics such as dice similarity coefficient (DSC), mean distance to agreement (MDA), and volume ratio (VR) were calculated to assess the accuracy of the contours. Additionally, the time taken by each software to generate the atlas contour was recorded. The mean DSC values for the bladder exhibited strong agreement (>0.8) with manual delineations for all software except for Eclipse and RayStation. Similarly, the femoral heads showed significant similarity between the atlas contours and ground truth across all software, with mean DSC values exceeding 0.9 and MDA values close to zero. On the other hand, the penile bulb displayed only moderate agreement with the ground truth, with mean DSC values ranging from 0.5 to 0.7 for all software. A similar trend was observed in the prostate atlas contours, except for MIM, which achieved a mean DSC of over 0.8. For the rectum, both ABAS and MIM atlases demonstrated strong agreement with the ground truth, resulting in mean DSC values of more than 0.8. Overall, MIM and ABAS outperformed Eclipse and RayStation in both DSC and MDA. These results indicate that the atlas-based segmentation employed in this study produces acceptable contours for the anatomical structures of interest in prostate radiotherapy treatment planning.

Clinical evaluation of the efficacy of limbus artificial intelligence software to augment contouring for prostate and nodes radiotherapy.

To determine if Limbus, an artificial intelligence (AI) auto-contouring software, can offer meaningful time savings for prostate radiotherapy treatment planning. Three clinical oncologists recorded the time taken to contour prostate and seminal vesicles, lymph nodes, bladder, rectum, bowel, and femoral heads on CT scans for 30 prostate patients (15 prostate, 15 prostate and nodes). Limbus 1.6.0 was used to generate these contours on the 30 CT scans. The time taken by the oncologists to modify individual Limbus contours was noted and compared with manual contouring times. The geometric similarity of Limbus and expert contours was assessed using the Dice Similarity Coefficient (DSC), and the dosimetric impact of using un-edited Limbus organs at risk contours was studied. Limbus reduced the time to produce clinically acceptable contours by 26 minutes for prostate and nodes patients and by 13 minutes for the prostate only patients. DSC values of greater than 0.7 were calculated for all contours, demonstrating good initial agreement. A dosimetric study showed that 5 of the 20 plans optimized using unmodified AI structures required unnecessary compromise of PTV coverage, highlighting the importance of expert review. Limbus offers significant time saving and has become an essential part of our clinical practice. This article is the first to include bowel and lymph nodes when assessing potential time savings using Limbus software. It demonstrates that Limbus can be used as an aid for prostate and node radiotherapy treatment planning.

Tumor conspicuity enhancement-based segmentation model for liver tumor segmentation and RECIST diameter measurement in non-contrast CT images

Background and objectiveLiver tumor segmentation (LiTS) accuracy on contrast-enhanced computed tomography (CECT) images is higher than that on non-contrast computed tomography (NCCT) images. However, CECT requires contrast medium and repeated scans to obtain multiphase enhanced CT images, which is time-consuming and cost-increasing. Therefore, despite the lower accuracy of LiTS on NCCT images, which still plays an irreplaceable role in some clinical settings, such as guided brachytherapy, ablation, or evaluation of patients with renal function damage. In this study, we intend to generate enhanced high-contrast pseudo-color CT (PCCT) images to improve the accuracy of LiTS and RECIST diameter measurement on NCCT images. MethodsTo generate high-contrast CT liver tumor region images, an intensity-based tumor conspicuity enhancement (ITCE) model was first developed. In the ITCE model, a pseudo color conversion function from an intensity distribution of the tumor was established, and it was applied in NCCT to generate enhanced PCCT images. Additionally, we design a tumor conspicuity enhancement-based liver tumor segmentation (TCELiTS) model, which was applied to improve the segmentation of liver tumors on NCCT images. The TCELiTS model consists of three components: an image enhancement module based on the ITCE model, a segmentation module based on a deep convolutional neural network, and an attention loss module based on restricted activation. Segmentation performance was analyzed using the Dice similarity coefficient (DSC), sensitivity, specificity, and RECIST diameter error. ResultsTo develop the deep learning model, 100 patients with histopathologically confirmed liver tumors (hepatocellular carcinoma, 64 patients; hepatic hemangioma, 36 patients) were randomly divided into a training set (75 patients) and an independent test set (25 patients). Compared with existing tumor automatic segmentation networks trained on CECT images (U-Net, nnU-Net, DeepLab-V3, Modified U-Net), the DSCs achieved on the enhanced PCCT images are both improved compared with those on NCCT images. We observe improvements of 0.696–0.713, 0.715 to 0.776, 0.748 to 0.788, and 0.733 to 0.799 in U-Net, nnU-Net, DeepLab-V3, and Modified U-Net, respectively, in terms of DSC values. In addition, an observer study including 5 doctors was conducted to compare the segmentation performance of enhanced PCCT images with that of NCCT images and showed that enhanced PCCT images are more advantageous for doctors to segment tumor regions. The results showed an accuracy improvement of approximately 3%–6%, but the time required to segment a single CT image was reduced by approximately 50 %. ConclusionsExperimental results show that the ITCE model can generate high-contrast enhanced PCCT images, especially in liver regions, and the TCELiTS model can improve LiTS accuracy in NCCT images.

Automatic gross tumor volume segmentation with failure detection for safe implementation in locally advanced cervical cancer

Background and PurposeAutomatic segmentation methods have greatly changed the RadioTherapy (RT) workflow, but still need to be extended to target volumes. In this paper, Deep Learning (DL) models were compared for Gross Tumor Volume (GTV) segmentation in locally advanced cervical cancer, and a novel investigation into failure detection was introduced by utilizing radiomic features. Methods and materialsWe trained eight DL models (UNet, VNet, SegResNet, SegResNetVAE) for 2D and 3D segmentation. Ensembling individually trained models during cross-validation generated the final segmentation. To detect failures, binary classifiers were trained using radiomic features extracted from segmented GTVs as inputs, aiming to classify contours based on whether their Dice Similarity Coefficient (DSC)<T and DSC⩾T. Two distinct cohorts of T2-Weighted (T2W) pre-RT MR images captured in 2D sequences were used: one retrospective cohort consisting of 115 LACC patients from 30 scanners, and the other prospective cohort, comprising 51 patients from 7 scanners, used for testing. ResultsSegmentation by 2D-SegResNet achieved the best DSC, Surface DSC (SDSC3mm), and 95th Hausdorff Distance (95HD): DSC = 0.72 ± 0.16, SDSC3mm=0.66 ± 0.17, and 95HD = 14.6 ± 9.0 mm without missing segmentation (M=0) on the test cohort. Failure detection could generate precision (P=0.88), recall (R=0.75), F1-score (F=0.81), and accuracy (A=0.86) using Logistic Regression (LR) classifier on the test cohort with a threshold T = 0.67 on DSC values. ConclusionsOur study revealed that segmentation accuracy varies slightly among different DL methods, with 2D networks outperforming 3D networks in 2D MRI sequences. Doctors found the time-saving aspect advantageous. The proposed failure detection could guide doctors in sensitive cases.

A deep inverse convolutional neural network-based semantic classification method for land cover remote sensing images

The imbalance of land cover categories is a common problem. Some categories appear less frequently in the image, while others may occupy the vast majority of the proportion. This imbalance can lead the classifier to tend to predict categories with higher frequency of occurrence, while the recognition effect on minority categories is poor. In view of the difficulty of land cover remote sensing image multi-target semantic classification, a semantic classification method of land cover remote sensing image based on depth deconvolution neural network is proposed. In this method, the land cover remote sensing image semantic segmentation algorithm based on depth deconvolution neural network is used to segment the land cover remote sensing image with multi-target semantic segmentation; Four semantic features of color, texture, shape and size in land cover remote sensing image are extracted by using the semantic feature extraction method of remote sensing image based on improved sequential clustering algorithm; The classification and recognition method of remote sensing image semantic features based on random forest algorithm is adopted to classify and identify four semantic feature types of land cover remote sensing image, and realize the semantic classification of land cover remote sensing image. The experimental results show that after this method classifies the multi-target semantic types of land cover remote sensing images, the average values of Dice similarity coefficient and Hausdorff distance are 0.9877 and 0.9911 respectively, which can accurately classify the multi-target semantic types of land cover remote sensing images.

A deep learning model for translating CT to ventilation imaging: analysis of accuracy and impact on functional avoidance radiotherapy planning.

Radiotherapy planning incorporating functional lung images has the potential to reduce pulmonary toxicity. Free-breathing 4DCT-derived ventilation image (CTVI) may help quantify lung function. This study introduces a novel deep-learning model directly translating planning CT images into CTVI. We investigated the accuracy of generated images and the impact on functional avoidance planning. Paired planning CT and 4DCT scans from 48 patients with NSCLC were randomized to training (n = 41) and testing (n = 7) data sets. The ventilation maps were generated from 4DCT using a Jacobian-based algorithm to provide ground truth labels (CTVI4DCT). A 3D U-Net-based model was trained to map CT to synthetic CTVI (CTVISyn) and validated using fivefold cross-validation. The highest-performing model was applied to the testing set. Spearman's correlation (rs) and Dice similarity coefficient (DSC) determined voxel-wise and functional-wise concordance between CTVI4DCT and CTVISyn. Three plans were designed per patient in the testing set: one clinical plan without CTVI and two functional avoidance plans combined with CTVI4DCT or CTVISyn, aimed at sparing high-functional lungs defined as the top 50% of the percentile ventilation ranges. Dose-volume (DVH) parameters regarding the planning target volume (PTV) and organs at risk (OARs) were recorded. Radiation pneumonitis (RP) risk was estimated using a dose-function (DFH)-based normal tissue complication probability (NTCP) model. CTVISyn showed a mean rs value of 0.65 ± 0.04 compared to CTVI4DCT. Mean DSC values over the top 50% and 60% of ventilation ranges were 0.41 ± 0.07 and 0.52 ± 0.10, respectively. In the test set (n = 7), all patients' RP-risk benefited from CTVI4DCT-guided plans (Riskmean_4DCT_vs_Clinical: 29.24% vs. 49.12%, P = 0.016), and six patients benefited from CTVISyn-guided plans (Riskmean_Syn_vs_Clinical: 31.13% vs. 49.12%, P = 0.022). There were no significant differences in DVH and DFH metrics between CTVISyn and CTVI4DCT-guided plan (P > 0.05). Using deep-learning techniques, CTVISyn generated from planning CT exhibited a moderate-to-high correlation with CTVI4DCT. The CTVISyn-guided plans were comparable to the CTVI4DCT-guided plans, effectively reducing pulmonary toxicity in patients while maintaining acceptable plan quality. Further prospective trials are needed to validate these findings.

Deep learning-based 3D cerebrovascular segmentation workflow on bright and black blood sequences magnetic resonance angiography

BackgroundCerebrovascular diseases have emerged as significant threats to human life and health. Effectively segmenting brain blood vessels has become a crucial scientific challenge. We aimed to develop a fully automated deep learning workflow that achieves accurate 3D segmentation of cerebral blood vessels by incorporating classic convolutional neural networks (CNNs) and transformer models.MethodsWe used a public cerebrovascular segmentation dataset (CSD) containing 45 volumes of 1.5 T time-of-flight magnetic resonance angiography images. We collected data from another private middle cerebral artery (MCA) with lenticulostriate artery (LSA) segmentation dataset (MLD), which encompassed 3.0 T three-dimensional T1-weighted sequences of volumetric isotropic turbo spin echo acquisition MRI images of 107 patients aged 62 ± 11 years (42 females). The workflow includes data analysis, preprocessing, augmentation, model training with validation, and postprocessing techniques. Brain vessels were segmented using the U-Net, V-Net, UNETR, and SwinUNETR models. The model performances were evaluated using the dice similarity coefficient (DSC), average surface distance (ASD), precision (PRE), sensitivity (SEN), and specificity (SPE).ResultsDuring 4-fold cross-validation, SwinUNETR obtained the highest DSC in each fold. On the CSD test set, SwinUNETR achieved the best DSC (0.853), PRE (0.848), SEN (0.860), and SPE (0.9996), while V-Net achieved the best ASD (0.99). On the MLD test set, SwinUNETR demonstrated good MCA segmentation performance and had the best DSC, ASD, PRE, and SPE for segmenting the LSA.ConclusionsThe workflow demonstrated excellent performance on different sequences of MRI images for vessels of varying sizes. This method allows doctors to visualize cerebrovascular structures.Critical relevance statementA deep learning-based 3D cerebrovascular segmentation workflow is feasible and promising for visualizing cerebrovascular structures and monitoring cerebral small vessels, such as lenticulostriate arteries.Key points• The proposed deep learning-based workflow performs well in cerebrovascular segmentation tasks.• Among comparison models, SwinUNETR achieved the best DSC, ASD, PRE, and SPE values in lenticulostriate artery segmentation.• The proposed workflow can be used for different MR sequences, such as bright and black blood imaging.Graphical

Quantitative measurement of the ureter on three-dimensional magnetic resonance urography images using deep learning.

Accurate measurement of ureteral diameters plays a pivotal role in diagnosing and monitoring urinary tract obstruction (UTO). While three-dimensional magnetic resonance urography (3D MRU) represents a significant advancement in imaging, the traditional manual methods for assessing ureteral diameters are characterized by labor-intensive procedures and inherent variability. In the realm of medical image analysis, deep learning has led to a paradigm shift, yet the development of a comprehensive automated tool for the precise segmentation and measurement of ureters in MR images is an unaddressed challenge. The ureter was quantitatively measured on 3D MRU images using a deep learning model. A retrospective cohort of 445 3D MRU scans (443 patients, 52±18 years; 217 female patients) was collected and split into training, validation, and internal testing cohorts. A 3D V-Net model was trained for urinary tract segmentation, and a post-processing algorithm was developed for ureteral measurements. The accuracy of the segmentation was evaluated using the Dice similarity coefficient (DSC) and volume intraclass correlation coefficient (ICC), with ground truth segmentations provided by experienced radiologists. The external cohort comprised 50 scans (50 patients, 55±21 years; 30 female patients), and the model-predicted ureteral diameter measurements were compared with manual measurements to assess system performance. The various diameter parameters of ureter among the different measurement methods (ground truth, auto-segmentation with automatic diameter extraction, and manual segmentation with automatic diameter extraction) were assessed with Friedman tests and post hoc Dunn test. The effectiveness of the UTO diagnosis was assessed by receiver operating characteristic (ROC) curves and their respective areas under the curve (AUC) between different methods. In both the internal test and external cohorts, the mean DSC values for bilateral ureters exceeded 0.70. The ICCs for the bilateral ureter volume obtained by comparing the model and manual segmentation were all greater than 0.96 (p < 0.05), except for the right ureter in the internal test cohort, for which the ICC was 0.773 (p < 0.05). The mean DSCs for interobserver and intraobserver reliability were all above 0.97. The maximum diameter of the ureter exhibited no statistically significant differences either in the dilated (p=0.08) or in the non-dilated (p=0.32) ureters across the three measurement methods. The AUCs of ground truth, auto-segmentation with automatic diameter extraction, and manual segmentation with automatic diameter extraction in diagnosing UTO were 0.988 (95% CI: 0.934, 1.000), 0.961 (95% CI: 0.893, 0.991), and 0.979 (95% CI: 0.919, 0.998), respectively. There was no statistical difference between AUCs of the different methods (p>0.05). The proposed deep learning model and post-processing algorithm provide an effective means for the quantitative evaluation of urinary diseases using 3D MRU images.

Fully Automated Identification of Lymph Node Metastases and Lymphovascular Invasion in Endometrial Cancer From Multi-Parametric MRI by Deep Learning.

Early and accurate identification of lymphatic node metastasis (LNM) and lymphatic vascular space invasion (LVSI) for endometrial cancer (EC) patients is important for treatment design, but difficult on multi-parametric MRI (mpMRI) images. To develop a deep learning (DL) model to simultaneously identify of LNM and LVSI of EC from mpMRI images. Retrospective. Six hundred twenty-one patients with histologically proven EC from two institutions, including 111 LNM-positive and 168 LVSI-positive, divided into training, internal, and external test cohorts of 398, 169, and 54 patients, respectively. T2-weighted imaging (T2WI), contrast-enhanced T1WI (CE-T1WI), and diffusion-weighted imaging (DWI) were scanned with turbo spin-echo, gradient-echo, and two-dimensional echo-planar sequences, using either a 1.5 T or 3 T system. EC lesions were manually delineated on T2WI by two radiologists and used to train an nnU-Net model for automatic segmentation. A multi-task DL model was developed to simultaneously identify LNM and LVSI positive status using the segmented EC lesion regions and T2WI, CE-T1WI, and DWI images as inputs. The performance of the model for LNM-positive diagnosis was compared with those of three radiologists in the external test cohort. Dice similarity coefficient (DSC) was used to evaluate segmentation results. Receiver Operating Characteristic (ROC) analysis was used to assess the performance of LNM and LVSI status identification. P value <0.05 was considered significant. EC lesion segmentation model achieved mean DSC values of 0.700 ± 0.25 and 0.693 ± 0.21 in the internal and external test cohorts, respectively. For LNM positive/LVSI positive identification, the proposed model achieved AUC values of 0.895/0.848, 0.806/0.795, and 0.804/0.728 in the training, internal, and external test cohorts, respectively, and better than those of three radiologists (AUC = 0.770/0.648/0.674). The proposed model has potential to help clinicians to identify LNM and LVSI status of EC patients and improve treatment planning. 3 TECHNICAL EFFICACY: Stage 2.

Assessment of lymph node area coverage with total marrow irradiation and implementation of total marrow and lymphoid irradiation using automated deep learning-based segmentation.

Total marrow irradiation (TMI) and total marrow and lymphoid irradiation (TMLI) have the advantages. However, delineating target lesions according to TMI and TMLI plans is labor-intensive and time-consuming. In addition, although the delineation of target lesions between TMI and TMLI differs, the clinical distinction is not clear, and the lymph node (LN) area coverage during TMI remains uncertain. Accordingly, this study calculates the LN area coverage according to the TMI plan. Further, a deep learning-based model for delineating LN areas is trained and evaluated. Whole-body regional LN areas were manually contoured in patients treated according to a TMI plan. The dose coverage of the delineated LN areas in the TMI plan was estimated. To train the deep learning model for automatic segmentation, additional whole-body computed tomography data were obtained from other patients. The patients and data were divided into training/validation and test groups and models were developed using the "nnU-NET" framework. The trained models were evaluated using Dice similarity coefficient (DSC), precision, recall, and Hausdorff distance 95 (HD95). The time required to contour and trim predicted results manually using the deep learning model was measured and compared. The dose coverage for LN areas by TMI plan had V100% (the percentage of volume receiving 100% of the prescribed dose), V95%, and V90% median values of 46.0%, 62.1%, and 73.5%, respectively. The lowest V100% values were identified in the inguinal (14.7%), external iliac (21.8%), and para-aortic (42.8%) LNs. The median values of DSC, precision, recall, and HD95 of the trained model were 0.79, 0.83, 0.76, and 2.63, respectively. The time for manual contouring and simply modified predicted contouring were statistically significantly different. The dose coverage in the inguinal, external iliac, and para-aortic LN areas was suboptimal when treatment is administered according to the TMI plan. This research demonstrates that the automatic delineation of LN areas using deep learning can facilitate the implementation of TMLI.

A publicly available deep learning model and dataset for segmentation of breast, fibroglandular tissue, and vessels in breast MRI

Breast density, or the amount of fibroglandular tissue (FGT) relative to the overall breast volume, increases the risk of developing breast cancer. Although previous studies have utilized deep learning to assess breast density, the limited public availability of data and quantitative tools hinders the development of better assessment tools. Our objective was to (1) create and share a large dataset of pixel-wise annotations according to well-defined criteria, and (2) develop, evaluate, and share an automated segmentation method for breast, FGT, and blood vessels using convolutional neural networks. We used the Duke Breast Cancer MRI dataset to randomly select 100 MRI studies and manually annotated the breast, FGT, and blood vessels for each study. Model performance was evaluated using the Dice similarity coefficient (DSC). The model achieved DSC values of 0.92 for breast, 0.86 for FGT, and 0.65 for blood vessels on the test set. The correlation between our model’s predicted breast density and the manually generated masks was 0.95. The correlation between the predicted breast density and qualitative radiologist assessment was 0.75. Our automated models can accurately segment breast, FGT, and blood vessels using pre-contrast breast MRI data. The data and the models were made publicly available.

Deep Learning For Automatic Gross Tumor Volumes Contouring in Esophageal Cancer Based on Contrast-Enhanced Computed Tomography Images: A Multi-Institutional Study

PurposeTo develop and externally validate an automatic Artificial Intelligence (AI) tool for delineating gross tumor volume (GTV) in esophageal squamous cell carcinoma (ESCC) patients, which can assist in the neo-adjuvant or radical radiation therapy treatment planning. Methods and MaterialsIn this multi-institutional study, contrast-enhanced CT images from 580 eligible ESCC patients were retrospectively collected. The GTV contours delineated by two experts via consensus were used as ground truth. A three-dimensional deep learning model was developed for GTV contouring in the training cohort and internally and externally validated in three validation cohorts. The AI tool was compared against twelve board-certified experts in 25 patients randomly selected from the external validation cohort to evaluate its assistance in improving contouring performance and reducing variation. Contouring performance was measured using dice similarity coefficient (DSC) and average surface distance (ASD). Additionally, our previously established radiomics model for predicting pathological complete response (pCR) was utilized to compare AI-generated and ground truth contours, in order to assess the potential of the AI contouring tool in radiomics analysis. ResultsThe AI tool demonstrated good GTV contouring performance in multi-center validation cohorts, with median DSC values of 0.865, 0.876, and 0.866, and median ASD values of 0.939 mm, 0.789 mm, and 0.875 mm, respectively. Furthermore, the AI tool significantly improved contouring performance for half of twelve board-certified experts (DSC values, 0.794-0.835 vs 0.856-0.881, P = 0.003-0.048), reduced the intra- and inter-observer variations by 37.4% and 55.2%, respectively, and saved contouring time by 77.6%. In the radiomics analysis, 88.7% of radiomic features from ground truth and AI-generated contours demonstrated stable reproducibility, and similar pCR prediction performance for these contours (P = 0.430) were observed. ConclusionsOur AI contouring tool can improve GTV contouring performance and facilitate radiomics analysis in ESCC patients, which indicated its potential on GTV contouring during radiation therapy treatment planning and radiomics studies.

Monitoring acoustic cavitation effects in tissues under the action of HIFU based on ultrasound images

The cavitation effect plays a key role in the field of High-intensity focused ultrasound treatment. By monitoring cavitation to adjust the irradiation dose, effective control of cavitation effects can be achieved, which is crucial for ensuring the safety and efficacy of HIFU therapy. In this paper, a method for monitoring cavitation effects in tissues based on ultrasound images is proposed. First, support vector machine is used to rapidly and accurately determine whether cavitation has occurred. Then, the improved watershed algorithm is employed to extract the regions where cavitation occurs, and the extracted cavitation region images are reconstructed using the total focusing method based on sparse array elements. Finally, to validate the feasibility and stability of the proposed method and investigate the development patterns of cavitation effects. An experimental system was established to conduct cavitation effect monitoring experiments on fresh bovine liver and a simulated human tissue model. The experimental results showed that, except for the recall rate in the fresh bovine liver test set, all classification metrics are greater than 0.9, demonstrating the practicality of the model established in this paper. The improved watershed algorithm achieved average values of Dice Similarity Coefficient, accuracy and precision at 93.69%, 96.74% and 92.23% respectively, representing a significant improvement compared to the traditional watershed method. The proposed total focusing method based on sparse array elements can effectively improve imaging efficiency while ensuring reconstruction accuracy.