Manual Segmentation Research Articles

Deep learning technology in vascular image segmentation and disease diagnosis

AbstractBlood vessel segmentation is a crucial aspect of medical image processing, aiding medical professionals in more accurate disease analysis and diagnosis. Manual blood vessel segmentation methods are time‐consuming and cumbersome, making the development of automatic segmentation methods essential. The rapid advancements in deep learning technology have introduced new tools and methods for vascular image segmentation. In this review, we provide a comprehensive overview of deep learning‐based blood vessel segmentation methods across various fields, including retinal vessel segmentation, cerebrovascular segmentation, and pulmonary vessel segmentation. Several prevalent diseases, such as retinal vascular diseases, cerebrovascular diseases, pulmonary vascular diseases, and tumors, have posed significant health challenges globally. This review also discusses the application of deep learning technology in disease diagnosis within these contexts. Finally, considering the current research landscape, we discuss existing challenges and potential future developments in blood vessel segmentation. We aim to assist researchers in gaining a comprehensive understanding and designing effective blood vessel segmentation models, ultimately offering opportunities for early disease diagnosis and treatment.

OAR-UNet: Enhancing Long-Distance Dependencies for Head and Neck OAR Segmentation

Accurate segmentation of organs at risk (OARs) is a crucial step in the precise planning of radiotherapy for head and neck tumors. However, manual segmentation methods using CT images, which are still predominantly applied in clinical settings, are inefficient and expensive. Additionally, existing segmentation methods struggle with small organs and have difficulty managing the complex interdependencies between organs. To address these issues, this study proposed an OAR-UNet segmentation method based on a U-shaped architecture with two key designs. To tackle the challenge of segmenting small organs, a Local Feature Perception Module (LFPM) is developed to enhance the sensitivity of the method to subtle structures. Furthermore, a Cross-shaped Transformer Block (CSTB) with a cross-shaped attention mechanism is introduced to improve the ability of the model to capture and process long-distance dependency information. To accelerate the convergence of the Transformer, we designed a Local Encoding Module (LEM) based on depthwise separable convolutions. In our experimental evaluation, we utilized two publicly available datasets, SegRap2023 and PDDCA, achieving Dice coefficients of 78.22% and 89.42%, respectively. These results demonstrate that our method outperforms both previous classic methods and state-of-the-art (SOTA) methods.

Automated abdominal organ segmentation algorithms for non-enhanced CT for volumetry and 3D radiomics analysis

Abstract Purpose To develop fully-automated abdominal organ segmentation algorithms from non-enhanced abdominal CT and low-dose chest CT and assess their feasibility for automated CT volumetry and 3D radiomics analysis of abdominal solid organs. Methods Fully-automated nnU-Net-based models were developed to segment the liver, spleen, and both kidneys in non-enhanced abdominal CT, and the liver and spleen in low-dose chest CT. 105 abdominal CTs and 60 low-dose chest CTs were used for model development, and 55 abdominal CTs and 10 low-dose chest CTs for external testing. The segmentation performance for each organ was assessed using the Dice similarity coefficients, with manual segmentation results serving as the ground truth. Agreements between ground-truth measurements and model estimates of organ volume and 3D radiomics features were assessed using the Bland–Altman analysis and intraclass correlation coefficients (ICC). Results The models accurately segmented the liver, spleen, right kidney, and left kidney in abdominal CT and the liver and spleen in low-dose chest CT, showing mean Dice similarity coefficients in the external dataset of 0.968, 0.960, 0.952, and 0.958, respectively, in abdominal CT, and 0.969 and 0.960, respectively, in low-dose chest CT. The model-estimated and ground truth volumes of these organs exhibited mean differences between − 0.7% and 2.2%, with excellent agreements. The automatically extracted mean and median Hounsfield units (ICCs, 0.970–0.999 and 0.994–0.999, respectively), uniformity (ICCs, 0.985–0.998), entropy (ICCs, 0.931–0.993), elongation (ICCs, 0.978–0.992), and flatness (ICCs, 0.973–0.997) showed excellent agreement with ground truth measurements for each organ; however, skewness (ICCs, 0.210–0.831), kurtosis (ICCs, 0.053–0.933), and sphericity (ICCs, 0.368–0.819) displayed relatively low and inconsistent agreement. Conclusion Our nnU-Net-based models accurately segmented abdominal solid organs in non-enhanced abdominal and low-dose chest CT, enabling reliable automated measurements of organ volume and specific 3D radiomics features.

OSBA: An Open Neonatal Neuroimaging Atlas and Template for Spina Bifida Aperta

We present the Open Spina Bifida Aperta (OSBA) atlas, an open atlas and set of neuroimaging templates for spina bifida aperta (SBA). Traditional brain atlases may not adequately capture anatomical variations present in pediatric or disease-specific cohorts. The OSBA atlas fills this gap by representing the computationally averaged anatomy of the neonatal brain with SBA after fetal surgical repair. The OSBA atlas was constructed using structural T2-weighted and diffusion tensor MRIs of 28 newborns with SBA who underwent prenatal surgical correction. The corrected gestational age at MRI was 38.1 ± 1.1 weeks (mean ± SD). The OSBA atlas consists of T2-weighted and fractional anisotropy templates, along with nine tissue prior maps and region of interest (ROI) delineations. The OSBA atlas offers a standardized reference space for spatial normalization and anatomical ROI definition. Our image segmentation and cortical ribbon definition are based on a human-in-the-loop approach, which includes manual segmentation. The precise alignment of the ROIs was achieved by a combination of manual image alignment and automated, non-linear image registration. From the clinical and neuroimaging perspective, the OSBA atlas enables more accurate spatial standardization and ROI-based analyses and supports advanced analyses such as diffusion tractography and connectomic studies in newborns affected by this condition.

External validation of a deep learning model for automatic segmentation of skeletal muscle and adipose tissue on abdominal computed tomography images.

Body composition assessment using computed tomography (CT) images at the L3-level is increasingly applied in cancer research. Robust high-throughput automated segmentation is key to assess large patient cohorts and to support implementation of body composition analysis into routine clinical practice. We trained and externally validated a deep learning neural network (DLNN) to automatically segment L3-CT images. Expert-drawn segmentations of visceral and subcutaneous adipose tissue (VAT/SAT) and skeletal muscle (SM) of L3-CT-images of 3,187 patients undergoing abdominal surgery were used to train a DLNN. The external validation cohort was comprised of 2,535 patients with abdominal cancer. DLNN performance was evaluated with (geometric) Dice Similarity (DS) and Lin's Concordance Correlation Coefficient. There was a strong concordance between automatic and manual segmentations with median DS for SM, VAT, and SAT of 0.97 (interquartile range, IQR: 0.95-0.98), 0.98 (IQR: 0.95-0.98), and 0.95 (IQR: 0.92-0.97), respectively. Concordance correlations were excellent: SM 0.964 (0.959-0.968), VAT 0.998 (0.998-0.998), and SAT 0.992 (0.991-0.993). Bland-Altman metrics indicated only small and clinically insignificant systematic offsets; SM radiodensity: 0.23 hounsfield units (0.5%), SM: 1.26 cm2.m-2 (2.8%), VAT: -1.02 cm2.m-2 (1.7%), and SAT: 3.24 cm2.m-2 (4.6%). A robustly-performing and independently externally validated DLNN for automated body composition analysis was developed. CT-based body composition analysis is highly prognostic for long-term overall survival in oncology. This DLNN was succesfully trained and externally validated on several large patient cohorts and will therefore enable large scale population studies and implementation of body composition analysis into clinical practice.

Incorporating patient-specific information for the development of rectal tumor auto-segmentation models for online adaptive magnetic resonance Image-guided radiotherapy

Background and purposeIn online adaptive magnetic resonance image (MRI)-guided radiotherapy (MRIgRT), manual contouring of rectal tumors on daily images is labor-intensive and time-consuming. Automation of this task is complex due to substantial variation in tumor shape and location between patients. The aim of this work was to investigate different approaches of propagating patient-specific prior information to the online adaptive treatment fractions to improve deep-learning based auto-segmentation of rectal tumors. Materials and methods243 T2-weighted MRI scans of 49 rectal cancer patients treated on the 1.5T MR-Linear accelerator (MR-Linac) were utilized to train models to segment rectal tumors. As benchmark, an MRI_only auto-segmentation model was trained. Three approaches of including a patient-specific prior were studied: 1. include the segmentations of fraction 1 as extra input channel for the auto-segmentation of subsequent fractions, 2. fine-tuning of the MRI_only model to fraction 1 (PSF_1) and 3. fine-tuning of the MRI_only model on all earlier fractions (PSF_cumulative). Auto-segmentations were compared to the manual segmentation using geometric similarity metrics. Clinical impact was assessed by evaluating post-treatment target coverage. ResultsAll patient-specific methods outperformed the MRI_only segmentation approach. Median 95th percentile Hausdorff (95HD) were 22.0 (range: 6.1–76.6) mm for MRI_only segmentation, 9.9 (range: 2.5–38.2) mm for MRI+prior segmentation, 6.4 (range: 2.4–17.8) mm for PSF_1 and 4.8 (range: 1.7–26.9) mm for PSF_cumulative. PSF_cumulative was found to be superior to PSF_1 from fraction 4 onward (p = 0.014). ConclusionPatient-specific fine-tuning of automatically segmented rectal tumors, using images and segmentations from all previous fractions, yields superior quality compared to other auto-segmentation approaches.

Anatomo-functional changes in neural substrates of cognitive memory in developmental amnesia: Insights from automated and manual Magnetic Resonance Imaging examinations.

Despite bilateral hippocampal damage dating to the perinatal or early childhood period and severely impaired episodic memory, patients with developmental amnesia continue to exhibit well-developed semantic memory across the developmental trajectory. Detailed information on the extent and focality of brain damage in these patients is needed to hypothesize about the neural substrate that supports their remarkable capacity for encoding and retrieval of semantic memory. In particular, we need to assess whether the residual hippocampal tissue is involved in this preservation, or whether the surrounding cortical areas reorganize to rescue aspects of these critical cognitive memory processes after early injury. We used voxel-based morphometry (VBM) analysis, automatic (FreeSurfer) and manual segmentation to characterize structural changes in the brain of an exceptionally large cohort of 23 patients with developmental amnesia in comparison with 32 control subjects. Both the VBM and the FreeSurfer analyses revealed severe structural alterations in the hippocampus and thalamus of patients with developmental amnesia. Milder damage was found in the amygdala, caudate, and parahippocampal gyrus. Manual segmentation demonstrated differences in the degree of atrophy of the hippocampal subregions in patients. The level of atrophy in CA-DG subregions and subicular complex was more than 40%, while the atrophy of the uncus was moderate (-24%). Anatomo-functional correlations were observed between the volumes of residual hippocampal subregions in patients and selective aspects of their cognitive performance, viz, intelligence, working memory, and verbal and visuospatial recall. Our findings suggest that in patients with developmental amnesia, cognitive processing is compromised as a function of the extent of atrophy in hippocampal subregions. More severe hippocampal damage may be more likely to promote structural and/or functional reorganization in areas connected to the hippocampus. In this hypothesis, different levels of hippocampal function may be rescued following this variable reorganization. Our findings document not only the extent, but also the limits of circuit reorganization occurring in the young brain after early bilateral hippocampal damage.

Training and validation of a deep learning U-net architecture general model for automated segmentation of inner ear from CT

BackgroundThe intricate three-dimensional anatomy of the inner ear presents significant challenges in diagnostic procedures and critical surgical interventions. Recent advancements in deep learning (DL), particularly convolutional neural networks (CNN), have shown promise for segmenting specific structures in medical imaging. This study aimed to train and externally validate an open-source U-net DL general model for automated segmentation of the inner ear from computed tomography (CT) scans, using quantitative and qualitative assessments.MethodsIn this multicenter study, we retrospectively collected a dataset of 271 CT scans to train an open-source U-net CNN model. An external set of 70 CT scans was used to evaluate the performance of the trained model. The model’s efficacy was quantitatively assessed using the Dice similarity coefficient (DSC) and qualitatively assessed using a 4-level Likert score. For comparative analysis, manual segmentation served as the reference standard, with assessments made on both training and validation datasets, as well as stratified analysis of normal and pathological subgroups.ResultsThe optimized model yielded a mean DSC of 0.83 and achieved a Likert score of 1 in 42% of the cases, in conjunction with a significantly reduced processing time. Nevertheless, 27% of the patients received an indeterminate Likert score of 4. Overall, the mean DSCs were notably higher in the validation dataset than in the training dataset.ConclusionThis study supports the external validation of an open-source U-net model for the automated segmentation of the inner ear from CT scans.Relevance statementThis study optimized and assessed an open-source general deep learning model for automated segmentation of the inner ear using temporal CT scans, offering perspectives for application in clinical routine. The model weights, study datasets, and baseline model are worldwide accessible.Key PointsA general open-source deep learning model was trained for CT automated inner ear segmentation.The Dice similarity coefficient was 0.83 and a Likert score of 1 was attributed to 42% of automated segmentations.The influence of scanning protocols on the model performances remains to be assessed.Graphical

Automated Three-Dimensional Imaging and Pfirrmann Classification of Intervertebral Disc Using a Graphical Neural Network in Sagittal Magnetic Resonance Imaging of the Lumbar Spine.

This study aimed to develop a graph neural network (GNN) for automated three-dimensional (3D) magnetic resonance imaging (MRI) visualization and Pfirrmann grading of intervertebral discs (IVDs), and benchmark it against manual classifications. Lumbar IVD MRI data from 300 patients were retrospectively analyzed. Two clinicians assessed the manual segmentation and grading for inter-rater reliability using Cohen's kappa. The IVDs were then processed and classified using an automated convolutional neural network (CNN)-GNN pipeline, and their performance was evaluated using F1 scores. Manual Pfirrmann grading exhibited moderate agreement (κ = 0.455-0.565) among the clinicians, with higher exact match frequencies at lower lumbar levels. Single-grade discrepancies were prevalent except at L5/S1. Automated segmentation of IVDs using a pretrained U-Net model achieved an F1 score of 0.85, with a precision and recall of 0.83 and 0.88, respectively. Following 3D reconstruction of the automatically segmented IVD into a 3D point-cloud representation of the target intervertebral disc, the GNN model demonstrated moderate performance in Pfirrmann classification. The highest precision (0.81) and F1 score (0.71) were observed at L2/3, whereas the overall metrics indicated moderate performance (precision: 0.46, recall: 0.47, and F1 score: 0.46), with variability across spinal levels. The integration of CNN and GNN offers a new perspective for automating IVD analysis in MRI. Although the current performance highlights the need for further refinement, the moderate accuracy of the model, combined with its 3D visualization capabilities, establishes a promising foundation for more advanced grading systems.

Training robust T1-weighted magnetic resonance imaging liver segmentation models using ensembles of datasets with different contrast protocols and liver disease etiologies

Image segmentation of the liver is an important step in treatment planning for liver cancer. However, manual segmentation at a large scale is not practical, leading to increasing reliance on deep learning models to automatically segment the liver. This manuscript develops a generalizable deep learning model to segment the liver on T1-weighted MR images. In particular, three distinct deep learning architectures (nnUNet, PocketNet, Swin UNETR) were considered using data gathered from six geographically different institutions. A total of 819 T1-weighted MR images were gathered from both public and internal sources. Our experiments compared each architecture’s testing performance when trained both intra-institutionally and inter-institutionally. Models trained using nnUNet and its PocketNet variant achieved mean Dice-Sorensen similarity coefficients>0.9 on both intra- and inter-institutional test set data. The performance of these models suggests that nnUNet and PocketNet liver segmentation models trained on a large and diverse collection of T1-weighted MR images would on average achieve good intra-institutional segmentation performance.

Feasibility of deep learning algorithm in diagnosing lumbar central canal stenosis using abdominal CT.

To develop a deep learning algorithm for diagnosing lumbar central canal stenosis (LCCS) using abdominal CT (ACT) and lumbar spine CT (LCT). This retrospective study involved 109 patients undergoing LCTs and ACTs between January 2014 and July 2021. The dural sac on CT images was manually segmented and classified as normal or stenosed (dural sac cross-sectional area ≥ 100 mm2 or < 100 mm2, respectively). A deep learning model based on U-Net architecture was developed to automatically segment the dural sac and classify the central canal stenosis. The classification performance of the model was compared on a testing set (990 images from 9 patients). The accuracy, sensitivity, and specificity of automatic segmentation were quantitatively evaluated by comparing its Dice similarity coefficient (DSC) and intraclass correlation coefficient (ICC) with those of manual segmentation. In total, 990 CT images from nine patients (mean age ± standard deviation, 77 ± 7years; six men) were evaluated. The algorithm achieved high segmentation performance with a DSC of 0.85 ± 0.10 and ICC of 0.82 (95% confidence interval [CI]: 0.80,0.85). The ICC between ACTs and LCTs on the deep learning algorithm was 0.89 (95%CI: 0.87,0.91). The accuracy of the algorithm in diagnosing LCCS with dichotomous classification was 84%(95%CI: 0.82,0.86). In dataset analysis, the accuracy of ACTs and LCTs was 85%(95%CI: 0.82,0.88) and 83%(95%CI: 0.79,0.86), respectively. The model showed better accuracy for ACT than LCT. The deep learning algorithm automatically diagnosed LCCS on LCTs and ACTs. ACT had a diagnostic performance for LCCS comparable to that of LCT.

Precise ablation zone segmentation on CT images after liver cancer ablation using semi‐automatic CNN‐based segmentation

AbstractBackgroundAblation zone segmentation in contrast‐enhanced computed tomography (CECT) images enables the quantitative assessment of treatment success in the ablation of liver lesions. However, fully automatic liver ablation zone segmentation in CT images still remains challenging, such as low accuracy and time‐consuming manual refinement of the incorrect regions.PurposeTherefore, in this study, we developed a semi‐automatic technique to address the remaining drawbacks and improve the accuracy of the liver ablation zone segmentation in the CT images.MethodsOur approach uses a combination of a CNN‐based automatic segmentation method and an interactive CNN‐based segmentation method. First, automatic segmentation is applied for coarse ablation zone segmentation in the whole CT image. Human experts then visually validate the segmentation results. If there are errors in the coarse segmentation, local corrections can be performed on each slice via an interactive CNN‐based segmentation method. The models were trained and the proposed method was evaluated using two internal datasets of post‐interventional CECT images ( = 22, = 145; 62 patients in total) and then further tested using an external benchmark dataset ( = 12; 10 patients).ResultsTo evaluate the accuracy of the proposed approach, we used Dice similarity coefficient (DSC), average symmetric surface distance (ASSD), Hausdorff distance (HD), and volume difference (VD). The quantitative evaluation results show that the proposed approach obtained mean DSC, ASSD, HD, and VD scores of 94.0%, 0.4 mm, 8.4 mm, 0.02, respectively, on the internal dataset, and 87.8%, 0.9 mm, 9.5 mm, and −0.03, respectively, on the benchmark dataset. We also compared the performance of the proposed approach to that of five well‐known segmentation methods; the proposed semi‐automatic method achieved state‐of‐the‐art performance on ablation segmentation accuracy, and on average, 2 min are required to correct the segmentation. Furthermore, we found that the accuracy of the proposed method on the benchmark dataset is comparable to that of manual segmentation by human experts ( = 0.55, ‐test).ConclusionsThe proposed semi‐automatic CNN‐based segmentation method can be used to effectively segment the ablation zones, increasing the value of CECT for an assessment of treatment success. For reproducibility, the trained models, source code, and demonstration tool are publicly available at https://github.com/lqanh11/Interactive_AblationZone_Segmentation.

Accuracy of deep learning-based upper airway segmentation

IntroductionIn orthodontic treatments, accurately assessing the upper airway volume and morphology is essential for proper diagnosis and planning. Cone beam computed tomography (CBCT) is used for assessing upper airway volume through manual, semi-automatic, and automatic airway segmentation methods. This study evaluates upper airway segmentation accuracy by comparing the results of an automatic model and a semi-automatic method against the gold standard manual method. Materials and methodsAn automatic segmentation model was trained using the MONAI Label framework to segment the upper airway from CBCT images. An open-source program, ITK-SNAP, was used for semi-automatic segmentation. The accuracy of both methods was evaluated against manual segmentations. Evaluation metrics included Dice Similarity Coefficient (DSC), Precision, Recall, 95% Hausdorff Distance (HD), and volumetric differences. ResultsThe automatic segmentation group averaged a DSC score of 0.915±0.041, while the semi-automatic group scored 0.940±0.021, indicating clinically acceptable accuracy for both methods. Analysis of the 95% HD revealed that semi-automatic segmentation (0.997±0.585) was more accurate and closer to manual segmentation than automatic segmentation (1.447±0.674). Volumetric comparisons revealed no statistically significant differences between automatic and manual segmentation for total, oropharyngeal, and velopharyngeal airway volumes. Similarly, no significant differences were noted between the semi-automatic and manual methods across these regions. ConclusionIt has been observed that both automatic and semi-automatic methods, which utilise open-source software, align effectively with manual segmentation. Implementing these methods can aid in decision-making by allowing faster and easier upper airway segmentation with comparable accuracy in orthodontic practice.

Automated endometrial identification and volume calculation in normal uteri using a novel smart ERA technique

To evaluate the repeatability of a novel automated technique called Smart ERA (Smart Endometrial Receptivity Analysis) for the automated segmentation and volume calculation of the endometrium in patients with normal uteri,, and to compare the agreement of endometrial volume measurements between Smart ERA, the semi-automated Virtual Organ Computer-aided Analysis (VOCAL) technique and manual segmentation. This retrospective study evaluated endometrial volume measurement in infertile patients who underwent frozen-thawed embryo transfer (FET). Transvaginal three-dimensional ultrasound scans were performed using a Resona R9 ultrasound machine. Data was collected from patients between 2021 and 2022. Patients with normal uteri and optimal ultrasound images were included. Endometrial volumes were measured using Smart ERA, VOCAL at 15° rotation, and manual segmentation. Intra-observer repeatability and agreement between techniques were assessed using the intraclass correlation coefficient (ICC) and Bland–Altman analysis. A total of 407 female patients were evaluated (mean age 33.2 ± 4.7 years). The repeatability of Smart ERA showed an ICC of 0.983 (95% CI 0.984–0.991). The agreement between Smart ERA and the manual method, Smart ERA and VOCAL, and VOCAL and the manual method, as assessed by ICC, were 0.986 (95% CI 0.977–0.990), 0.943 (95% CI 0.934–0.963), and 0.951 (95% CI 0.918–0.969), respectively. The Smart ERA technique required approximately 3 s for endometrial volume calculation, while VOCAL took around 5 min and the manual segmentation method took approximately 50 min. The Smart-ERA software, which employs a novel three-dimensional segmentation algorithm, demonstrated excellent intra-observer repeatability and high agreement with both VOCAL and manual segmentation for endometrial volume measurement in women with normal uteri. However, these findings should be interpreted with caution, as the algorithm's performance may not be generalizable to populations with different uterine characteristic. Additionally, Smart ERA required significantly less time compared to VOCAL and manual segmentation.

Evaluation of an automated laminar cartilage T2 relaxation time analysis method in an early osteoarthritis model.

A fully automated laminar cartilage composition (MRI-based T2) analysis method was technically and clinically validated by comparing radiographically normal knees with (CL-JSN) and without contra-lateral joint space narrowing or other signs of radiographic osteoarthritis (OA, CL-noROA). 2D U-Nets were trained from manually segmented femorotibial cartilages (n = 72) from all 7 echoes (AllE), or from the 1st echo only (1stE) of multi-echo-spin-echo (MESE) MRIs acquired by the Osteoarthritis Initiative (OAI). Because of its greater accuracy, only the AllE U-Net was then applied to knees from the OAI healthy reference cohort (n = 10), CL-JSN (n = 39), and (1:1) matched CL-noROA knees (n = 39) that all had manual expert segmentation, and to 982 non-matched CL-noROA knees without expert segmentation. The agreement (Dice similarity coefficient) between automated vs. manual expert cartilage segmentation was between 0.82 ± 0.05/0.79 ± 0.06 (AllE/1stE) and 0.88 ± 0.03/0.88 ± 0.03 (AllE/1stE) across femorotibial cartilage plates. The deviation between automated vs. manually derived laminar T2 reached up to - 2.2 ± 2.6ms/ + 4.1 ± 10.2ms (AllE/1stE). The AllE U-Net showed a similar sensitivity to cross-sectional laminar T2 differences between CL-JSN and CL-noROA knees in the matched (Cohen's D ≤ 0.54) and the non-matched (D ≤ 0.54) comparison as the matched manual analyses (D ≤ 0.48). Longitudinally, the AllE U-Net also showed a similar sensitivity to CL-JSN vs. CS-noROA differences in the matched (D ≤ 0.51) and the non-matched (D ≤ 0.43) comparison as matched manual analyses (D ≤ 0.41). The fully automated T2 analysis showed a high agreement, acceptable accuracy, and similar sensitivity to cross-sectional and longitudinal laminar T2 differences in an early OA model, compared with manual expert analysis. Clinicaltrials.gov identification: NCT00080171.

A Scoping Review of Machine-Learning Derived Radiomic Analysis of CT and PET Imaging to Investigate Atherosclerotic Cardiovascular Disease.

Cardiovascular disease affects the carotid arteries, coronary arteries, aorta and the peripheral arteries. Radiomics involves the extraction of quantitative data from imaging features that are imperceptible to the eye. Radiomics analysis in cardiovascular disease has largely focused on CT and MRI modalities. This scoping review aims to summarise the existing literature on radiomic analysis techniques in cardiovascular disease. MEDLINE and Embase databases were searched for eligible studies evaluating radiomic techniques in living human subjects derived from CT, MRI or PET imaging investigating atherosclerotic disease. Data on study population, imaging characteristics and radiomics methodology were extracted. Twenty-nine studies consisting of 5753 patients (3752 males) were identified, and 78.7% of patients were from coronary artery studies. Twenty-seven studies employed CT imaging (19 CT carotid angiography and 6 CT coronary angiography (CTCA)), and two studies studied PET/CT. Manual segmentation was most frequently undertaken. Processing techniques included voxel discretisation, voxel resampling and filtration. Various shape, first-order, second-order and higher-order radiomic features were extracted. Logistic regression was most commonly used for machine learning. Most published evidence was feasibility/proof of concept work. There was significant heterogeneity in image acquisition, segmentation techniques, processing and analysis between studies. There is a need for the implementation of standardised imaging acquisition protocols, adherence to published reporting guidelines and economic evaluation.

Automated segmentation and classification of supraspinatus fatty infiltration in shoulder magnetic resonance image using a convolutional neural network.

Goutallier's fatty infiltration of the supraspinatus muscle is a critical condition in degenerative shoulder disorders. Deep learning research primarily uses manual segmentation and labeling to detect this condition. Employing unsupervised training with a hybrid framework of segmentation and classification could offer an efficient solution. To develop and assess a two-step deep learning model for detecting the region of interest and categorizing the magnetic resonance image (MRI) supraspinatus muscle fatty infiltration according to Goutallier's scale. A retrospective study was performed from January 1, 2019 to September 20, 2020, using 900 MRI T2-weighted images with supraspinatus muscle fatty infiltration diagnoses. A model with two sequential neural networks was implemented and trained. The first sub-model automatically detects the region of interest using a U-Net model. The second sub-model performs a binary classification using the VGG-19 architecture. The model's performance was computed as the average of five-fold cross-validation processes. Loss, accuracy, Dice coefficient (CI. 95%), AU-ROC, sensitivity, and specificity (CI. 95%) were reported. Six hundred and six shoulders MRIs were analyzed. The Goutallier distribution was presented as follows: 0 (66.50%); 1 (18.81%); 2 (8.42%); 3 (3.96%); 4 (2.31%). Segmentation results demonstrate high levels of accuracy (0.9977 ± 0.0002) and Dice score (0.9441 ± 0.0031), while the classification model also results in high levels of accuracy (0.9731 ± 0.0230); sensitivity (0.9000 ± 0.0980); specificity (0.9788 ± 0.0257); and AUROC (0.9903 ± 0.0092). The two-step training method proposed using a deep learning model demonstrated strong performance in segmentation and classification tasks.

Micro to macro scale anatomical analysis of the human hippocampal arteries with synchrotron hierarchical phase-contrast tomography.

To date, no non-invasive imaging modality has been employed to profile the structural intricacies of the hippocampal arterial microvasculature in humans. We hypothesised that synchrotron-based imaging of the human hippocampus would enable precise characterisation of the arterial microvasculature. Two preserved human brains from, a 69-year-old female and a 63-year-old male body donors were imaged using hierarchical phase-contrast tomography (HiP-CT) with synchrotron radiation at multiple voxel resolutions from 25.08μm down to 2.45μm. Subsequent manual and semi-automatic artery segmentation were performed followed by morphometric analyses. These data were compared to published data from alternative methodologies. HiP-CT made it possible to segment in context the arterial architecture of the human hippocampus. Our analysis identified anterior, medial and posterior hippocampal arteries arising from the P2 segment of the posterior cerebral artery on the image slices. We mapped arterial branches with external diameters greater than 50 μm in the hippocampal region. We visualised vascular asymmetry and quantified arterial structures with diameters as small as 7 μm. Through the application of HiP-CT, we have provided the first imaging visualisation and quantification of the arterial system of the human hippocampus at high resolution in the context of whole brain imaging. Our results bridge the gap between anatomical and histological scales.

Deep learning-assisted interactive contouring of lung cancer: Impact on contouring time and consistency

Background and PurposeTo evaluate the impact of a deep learning (DL)-assisted interactive contouring tool on inter-observer variability and the time taken to complete tumour contouring. Materials and MethodsNine clinicians contoured the gross tumour volume (GTV) using the PET-CT scans of 10 non-small cell lung cancer (NSCLC) patients, either using DL-assisted or manual contouring tools. After contouring a case using one contouring method, the same case was contoured one week later using the other method. The contours and time taken were compared. ResultsUse of the DL-assisted tool led to a statistically significant decrease in active contouring time of 23 % relative to the standard manual segmentation method (p < 0.01). The mean observation time for all clinicians and cases made up nearly 60 % of interaction time for both contouring approaches. On average the time spent contouring per case was reduced from 22 min to 19 min when using the DL-assisted tool. Additionally, the DL-assisted tool reduced contour variability in the parts of tumour where clinicians tended to disagree the most, while the consensus contour was similar whichever of the two contouring approaches was used. ConclusionsA DL-assisted interactive contouring approach decreased active contouring time and local inter-observer variability when used to delineate lung cancer GTVs compared to a standard manual method. Integration of this tool into the clinical workflow could assist clinicians in contouring tasks and improve contouring efficiency.

ConvNext Mixer‐Based Encoder Decoder Method for Nuclei Segmentation in Histopathology Images

ABSTRACTHistopathology, vital in diagnosing medical conditions, especially in cancer research, relies on analyzing histopathology images (HIs). Nuclei segmentation, a key task, involves precisely identifying cell nuclei boundaries. Manual segmentation by pathologists is time‐consuming, prompting the need for robust automated methods. Challenges in segmentation arise from HI complexities, necessitating advanced techniques. Recent advancements in deep learning, particularly Convolutional Neural Networks (CNNs), have transformed nuclei segmentation. This study emphasizes feature extraction, introducing the ConvNext Mixer‐based Encoder‐Decoder (CNM‐ED) model. Unlike traditional CNN based models, the proposed CNM‐ED model enables the extraction of spatial and long context features to address the inherent complexities of histopathology images. This method leverages a multi‐path strategy using a traditional CNN architecture as well as different paths focused on obtaining customized long context features using the ConvNext Mixer block structure that combines ConvMixer and ConvNext blocks. The fusion of these diverse features in the final segmentation output enables improved accuracy and performance, surpassing existing state‐of‐the‐art segmentation models. Moreover, our multi‐level feature extraction strategy is more effective than models using self‐attention mechanisms such as SwinUnet and TransUnet, which have been frequently used in recent years. Experimental studies were conducted using five different datasets (TNBC, MoNuSeg, CoNSeP, CPM17, and CryoNuSeg) to analyze the performance of the proposed CNM‐ED model. Comparisons were made with various CNN based models in the literature using evaluation metrics such as accuracy, AJI, macro F1 score, macro intersection over union, macro precision, and macro recall. It was observed that the proposed CNM‐ED model achieved highly successful results across all metrics. Through comparisons with state‐art‐of models from the literature, the proposed CNM‐ED model stands out as a promising advancement in nuclei segmentation, addressing the intricacies of histopathological images. The model demonstrates enhanced diagnostic capabilities and holds the potential for significant progress in medical research.