Average Dice Similarity Coefficient Research Articles

An automated in vitro wound healing microscopy image analysis approach utilizing U-net-based deep learning methodology

BackgroundThe assessment of in vitro wound healing images is critical for determining the efficacy of the therapy-of-interest that may influence the wound healing process. Existing methods suffer significant limitations, such as user dependency, time-consuming nature, and lack of sensitivity, thus paving the way for automated analysis approaches.MethodsHereby, three structurally different variations of U-net architectures based on convolutional neural networks (CNN) were implemented for the segmentation of in vitro wound healing microscopy images. The developed models were fed using two independent datasets after applying a novel augmentation method aimed at the more sensitive analysis of edges after the preprocessing. Then, predicted masks were utilized for the accurate calculation of wound areas. Eventually, the therapy efficacy-indicator wound areas were thoroughly compared with current well-known tools such as ImageJ and TScratch.ResultsThe average dice similarity coefficient (DSC) scores were obtained as 0.958∼\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\sim$$\\end{document}0.968 for U-net-based deep learning models. The averaged absolute percentage errors (PE) of predicted wound areas to ground truth were 6.41%, 3.70%, and 3.73%, respectively for U-net, U-net++, and Attention U-net, while ImageJ and TScratch had considerable averaged error rates of 22.59% and 33.88%, respectively.ConclusionsComparative analyses revealed that the developed models outperformed the conventional approaches in terms of analysis time and segmentation sensitivity. The developed models also hold great promise for the prediction of the in vitro wound area, regardless of the therapy-of-interest, cell line, magnification of the microscope, or other application-dependent parameters.

MultiTumor Analyzer (MTA-20–55): A network for efficient classification of detected brain tumors from MRI images

Brain cancer, one of the leading causes of mortality worldwide, is caused by brain tumors. Early diagnosis of tumors and predicting their progression can help doctors to save lives. In this article, we have designed an automated approach for locating and classifying tumors from MRI images. The novelties of the research work include the following two stages: Developing an encoder-decoder type 20-Layered deep neural network (DNN) named MultiTumor Analyzer (MTA-20) with 15 down-sampling layers and 4 up-sampling layers, the segmentation is performed in the initial stage. Here, we have adhered a Leaky ReLU activation function instead of ReLU which learn a parameter with negative values that may have valuable information which is essential specifically for image segmentation. Further, a 55-layered DNN using multistage feature fusion is developed in the second stage of the work for the classification of localized tumors. The classification is performed using developed MultiTumor Analyzer (MTA-55) DNN with Softmax classifier. The efficacy of the designed network is validated using highly cited quantitative measures such as accuracy, sensitivity, specificity, dice similarity coefficient (DSC), precision, and F1-measure. It is observed that the proposed MTA-20 DNN attains the average accuracy, sensitivity, specificity, DSC, and precision of 99.2 %, 94.6 %, 99.3 %, 88 %, and 82.5 % respectively against seven state-of-the-art techniques. Also, it is found that, the proposed MTA-55 DNN provides the overall accuracy, recall, specificity, F1-measure, precision, and DSC of 99.8 %, 99.633 %, 99.844 %, 99.659 %, 99.689 %, and 99.656 % respectively as compared to thirteen state-of-the-art techniques. These results corroborate the superiority of the proposed technique.

Multi-modal segmentation with missing image data for automatic delineation of gross tumor volumes in head and neck cancers.

Head and neck (HN) gross tumor volume (GTV) auto-segmentation is challenging due to the morphological complexity and low image contrast of targets. Multi-modality images, including computed tomography (CT) and positron emission tomography (PET), are used in the routine clinic to assist radiation oncologists for accurate GTV delineation. However, the availability of PET imaging may not always be guaranteed. To develop a deep learning segmentation framework for automated GTV delineation of HN cancers using a combination of PET/CT images, while addressing the challenge of missing PET data. Two datasets were included for this study: Dataset I: 524 (training) and 359 (testing) oropharyngeal cancer patients from different institutions with their PET/CT pairs provided by the HECKTOR Challenge; Dataset II: 90 HN patients(testing) from a local institution with their planning CT, PET/CT pairs. To handle potentially missing PET images, a model training strategy named the "Blank Channel" method was implemented. To simulate the absence of a PET image, a blank array with the same dimensions as the CT image was generated to meet the dual-channel input requirement of the deep learning model. During the model training process, the model was randomly presented with either a real PET/CT pair or a blank/CT pair. This allowed the model to learn the relationship between the CT image and the corresponding GTV delineation based on available modalities. As a result, our model had the ability to handle flexible inputs during prediction, making it suitable for cases where PET images are missing. To evaluate the performance of our proposed model, we trained it using training patients from Dataset I and tested it with Dataset II. We compared our model (Model 1) with two other models which were trained for specific modality segmentations: Model 2 trained with only CT images, and Model 3 trained with real PET/CT pairs. The performance of the models was evaluated using quantitative metrics, including Dice similarity coefficient (DSC), mean surface distance (MSD), and 95% Hausdorff Distance (HD95). In addition, we evaluated our Model 1 and Model 3 using the 359 test cases in Dataset I. Our proposed model(Model 1) achieved promising results for GTV auto-segmentation using PET/CT images, with the flexibility of missing PET images. Specifically, when assessed with only CT images in Dataset II, Model 1 achieved DSC of 0.56±0.16, MSD of 3.4±2.1mm, and HD95 of 13.9±7.6mm. When the PET images were included, the performance of our model was improved to DSC of 0.62±0.14, MSD of 2.8±1.7mm, and HD95 of 10.5±6.5mm. These results are comparable to those achieved by Model 2 and Model 3, illustrating Model 1's effectiveness in utilizing flexible input modalities. Further analysis using the test dataset from Dataset I showed that Model 1 achieved an average DSC of 0.77, surpassing the overall average DSC of 0.72 among all participants in the HECKTOR Challenge. We successfully refined a multi-modal segmentation tool for accurate GTV delineation for HN cancer. Our method addressed the issue of missing PET images by allowing flexible data input, thereby providing a practical solution for clinical settings where access to PET imaging may be limited.

Precision dose prediction for breast cancer patients undergoing IMRT: The Swin-UMamba-Channel Model

BackgroundRadiation therapy is one of the crucial treatment modalities for cancer. An excellent radiation therapy plan relies heavily on an outstanding dose distribution map, which is traditionally generated through repeated trials and adjustments by experienced physicists. However, this process is both time-consuming and labor-intensive, and it comes with a degree of subjectivity. Now, with the powerful capabilities of deep learning, we are able to predict dose distribution maps more accurately, effectively overcoming these challenges. MethodsIn this study, we propose a novel Swin-UMamba-Channel prediction model specifically designed for predicting the dose distribution of patients with left breast cancer undergoing radiotherapy after total mastectomy. This model integrates anatomical position information of organs and ray angle information, significantly enhancing prediction accuracy. Through iterative training of the generator (Swin-UMamba) and discriminator, the model can generate images that closely match the actual dose, assisting physicists in quickly creating DVH curves and shortening the treatment planning cycle. Our model exhibits excellent performance in terms of prediction accuracy, computational efficiency, and practicality, and its effectiveness has been further verified through comparative experiments with similar networks. ResultsThe results of the study indicate that our model can accurately predict the clinical dose of breast cancer patients undergoing intensity-modulated radiation therapy (IMRT). The predicted dose range is from 0 to 50 Gy, and compared with actual data, it shows a high accuracy with an average Dice similarity coefficient of 0.86. Specifically, the average dose change rate for the planning target volume ranges from 0.28 % to 1.515 %, while the average dose change rates for the right and left lungs are 2.113 % and 0.508 %, respectively. Notably, due to their small sizes, the heart and spinal cord exhibit relatively higher average dose change rates, reaching 3.208 % and 1.490 %, respectively. In comparison with similar dose studies, our model demonstrates superior performance. Additionally, our model possesses fewer parameters, lower computational complexity, and shorter processing time, further enhancing its practicality and efficiency. These findings provide strong evidence for the accuracy and reliability of our model in predicting doses, offering significant technical support for IMRT in breast cancer patients. ConclusionThis study presents a novel Swin-UMamba-Channel dose prediction model, and its results demonstrate its precise prediction of clinical doses for the target area of left breast cancer patients undergoing total mastectomy and IMRT. These remarkable achievements provide valuable reference data for subsequent plan optimization and quality control, paving a new path for the application of deep learning in the field of radiation therapy.

Evaluation of multiple-vendor AI autocontouring solutions

BackgroundMultiple artificial intelligence (AI)-based autocontouring solutions have become available, each promising high accuracy and time savings compared with manual contouring. Before implementing AI-driven autocontouring into clinical practice, three commercially available CT-based solutions were evaluated.Materials and methodsThe following solutions were evaluated in this work: MIM-ProtégéAI+ (MIM), Radformation-AutoContour (RAD), and Siemens-DirectORGANS (SIE). Sixteen organs were identified that could be contoured by all solutions. For each organ, ten patients that had manually generated contours approved by the treating physician (AP) were identified, totaling forty-seven different patients. CT scans in the supine position were acquired using a Siemens-SOMATOMgo 64-slice helical scanner and used to generate autocontours. Physician scoring of contour accuracy was performed by at least three physicians using a five-point Likert scale. Dice similarity coefficient (DSC), Hausdorff distance (HD) and mean distance to agreement (MDA) were calculated comparing AI contours to “ground truth” AP contours.ResultsThe average physician score ranged from 1.00, indicating that all physicians reviewed the contour as clinically acceptable with no modifications necessary, to 3.70, indicating changes are required and that the time taken to modify the structures would likely take as long or longer than manually generating the contour. When averaged across all sixteen structures, the AP contours had a physician score of 2.02, MIM 2.07, RAD 1.96 and SIE 1.99. DSC ranged from 0.37 to 0.98, with 41/48 (85.4%) contours having an average DSC ≥ 0.7. Average HD ranged from 2.9 to 43.3 mm. Average MDA ranged from 0.6 to 26.1 mm.ConclusionsThe results of our comparison demonstrate that each vendor’s AI contouring solution exhibited capabilities similar to those of manual contouring. There were a small number of cases where unusual anatomy led to poor scores with one or more of the solutions. The consistency and comparable performance of all three vendors’ solutions suggest that radiation oncology centers can confidently choose any of the evaluated solutions based on individual preferences, resource availability, and compatibility with their existing clinical workflows. Although AI-based contouring may result in high-quality contours for the majority of patients, a minority of patients require manual contouring and more in-depth physician review.

PAC-UNet: Parallel Dual Self-Attention with Convolution for Meniscal MRI Image Segmentation

Meniscal tears are common sports-injury disorders, and thus accurate segmentation of the meniscus is a worthwhile means of medical diagnosis. However, due to the limited research on image segmentation of the meniscus, most previous works have poor segmentation effects on the meniscus, which affects the adoption of assisted medical diagnosis of meniscus. To address this issue, we propose an improved neural network model, termed as the PAC-UNet model, which introduces a parallel dual self-attention with depth-wise convolution for the meniscus image segmentation. Firstly, in the encoder stage, the parallel block is used to eliminate the negative impact of weak modeling ability caused by weight sharing on shared dimensions, so as to better learn the semantic information. Then, in the decoder stage, the parallel block and patch expansion are used to restore the predicted results of meniscus segmentation by performing self-attention and up-sampling on the features. By analyzing the outcomes of experiments on the meniscus dataset, which were collected from the hospital, it is found that the proposed network performed better than other medical image segmentation networks, where the average Dice Similarity Coefficient (DSC), Intersection Over Union (IOU), precision, and Hausdorff_95 of the medial meniscus and lateral meniscus are up to 89.01%, 80.81%, 90.5%, and 2.43, respectively.

Uncertainty estimation and evaluation of deformation image registration based convolutional neural networks

Objective. Fast and accurate deformable image registration (DIR), including DIR uncertainty estimation, is essential for safe and reliable clinical deployment. While recent deep learning models have shown promise in predicting DIR with its uncertainty, challenges persist in proper uncertainty evaluation and hyperparameter optimization for these methods. This work aims to develop and evaluate a model that can perform fast DIR and predict its uncertainty in seconds. Approach. This study introduces a novel probabilistic multi-resolution image registration model utilizing convolutional neural networks to estimate a multivariate normal distributed dense displacement field (DDF) in a multimodal image registration problem. To assess the quality of the DDF distribution predicted by the model, we propose a new metric based on the Kullback–Leibler divergence. The performance of our approach was evaluated against three other DIR algorithms (VoxelMorph, Monte Carlo dropout, and Monte Carlo B-spline) capable of predicting uncertainty. The evaluation of the models included not only the quality of the deformation but also the reliability of the estimated uncertainty. Our application investigated the registration of a treatment planning computed tomography (CT) to follow-up cone beam CT for daily adaptive radiotherapy. Main results. The hyperparameter tuning of the models showed a trade-off between the estimated uncertainty’s reliability and the deformation’s accuracy. In the optimal trade-off, our model excelled in contour propagation and uncertainty estimation (p <0.05) compared to existing uncertainty estimation models. We obtained an average dice similarity coefficient of 0.89 and a KL-divergence of 0.15. Significance. By addressing challenges in DIR uncertainty estimation and evaluation, our work showed that both the DIR and its uncertainty can be reliably predicted, paving the way for safe deployment in a clinical environment.

Uncertainty estimation- and attention-based semi-supervised models for automatically delineate clinical target volume in CBCT images of breast cancer

ObjectivesAccurate segmentation of the clinical target volume (CTV) of CBCT images can observe the changes of CTV during patients' radiotherapy, and lay a foundation for the subsequent implementation of adaptive radiotherapy (ART). However, segmentation is challenging due to the poor quality of CBCT images and difficulty in obtaining target volumes. An uncertainty estimation- and attention-based semi-supervised model called residual convolutional block attention-uncertainty aware mean teacher (RCBA-UAMT) was proposed to delineate the CTV in cone-beam computed tomography (CBCT) images of breast cancer automatically.MethodsA total of 60 patients who undergone radiotherapy after breast-conserving surgery were enrolled in this study, which involved 60 planning CTs and 380 CBCTs. RCBA-UAMT was proposed by integrating residual and attention modules in the backbone network 3D UNet. The attention module can adjust channel and spatial weights of the extracted image features. The proposed design can train the model and segment CBCT images with a small amount of labeled data (5%, 10%, and 20%) and a large amount of unlabeled data. Four types of evaluation metrics, namely, dice similarity coefficient (DSC), Jaccard, average surface distance (ASD), and 95% Hausdorff distance (95HD), are used to assess the model segmentation performance quantitatively.ResultsThe proposed method achieved average DSC, Jaccard, 95HD, and ASD of 82%, 70%, 8.93, and 1.49 mm for CTV delineation on CBCT images of breast cancer, respectively. Compared with the three classical methods of mean teacher, uncertainty-aware mean-teacher and uncertainty rectified pyramid consistency, DSC and Jaccard increased by 7.89–9.33% and 14.75–16.67%, respectively, while 95HD and ASD decreased by 33.16–67.81% and 36.05–75.57%, respectively. The comparative experiment results of the labeled data with different proportions (5%, 10% and 20%) showed significant differences in the DSC, Jaccard, and 95HD evaluation indexes in the labeled data with 5% versus 10% and 5% versus 20%. Moreover, no significant differences were observed in the labeled data with 10% versus 20% among all evaluation indexes. Therefore, we can use only 10% labeled data to achieve the experimental objective.ConclusionsUsing the proposed RCBA-UAMT, the CTV of breast cancer CBCT images can be delineated reliably with a small amount of labeled data. These delineated images can be used to observe the changes in CTV and lay the foundation for the follow-up implementation of ART.

Deep-learning-based pelvic automatic segmentation in pelvic fractures

With the recent increase in traffic accidents, pelvic fractures are increasing, second only to skull fractures, in terms of mortality and risk of complications. Research is actively being conducted on the treatment of intra-abdominal bleeding, the primary cause of death related to pelvic fractures. Considerable preliminary research has also been performed on segmenting tumors and organs. However, studies on clinically useful algorithms for bone and pelvic segmentation, based on developed models, are limited. In this study, we explored the potential of deep-learning models presented in previous studies to accurately segment pelvic regions in X-ray images. Data were collected from X-ray images of 940 patients aged 18 or older at Gachon University Gil Hospital from January 2015 to December 2022. To segment the pelvis, Attention U-Net, Swin U-Net, and U-Net were trained, thereby comparing and analyzing the results using five-fold cross-validation. The Swin U-Net model displayed relatively high performance compared to Attention U-Net and U-Net models, achieving an average sensitivity, specificity, accuracy, and dice similarity coefficient of 96.77%, of 98.50%, 98.03%, and 96.32%, respectively.

Real-time coronary artery segmentation in CAG images: A semi-supervised deep learning strategy

BackgroundWhen treating patients with coronary artery disease and concurrent renal concerns, we often encounter a conundrum: how to achieve a clearer view of vascular details while minimizing the contrast and radiation doses during percutaneous coronary intervention (PCI). Our goal is to use deep learning (DL) to create a real-time roadmap for guiding PCI. To this end, segmentation, a critical first step, paves the way for detailed vascular analysis. Unlike traditional supervised learning, which demands extensive labeling time and manpower, our strategy leans toward semi-supervised learning. This method not only economizes on labeling efforts but also aims at reducing contrast and radiation exposure. Methods and resultsCAG data sourced from eight tertiary centers in Taiwan, comprising 500 labeled and 8952 unlabeled images. Employing 400 labels for training and reserving 100 for validation, we built a U-Net based network within a teacher-student architecture. The initial teacher model was updated with 8952 unlabeled images inputted, employing a quality control strategy involving consistency regularization and RandAugment. The optimized teacher model produced pseudo-labels for label expansion, which were then utilized to train the final student model. We attained an average dice similarity coefficient of 0.9003 for segmentation, outperforming supervised learning methods with the same label count. Even with only 5 % labels for semi-supervised training, the results surpassed a supervised method with 100 % labels inputted. This semi-supervised approach's advantage extends beyond single-frame prediction, yielding consistently superior results in continuous angiography films. ConclusionsHigh labeling cost hinders DL training. Semi-supervised learning, quality control, and pseudo-label expansion can overcome this. DL-assisted segmentation potentially provides a real-time PCI roadmap and further diminishes radiation and contrast doses.

Patient-specific temperature distribution prediction in laser interstitial thermal therapy: single-irradiation data-driven method

Laser interstitial thermal therapy (LITT) is popular for treating brain tumours and epilepsy. The strict control of tissue thermal damage extent is crucial for LITT. Temperature prediction is useful for predicting thermal damage extent. Accurately predicting in vivo brain tissue temperature is challenging due to the temperature dependence and the individual variations in tissue properties. Considering these factors is essential for improving the temperature prediction accuracy. Objective. To present a method for predicting patient-specific tissue temperature distribution within a target lesion area in the brain during LITT. Approach. A magnetic resonance temperature imaging (MRTI) data-driven estimation model was constructed and combined with a modified Pennes bioheat transfer equation (PBHE) to predict patient-specific temperature distribution. In the PBHE for temperature prediction, the individual specificity and temperature dependence of thermal tissue properties and blood perfusion, as well as the individual specificity of optical tissue properties were considered. Only MRTI data during one laser irradiation were required in the method. This enables the prediction of patient-specific temperature distribution and the resulting thermal damage region for subsequent ablations. Main results. Patient-specific temperature prediction was evaluated based on clinical data acquired during LITT in the brain, using intraoperative MRTI data as the reference standard. Our method significantly improved the prediction performance of temperature distribution and thermal damage region. The average root mean square error was decreased by 69.54%, the average intraclass correlation coefficient was increased by 37.5%, the average Dice similarity coefficient was increased by 43.14% for thermal damage region prediction. Significance. The proposed method can predict temperature distribution and thermal damage region at an individual patient level during LITT, providing a promising approach to assist in patient-specific treatment planning for LITT in the brain.

Deep learning-based efficient diagnosis of periapical diseases with dental X-rays

Diagnosis of periapical diseases usually requires a lot of time and effort from the dentist to perform a series of examinations and evaluations, although X-rays have been available to assist in visualizing the condition of the apical region of the tooth. To achieve efficient automated detection and diagnosis of periapical diseases (periapical granuloma, periapical abscess, periapical cysts, and condensing osteitis) by dental X-rays, a deep learning-based approach is proposed, which includes an improved Mask R-CNN-based lesion area segmentation network and a neural network classifier based on six texture features extracted from the segmented lesion regions. The results demonstrate that the average pixel accuracy of lesion area segmentation is over 0.97, while the average Dice Similarity Coefficient for segmentation is over 0.95. The accuracy, precision, recall, and F1 score of this method for the diagnosis of periapical diseases are all above 0.99. Precise segmentation and accurate classification of four distinct types of periapical diseases are achieved using this method, making it possible to create automated systems that can assist in the clinical diagnosis of periapical diseases, potentially streamlining the diagnostic process, reducing the workload of dentists, and improving overall patient care.

A Deep Learning Framework for Analysis of the Eustachian Tube and the Internal Carotid Artery.

Obtaining automated, objective3-dimensional(3D) models of the Eustachian tube (ET) and the internal carotid artery (ICA) from computed tomography (CT) scans could provide useful navigational and diagnostic information for ET pathologies and interventions. We aim to develop a deep learning (DL) pipeline to automatically segment the ET and ICA and use these segmentations to compute distances between these structures. Retrospective cohort. Tertiary referral center. From a database of 30 CT scans, 60 ET and ICA pairs were manually segmented and used to train an nnU-Net model, a DL segmentation framework. These segmentations were also used to develop a quantitative tool to capture the magnitude and location of the minimum distance point (MDP) between ET and ICA. Performance metrics for the nnU-Net automated segmentations were calculated via the average Hausdorff distance (AHD) and dice similarity coefficient (DSC). The AHD for the ET and ICA were 0.922 and 0.246 mm, respectively. Similarly, the DSC values for the ET and ICA were 0.578 and 0.884. The mean MDP from ET to ICA in the cartilaginous region was 2.6 mm (0.7-5.3 mm)and was located on average 1.9 mm caudal from the bony cartilaginous junction. This study describes the first end-to-end DL pipeline for automated ET and ICA segmentation and analyzes distances between these structures. In addition to helping to ensure the safe selection of patients for ET dilation, this method can facilitate large-scale studies exploring the relationship between ET pathologies and the 3D shape of the ET.

Deep learning-aided 3D proxy-bridged region-growing framework for multi-organ segmentation

Accurate multi-organ segmentation in 3D CT images is imperative for enhancing computer-aided diagnosis and radiotherapy planning. However, current deep learning-based methods for 3D multi-organ segmentation face challenges such as the need for labor-intensive manual pixel-level annotations and high hardware resource demands, especially regarding GPU resources. To address these issues, we propose a 3D proxy-bridged region-growing framework specifically designed for the segmentation of the liver and spleen. Specifically, a key slice is selected from each 3D volume according to the corresponding intensity histogram. Subsequently, a deep learning model is employed to pinpoint the semantic central patch on this key slice, to calculate the growing seed. To counteract the impact of noise, segmentation of the liver and spleen is conducted on superpixel images created through proxy-bridging strategy. The segmentation process is then extended to adjacent slices by applying the same methodology iteratively, culminating in the comprehensive segmentation results. Experimental results demonstrate that the proposed framework accomplishes segmentation of the liver and spleen with an average Dice Similarity Coefficient of approximately 0.93 and a Jaccard Similarity Coefficient of around 0.88. These outcomes substantiate the framework's capability to achieve performance on par with that of deep learning methods, albeit requiring less guidance information and lower GPU resources.

Automatic segmentation of tumour and organs at risk in 3D MRI for cervical cancer radiation therapy with anatomical variations.

Cervical cancer is a common cancer in women globally, with treatment usually involving radiation therapy (RT). Accurate segmentation for the tumour site and organ-at-risks (OARs) could assist in the reduction of treatment side effects and improve treatment planning efficiency. Cervical cancer Magnetic Resonance Imaging (MRI) segmentation is challenging due to a limited amount of training data available and large inter- and intra- patient shape variation for OARs. The proposed Masked-Net consists of a masked encoder within the 3D U-Net to account for the large shape variation within the dataset, with additional dilated layers added to improve segmentation performance. A new loss function was introduced to consider the bounding box loss during training with the proposed Masked-Net. Transfer learning from a male pelvis MRI data with a similar field of view was included. The approaches were compared to the 3D U-Net which was widely used in MRI image segmentation. The data used consisted of 52 volumes obtained from 23 patients with stage IB to IVB cervical cancer across a maximum of 7 weeks of RT with manually contoured labels including the bladder, cervix, gross tumour volume, uterus and rectum. The model was trained and tested with a 5-fold cross validation. Outcomes were evaluated based on the Dice Similarity Coefficients (DSC), the Hausdorff Distance (HD) and the Mean Surface Distance (MSD). The proposed method accounted for the small dataset, large variations in OAR shape and tumour sizes with an average DSC, HD and MSD for all anatomical structures of 0.790, 30.19mm and 3.15mm respectively.

A Hybrid Model for Fetal Growth Restriction Assessment by Automatic Placental Radiomics on T2-Weighted MRI and Multifeature Fusion.

MRI-based placental analyses have been used to improve fetal growth restriction (FGR) assessment by complementing ultrasound-based measurements. However, these are still limited by time-consuming manual annotation in MRI data and the lack of mother-based information. To develop and validate a hybrid model for accurate FGR assessment by automatic placental radiomics on T2-weighted imaging (T2WI) and multifeature fusion. Retrospective. 274 pregnant women (29.5 4.0 years) from two centers were included and randomly divided into training (N = 119), internal test (N = 40), time-independent validation (N = 43), and external validation (N = 72) sets. 1.5-T, T2WI half-Fourier acquisition single-shot turbo spin-echo pulse sequence. First, the placentas on T2WI were manually annotated, and a deep learning model was developed to automatically segment the placentas. Then, the radiomic features were extracted from the placentas and selected by three-step feature selection. In addition, fetus-based measurement features and mother-based clinical features were obtained from ultrasound examinations and medical records, respectively. Finally, a hybrid model based on random forest was constructed by fusing these features, and further compared with models based on other machine learning methods and different feature combinations. The performances of placenta segmentation and FGR assessment were evaluated by Dice similarity coefficient (DSC) and the area under the receiver operating characteristic curve (AUROC), respectively. A P-value <0.05 was considered statistically significant. The placentas were automatically segmented with an average DSC of 90.0%. The hybrid model achieved an AUROC of 0.923, 0.931, and 0.880 on the internal test, time-independent validation, and external validation sets, respectively. The mother-based clinical features resulted in significant performance improvements for FGR assessment. The proposed hybrid model may be able to assess FGR with high accuracy. Furthermore, information complementation based on placental, fetal, and maternal features could also lead to better FGR assessment performance. Stage 2.

A hybrid statistical morphometry free-form deformation approach to 3D personalized foot-ankle models

Foot and ankle joint models are widely used in the biomechanics community for musculoskeletal and finite element analysis. However, personalizing a foot and ankle joint model is highly time-consuming in terms of medical image collection and data processing. This study aims to develop and evaluate a framework for constructing a comprehensive 3D foot model that integrates statistical shape modeling (SSM) with free-form deformation (FFD) of internal bones. The SSM component is derived from external foot surface scans (skin measurements) of 50 participants, utilizing principal component analysis (PCA) to capture the variance in foot shapes. The derived surface shapes from SSM then guide the FFD process to accurately reconstruct the internal bone structures. The workflow accuracy was established by comparing three model-generated foot models against corresponding skin and bone geometries manually segmented and not part of the original training set. We used the top ten principal components representing 85 % of the population variation to create the model. For prediction validation, the average Dice similarity coefficient, Hausdorff distance error, and root mean square error were 0.92 ± 0.01, 2.2 ± 0.19 mm, and 2.95 ± 0.23 mm for soft tissues, and 0.84 ± 0.03, 1.83 ± 0.1 mm, and 2.36 ± 0.12 mm for bones, respectively. This study presents an efficient approach for 3D personalized foot model reconstruction via SSM generation of the foot surface that informs bone reconstruction based on FFD. The proposed workflow is part of the open-source Musculoskeletal Atlas Project linked to OpenSim and makes it feasible to accurately generate foot models informed by population anatomy, and suitable for rigid body analysis and finite element simulation.

Creating an AI-powered platform for neurosurgery alongside a usability examination: Progressing towards minimally invasive robotics

Recent advancements in artificial intelligence have paved the way for promising applications in neurosurgery, aiming to improve patient outcomes while minimizing risks. This paper introduces a novel AI-driven system designed to assist neurosurgeons in accurately identifying and localizing brain tumors. Leveraging deep learning algorithms, the system was trained on a comprehensive dataset of brain MRI scans for segmentation and classification tasks. Evaluation of the system on an independent set of brain MRI scans revealed an average Dice similarity coefficient of 0.87, indicating high performance. Moreover, a user experience assessment conducted at the Department of Neurosurgery, University Hospital Ulm, demonstrated notable enhancements in accuracy, efficiency, and reduced cognitive load and stress levels among users. Notably, the system showcased adaptability across various surgical scenarios and provided personalized guidance to users. These findings underscore the potential of AI to augment the quality of neurosurgical interventions and ultimately enhance patient outcomes. Future endeavors will focus on integrating this system with robotic surgical tools to facilitate minimally invasive surgeries.

Creating an AI-powered platform for neurosurgery alongside a usability examination: Progressing towards minimally invasive robotics

Recent advancements in artificial intelligence have paved the way for promising applications in neurosurgery, aiming to improve patient outcomes while minimizing risks. This paper introduces a novel AI-driven system designed to assist neurosurgeons in accurately identifying and localizing brain tumors. Leveraging deep learning algorithms, the system was trained on a comprehensive dataset of brain MRI scans for segmentation and classification tasks. Evaluation of the system on an independent set of brain MRI scans revealed an average Dice similarity coefficient of 0.87, indicating high performance. Moreover, a user experience assessment conducted at the Department of Neurosurgery, University Hospital Ulm, demonstrated notable enhancements in accuracy, efficiency, and reduced cognitive load and stress levels among users. Notably, the system showcased adaptability across various surgical scenarios and provided personalized guidance to users. These findings underscore the potential of AI to augment the quality of neurosurgical interventions and ultimately enhance patient outcomes. Future endeavors will focus on integrating this system with robotic surgical tools to facilitate minimally invasive surgeries.

Evaluation and mitigation of deformable image registration uncertainties for MRI-guided adaptive radiotherapy.

We evaluate the performance of a deformable image registration (DIR) software package in registering abdominal magnetic resonance images (MRIs) and then develop a mechanical modeling method to mitigate detected DIR uncertainties. Three evaluation metrics, namely mean displacement to agreement (MDA), DICE similarity coefficient (DSC), and standard deviation of Jacobian determinants (STD-JD), are used to assess the multi-modality (MM), contour-consistency (CC), and image-intensity (II)-based DIR algorithms in the MIM software package, as well as an in-house developed, contour matching-based finite element method (CM-FEM). Furthermore, we develop a hybrid FEM registration technique to modify the displacement vector field of each MIM registration. The MIM and FEM registrations were evaluated on MRIs obtained from 10 abdominal cancer patients. One-tailed Wilcoxon-Mann-Whitney (WMW) tests were conducted to compare the MIM registrations with their FEM modifications. For the registrations performed with the MIM-CC, MIM-MM, MIM-II, and CM-FEM algorithms, their average MDAs are 0.62±0.27, 2.39±1.30, 3.07±2.42, 1.04±0.72mm, and average DSCs are 0.94±0.03, 0.80±0.12, 0.77±0.15, 0.90±0.11, respectively. The p-values of the WMW tests between the MIM registrations and their FEM modifications are less than 0.0084 for STD-JDs and greater than 0.87 for MDA and DSC. Among the three MIM DIR algorithms, MIM-CC shows the smallest errors in terms of MDA and DSC but exhibits significant Jacobian uncertainties in the interior regions of abdominal organs. The hybrid FEM technique effectively mitigates the Jacobian uncertainties in these regions.