Automatic Tumor Segmentation Research Articles

A convolutional attention model for predicting response to chemo-immunotherapy from ultrasound elastography in mouse tumor models

BackgroundIn the era of personalized cancer treatment, understanding the intrinsic heterogeneity of tumors is crucial. Despite some patients responding favorably to a particular treatment, others may not benefit, leading to the varied efficacy observed in standard therapies. This study focuses on the prediction of tumor response to chemo-immunotherapy, exploring the potential of tumor mechanics and medical imaging as predictive biomarkers. We have extensively studied “desmoplastic” tumors, characterized by a dense and very stiff stroma, which presents a substantial challenge for treatment. The increased stiffness of such tumors can be restored through pharmacological intervention with mechanotherapeutics.MethodsWe developed a deep learning methodology based on shear wave elastography (SWE) images, which involved a convolutional neural network (CNN) model enhanced with attention modules. The model was developed and evaluated as a predictive biomarker in the setting of detecting responsive, stable, and non-responsive tumors to chemotherapy, immunotherapy, or the combination, following mechanotherapeutics administration. A dataset of 1365 SWE images was obtained from 630 tumors from our previous experiments and used to train and successfully evaluate our methodology. SWE in combination with deep learning models, has demonstrated promising results in disease diagnosis and tumor classification but their potential for predicting tumor response prior to therapy is not yet fully realized.ResultsWe present strong evidence that integrating SWE-derived biomarkers with automatic tumor segmentation algorithms enables accurate tumor detection and prediction of therapeutic outcomes.ConclusionsThis approach can enhance personalized cancer treatment by providing non-invasive, reliable predictions of therapeutic outcomes.

Automatic detection and segmentation of lesions in 18 F-FDG PET/CT imaging of patients with Hodgkin lymphoma using 3D dense U-Net.

The accuracy of automatic tumor segmentation in PET/computed tomography (PET/CT) images is crucial for the effective treatment and monitoring of Hodgkin lymphoma. This study aims to address the challenges faced by certain segmentation algorithms in accurately differentiating lymphoma from normal organ uptakes due to PET image resolution and tumor heterogeneity. Variants of the encoder-decoder architectures are state-of-the-art models for image segmentation. Among these kinds of architectures, U-Net is one of the most famous and predominant for medical image segmentation. In this study, we propose a fully automatic approach for Hodgkin lymphoma segmentation that combines U-Net and DenseNet architectures to reduce network loss for very small lesions, which is trained using the Tversky loss function. The hypothesis is that the fusion of these two deep learning models can improve the accuracy and robustness of Hodgkin lymphoma segmentation. A dataset with 141 samples was used to train our proposed network. Also, to test and evaluate the proposed network, we allocated two separate datasets of 20 samples. We achieved 0.759 as the mean Dice similarity coefficient with a median value of 0.767, and interquartile range (0.647-0.837). A good agreement was observed between the ground truth of test images against the predicted volume with precision and recall scores of 0.798 and 0.763, respectively. This study demonstrates that the integration of U-Net and DenseNet architectures, along with the Tversky loss function, can significantly enhance the accuracy of Hodgkin lymphoma segmentation in PET/CT images compared to similar studies.

Applications of artificial intelligence in interventional oncology: An up-to-date review of the literature.

Interventional oncology provides image-guided therapies, including transarterial tumor embolization and percutaneous tumor ablation, for malignant tumors in a minimally invasive manner. As in other medical fields, the application of artificial intelligence (AI) in interventional oncology has garnered significant attention. This narrative review describes the current state of AI applications in interventional oncology based on recent literature. A literature search revealed a rapid increase in the number of studies relevant to this topic recently. Investigators have attempted to use AI for various tasks, including automatic segmentation of organs, tumors, and treatment areas; treatment simulation; improvement of intraprocedural image quality; prediction of treatment outcomes; and detection of post-treatment recurrence. Among these, the AI-based prediction of treatment outcomes has been the most studied. Various deep and conventional machine learning algorithms have been proposed for these tasks. Radiomics has often been incorporated into prediction and detection models. Current literature suggests that AI is potentially useful in various aspects of interventional oncology, from treatment planning to post-treatment follow-up. However, most AI-based methods discussed in this review are still at the research stage, and few have been implemented in clinical practice. To achieve widespread adoption of AI technologies in interventional oncology procedures, further research on their reliability and clinical utility is necessary. Nevertheless, considering the rapid research progress in this field, various AI technologies will be integrated into interventional oncology practices in the near future.

Automated segmentation and source prediction of bone tumors using ConvNeXtv2 Fusion based Mask R-CNN to identify lung cancer metastasis

Lung cancer, which is a leading cause of cancer-related deaths worldwide, frequently metastasizes to the bones, significantly diminishing patients’ quality of life and complicating treatment strategies. This study aims to develop an advanced 3D Mask R-CNN model, enhanced with the ConvNeXt-V2 backbone, for the automatic segmentation of bone tumors and identification of lung cancer metastasis to support personalized treatment planning. Data were collected from two hospitals: Center A (106 patients) and Center B (265 patients). The data from Center B were used for training, while Center A’s dataset served as an independent external validation set. High-resolution CT scans with 1 mm slice thickness and no inter-slice gaps were utilized, and the regions of interest (ROIs) were manually segmented and validated by two experienced radiologists. The 3D Mask R-CNN model achieved a Dice Similarity Coefficient (DSC) of 0.856, a sensitivity of 0.921, and a specificity of 0.961 on the training set. On the test set, it achieved a DSC of 0.849, a sensitivity of 0.911, and a specificity of 0.931. For the classification task, the model attained an AUC of 0.865, an accuracy of 0.866, a sensitivity of 0.875, and a specificity of 0.835 on the training set, while achieving an AUC of 0.842, an accuracy of 0.836, a sensitivity of 0.847, and a specificity of 0.819 on the test set. These results highlight the model’s potential in improving the accuracy of bone tumor segmentation and lung cancer metastasis detection, paving the way for enhanced diagnostic workflows and personalized treatment strategies in clinical oncology.

Deep learning with uncertainty estimation for automatic tumor segmentation in PET/CT of head and neck cancers: impact of model complexity, image processing and augmentation

Objective. Target volumes for radiotherapy are usually contoured manually, which can be time-consuming and prone to inter- and intra-observer variability. Automatic contouring by convolutional neural networks (CNN) can be fast and consistent but may produce unrealistic contours or miss relevant structures. We evaluate approaches for increasing the quality and assessing the uncertainty of CNN-generated contours of head and neck cancers with PET/CT as input. Approach. Two patient cohorts with head and neck squamous cell carcinoma and baseline 18F-fluorodeoxyglucose positron emission tomography and computed tomography images (FDG-PET/CT) were collected retrospectively from two centers. The union of manual contours of the gross primary tumor and involved nodes was used to train CNN models for generating automatic contours. The impact of image preprocessing, image augmentation, transfer learning and CNN complexity, architecture, and dimension (2D or 3D) on model performance and generalizability across centers was evaluated. A Monte Carlo dropout technique was used to quantify and visualize the uncertainty of the automatic contours. Main results. CNN models provided contours with good overlap with the manually contoured ground truth (median Dice Similarity Coefficient: 0.75–0.77), consistent with reported inter-observer variations and previous auto-contouring studies. Image augmentation and model dimension, rather than model complexity, architecture, or advanced image preprocessing, had the largest impact on model performance and cross-center generalizability. Transfer learning on a limited number of patients from a separate center increased model generalizability without decreasing model performance on the original training cohort. High model uncertainty was associated with false positive and false negative voxels as well as low Dice coefficients. Significance. High quality automatic contours can be obtained using deep learning architectures that are not overly complex. Uncertainty estimation of the predicted contours shows potential for highlighting regions of the contour requiring manual revision or flagging segmentations requiring manual inspection and intervention.

One-click annotation to improve segmentation by a convolutional neural network for PET images of head and neck cancer patients

A convolutional neural network (CNN) can be used to perform fully automatic tumor segmentation from the positron emission tomography (PET) images of head and neck cancer patients but the predictions often contain false positive segmentation caused by the high concentration of the tracer substance in the human brain. A potential solution would be a one-click annotation in which a user points the location of the tumor by clicking the image. This information can then be given either directly to a CNN or an algorithm that fixes its predictions. In this article, we compare the fully automatic segmentation to four semi-automatic approaches by using 962 transaxial slices collected from the PET images of 100 head and neck cancer patients. According to our results, a semi-automatic segmentation method with information about the center of the tumor performs the best with a median Dice score of 0.708.

Automated brain tumor diagnostics: Empowering neuro-oncology with deep learning-based MRI image analysis.

Brain tumors, characterized by the uncontrolled growth of abnormal cells, pose a significant threat to human health. Early detection is crucial for successful treatment and improved patient outcomes. Magnetic Resonance Imaging (MRI) is the primary diagnostic tool for brain tumors, providing detailed visualizations of the brain's intricate structures. However, the complexity and variability of tumor shapes and locations often challenge physicians in achieving accurate tumor segmentation on MRI images. Precise tumor segmentation is essential for effective treatment planning and prognosis. To address this challenge, we propose a novel hybrid deep learning technique, Convolutional Neural Network and ResNeXt101 (ConvNet-ResNeXt101), for automated tumor segmentation and classification. Our approach commences with data acquisition from the BRATS 2020 dataset, a benchmark collection of MRI images with corresponding tumor segmentations. Next, we employ batch normalization to smooth and enhance the collected data, followed by feature extraction using the AlexNet model. This involves extracting features based on tumor shape, position, shape, and surface characteristics. To select the most informative features for effective segmentation, we utilize an advanced meta-heuristics algorithm called Advanced Whale Optimization (AWO). AWO mimics the hunting behavior of humpback whales to iteratively search for the optimal feature subset. With the selected features, we perform image segmentation using the ConvNet-ResNeXt101 model. This deep learning architecture combines the strengths of ConvNet and ResNeXt101, a type of ConvNet with aggregated residual connections. Finally, we apply the same ConvNet-ResNeXt101 model for tumor classification, categorizing the segmented tumor into distinct types. Our experiments demonstrate the superior performance of our proposed ConvNet-ResNeXt101 model compared to existing approaches, achieving an accuracy of 99.27% for the tumor core class with a minimum learning elapsed time of 0.53 s.

Renal tumor segmentation, visualization, and segmentation confidence using ensembles of neural networks in patients undergoing surgical resection.

To develop an automatic segmentation model for solid renal tumors on contrast-enhanced CTs and to visualize segmentation with associated confidence to promote clinical applicability. The training dataset included solid renal tumor patients from two tertiary centers undergoing surgical resection and receiving CT in the corticomedullary or nephrogenic contrast media (CM) phase. Manual tumor segmentation was performed on all axial CT slices serving as reference standard for automatic segmentations. Independent testing was performed on the publicly available KiTS 2019 dataset. Ensembles of neural networks (ENN, DeepLabV3) were used for automatic renal tumor segmentation, and their performance was quantified with DICE score. ENN average foreground entropy measured segmentation confidence (binary: successful segmentation with DICE score > 0.8 versus inadequate segmentation ≤ 0.8). N = 639/n = 210 patients were included in the training and independent test dataset. Datasets were comparable regarding age and sex (p > 0.05), while renal tumors in the training dataset were larger and more frequently benign (p < 0.01). In the internal test dataset, the ENN model yielded a median DICE score = 0.84 (IQR: 0.62-0.97, corticomedullary) and 0.86 (IQR: 0.77-0.96, nephrogenic CM phase), and the segmentation confidence an AUC = 0.89 (sensitivity = 0.86; specificity = 0.77). In the independent test dataset, the ENN model achieved a median DICE score = 0.84 (IQR: 0.71-0.97, corticomedullary CM phase); and segmentation confidence an accuracy = 0.84 (sensitivity = 0.86 and specificity = 0.81). ENN segmentations were visualized with color-coded voxelwise tumor probabilities and thresholds superimposed on clinical CT images. ENN-based renal tumor segmentation robustly performs in external test data and might aid in renal tumor classification and treatment planning. Ensembles of neural networks (ENN) models could automatically segment renal tumors on routine CTs, enabling and standardizing downstream image analyses and treatment planning. Providing confidence measures and segmentation overlays on images can lower the threshold for clinical ENN implementation. Ensembles of neural networks (ENN) segmentation is visualized by color-coded voxelwise tumor probabilities and thresholds. ENN provided a high segmentation accuracy in internal testing and in an independent external test dataset. ENN models provide measures of segmentation confidence which can robustly discriminate between successful and inadequate segmentations.

Retraction Note: Automatic segmentation and classification of liver tumor from CT image using feature difference and SVM based classifier-soft computing technique

Retraction Note: Automatic segmentation and classification of liver tumor from CT image using feature difference and SVM based classifier-soft computing technique

Integrating a deep neural network and Transformer architecture for the automatic segmentation and survival prediction in cervical cancer.

Automated tumor segmentation and survival prediction are critical to clinical diagnosis and treatment. This study aimed to develop deep-learning models for automatic tumor segmentation and survival prediction in magnetic resonance imaging (MRI) of cervical cancer (CC) by combining deep neural networks and Transformer architecture. This study included 406 patients with CC, each with comprehensive clinical information and MRI scans. We randomly divided patients into training, validation, and independent test cohorts in a 6:2:2 ratio. During the model training, we employed two architecture types: one being a hybrid model combining convolutional neural network (CNN) and ransformer (CoTr) and one of pure CNNs. For survival prediction, the hybrid model combined tumor image features extracted by segmentation models with clinical information. The performance of the segmentation models was evaluated using the Dice similarity coefficient (DSC) and 95% Hausdorff distance (HD95). The performance of the survival models was assessed using the concordance index. The CoTr model performed well in both contrast-enhanced T1-weighted (ceT1W) and T2-weighted (T2W) imaging segmentation tasks, with average DSCs of 0.827 and 0.820, respectively, which outperformed other the CNN models such as U-Net (DSC: 0.807 and 0.808), attention U-Net (DSC: 0.814 and 0.811), and V-Net (DSC: 0.805 and 0.807). For survival prediction, the proposed deep-learning model significantly outperformed traditional methods, yielding a concordance index of 0.732. Moreover, it effectively divided patients into low-risk and high-risk groups for disease progression (P<0.001). Combining Transformer architecture with a CNN can improve MRI tumor segmentation, and this deep-learning model excelled in the survival prediction of patients with CC as compared to traditional methods.

A Dynamic Context Encoder Network for Liver Tumor Segmentation.

Accurate segmentation of liver tumor regions in medical images is of great significance for clinical diagnosis and the planning of surgical treatments. Recent advancements in machine learning have shown that convolutional neural networks are powerful in such image processing while largely reducing human labor. However, the variable shape, fuzzy boundary, and discontinuous tumor region of liver tumors in medical images bring great challenges to accurate segmentation. The feature extraction capability of a neural network can be improved by expanding its architecture, but it inevitably demands more computing resources in training and hyperparameter tuning. This study presents a Dynamic Context Encoder Network (DCE-Net), which incorporates multiple new modules, such as the Involution Layer, Dynamic Residual Module, Context Extraction Module, and Channel Attention Gates, for feature extraction and enhancement. In the experiment, we used a liver tumor CT dataset of LiTS2017 to train and test the DCE-Net for liver tumor segmentation. The experimental results showed that the four evaluation indexes of the method, precision, recall, dice, and AUC, were 0.8961, 0.9711, 0.9270, and 0.9875, respectively. Furthermore, our ablation study reported that the accuracy and training efficiency of our network were markedly superior to the networks without involution or dynamic residual modules. Therefore, the DCE-Net proposed in this study has great potential for automatic segmentation of liver lesion tumors in the clinical diagnostic environment.

A Multi-Center, Multi-Parametric MRI Dataset of Primary and Secondary Brain Tumors

Brain metastases (BMs) and high-grade gliomas (HGGs) are the most common and aggressive types of malignant brain tumors in adults, with often poor prognosis and short survival. As their clinical symptoms and image appearances on conventional magnetic resonance imaging (MRI) can be astonishingly similar, their accurate differentiation based solely on clinical and radiological information can be very challenging, particularly for “cancer of unknown primary”, where no systemic malignancy is known or found. Non-invasive multiparametric MRI and radiomics offer the potential to identify these distinct biological properties, aiding in the characterization and differentiation of HGGs and BMs. However, there is a scarcity of publicly available multi-origin brain tumor imaging data for tumor characterization. In this paper, we introduce a multi-center, multi-origin brain tumor MRI (MOTUM) imaging dataset obtained from 67 patients: 29 with high-grade gliomas, 20 with lung metastases, 10 with breast metastases, 2 with gastric metastasis, 4 with ovarian metastasis, and 2 with melanoma metastasis. This dataset includes anonymized DICOM files alongside processed FLAIR, T1-weighted, contrast-enhanced T1-weighted, T2-weighted sequences images, segmentation masks of two tumor regions, and clinical data. Our data-sharing initiative is to support the benchmarking of automated tumor segmentation, multi-modal machine learning, and disease differentiation of multi-origin brain tumors in a multi-center setting.

Attention-guided context asymmetric fusion networks for the liver tumor segmentation of computed tomography images.

Liver tumor segmentation based on medical imaging is playing an increasingly important role in liver tumor research and individualized therapeutic decision-making. However, it remains a challenging in terms of the accuracy of automatic segmentation of liver tumors. Therefore, we aimed to develop a novel deep neural network for improving the results from the automatic segmentation of liver tumors. This paper proposes the attention-guided context asymmetric fusion network (AGCAF-Net), combining attention guidance and fusion context modules on the basis of a residual neural network for the automatic segmentation of liver tumors. According to the attention-guided context block (AGCB), the feature map is first divided into multiple small blocks, the local correlation between features is calculated, and then the global nonlocal fusion module (GNFM) is used to obtain the global information between pixels. Additionally, the context pyramid module (CPM) and asymmetric semantic fusion module (AFM) are used to obtain multiscale features and resolve the feature mismatch during feature fusion, respectively. Finally, we used the liver tumor segmentation benchmark (LiTS) dataset to verify the efficiency of our designed network. Our results showed that AGCAF-Net with AFM and CPM is effective in improving the accuracy of liver tumor segmentation, with the Dice coefficient increasing from 82.5% to 84.1%. The segmentation results of liver tumors by AGCAF-Net were superior to those of several state-of-the-art U-net methods, with a Dice coefficient of 84.1%, a sensitivity of 91.7%, and an average symmetric surface distance of 3.52. AGCAF-Net can obtain better matched and accurate segmentation in liver tumor segmentation, thus effectively improving the accuracy of liver tumor segmentation.

Resolving spatial response heterogeneity in glioblastoma.

Spatial intratumoral heterogeneity poses a significant challenge for accurate response assessment in glioblastoma. Multimodal imaging coupled with advanced image analysis has the potential to unravel this response heterogeneity. Based on automated tumor segmentation and longitudinal registration with follow-up imaging, we categorized contrast-enhancing voxels of 61 patients with suspected recurrence of glioblastoma into either true tumor progression (TP) or pseudoprogression (PsP). To allow the unbiased analysis of semantically related image regions, adjacent voxels with similar values of cerebral blood volume (CBV), FET-PET, and contrast-enhanced T1w were automatically grouped into supervoxels. We then extracted first-order statistics as well as texture features from each supervoxel. With these features, a Random Forest classifier was trained and validated employing a 10-fold cross-validation scheme. For model evaluation, the area under the receiver operating curve, as well as classification performance metrics were calculated. Our image analysis pipeline enabled reliable spatial assessment of tumor response. The predictive model reached an accuracy of 80.0% and a macro-weighted AUC of 0.875, which takes class imbalance into account, in the hold-out samples from cross-validation on supervoxel level. Analysis of feature importances confirmed the significant role of FET-PET-derived features. Accordingly, TP- and PsP-labeled supervoxels differed significantly in their 10th and 90th percentile, as well as the median of tumor-to-background normalized FET-PET. However, CBV- and T1c-related features also relevantly contributed to the model's performance. Disentangling the intratumoral heterogeneity in glioblastoma holds immense promise for advancing precise local response evaluation and thereby also informing more personalized and localized treatment strategies in the future.

An automated two-stage approach to kidney and tumor segmentation in CT imaging.

The incidence of kidney tumors is progressively increasing each year. The precision of segmentation for kidney tumors is crucial for diagnosis and treatment. To enhance accuracy and reduce manual involvement, propose a deep learning-based method for the automatic segmentation of kidneys and kidney tumors in CT images. The proposed method comprises two parts: object detection and segmentation. We first use a model to detect the position of the kidney, then narrow the segmentation range, and finally use an attentional recurrent residual convolutional network for segmentation. Our model achieved a kidney dice score of 0.951 and a tumor dice score of 0.895 on the KiTS19 dataset. Experimental results show that our model significantly improves the accuracy of kidney and kidney tumor segmentation and outperforms other advanced methods. The proposed method provides an efficient and automatic solution for accurately segmenting kidneys and renal tumors on CT images. Additionally, this study can assist radiologists in assessing patients' conditions and making informed treatment decisions.

Automated segmentation of liver tumors from computed tomographic scans

The precision of liver tumor segmentation heavily depends on the doctor's expertise, hence it is required to produce an algorithm for automatic liver tumor segmentation to reduce the manual intervention in assessing liver disease identification. We propose a CNN-based UNet architecture designed to segment liver tumors from CT images of size 128×128. In this model, modifications were made to the encoder, decoder, and bridge paths to enhance feature extraction efficiency. The performance of the modified UNet was evaluated against an existing segmentation method using the same CT image size. The comparison focused on the Dice similarity coefficient and accuracy. Our proposed method demonstrated a high Dice similarity coefficient of 75.37 % and an accuracy of 99.75 % on the 3Dircadb dataset. These results indicate that our modified UNet achieved superior segmentation metrics compared to state-of-the-art methods, showcasing its effectiveness in liver tumor segmentation.

Deep Learning-Based Segmentation and Risk Stratification for Gastrointestinal Stromal Tumors in Transabdominal Ultrasound Imaging.

To develop a deep neural network system for the automatic segmentation and risk stratification prediction of gastrointestinal stromal tumors (GISTs). A total of 980 ultrasound (US) images from 245 GIST patients were retrospectively collected. These images were randomly divided (6:2:2) into a training set, a validation set, and an internal test set. Additionally, 188 US images from 47 prospective GIST patients were collected to evaluate the segmentation and diagnostic performance of the model. Five deep learning-based segmentation networks, namely, UNet, FCN, DeepLabV3+, Swin Transformer, and SegNeXt, were employed, along with the ResNet 18 classification network, to select the most suitable network combination. The performance of the segmentation models was evaluated using metrics such as the intersection over union (IoU), Dice similarity coefficient (DSC), recall, and precision. The classification performance was assessed based on accuracy and the area under the receiver operating characteristic curve (AUROC). Among the compared models, SegNeXt-ResNet18 exhibited the best segmentation and classification performance. On the internal test set, the proposed model achieved IoU, DSC, precision, and recall values of 82.1, 90.2, 91.7, and 88.8%, respectively. The accuracy and AUC for GIST risk prediction were 87.4 and 92.0%, respectively. On the external test set, the segmentation models exhibited IoU, DSC, precision, and recall values of 81.0, 89.5, 92.8, and 86.4%, respectively. The accuracy and AUC for GIST risk prediction were 86.7 and 92.5%, respectively. This two-stage SegNeXt-ResNet18 model achieves automatic segmentation and risk stratification prediction for GISTs and demonstrates excellent segmentation and classification performance.

Towards consistency in pediatric brain tumor measurements: Challenges, solutions, and the role of artificial intelligence-based segmentation.

MR imaging is central to the assessment of tumor burden and changes over time in neuro-oncology. Several response assessment guidelines have been set forth by the Response Assessment in Pediatric Neuro-Oncology (RAPNO) working groups in different tumor histologies; however, the visual delineation of tumor components using MRIs is not always straightforward, and complexities not currently addressed by these criteria can introduce inter- and intra-observer variability in manual assessments. Differentiation of non-enhancing tumors from peritumoral edema, mild enhancement from absence of enhancement, and various cystic components can be challenging; particularly given a lack of sufficient and uniform imaging protocols in clinical practice. Automated tumor segmentation with artificial intelligence (AI) may be able to provide more objective delineations, but rely on accurate and consistent training data created manually (ground truth). Herein, this paper reviews existing challenges and potential solutions to identifying and defining subregions of pediatric brain tumors (PBTs) that are not explicitly addressed by current guidelines. The goal is to assert the importance of defining and adopting criteria for addressing these challenges, as it will be critical to achieving standardized tumor measurements and reproducible response assessment in PBTs, ultimately leading to more precise outcome metrics and accurate comparisons among clinical studies.

Automatic segmentation of femoral tumors by nnU-net

BackgroundMetastatic femoral tumors may lead to pathological fractures during daily activities. A CT-based finite element analysis of a patient's femurs was shown to assist orthopedic surgeons in making informed decisions about the risk of fracture and the need for a prophylactic fixation. Improving the accuracy of such analyses ruqires an automatic and accurate segmentation of the tumors and their automatic inclusion in the finite element model. We present herein a deep learning algorithm (nnU-Net) to automatically segment lytic tumors within the femur. MethodA dataset consisting of fifty CT scans of patients with manually annotated femoral tumors was created. Forty of them, chosen randomly, were used for training the nnU-Net, while the remaining ten CT scans were used for testing. The deep learning model's performance was compared to two experienced radiologists. FindingsThe proposed algorithm outperformed the current state-of-the-art solutions, achieving dice similarity scores of 0.67 and 0.68 on the test data when compared to two experienced radiologists, while the dice similarity score for inter-individual variability between the radiologists was 0.73. InterpretationThe automatic algorithm may segment lytic femoral tumors in CT scans as accurately as experienced radiologists with similar dice similarity scores. The influence of the realistic tumors inclusion in an autonomous finite element algorithm is presented in (Rachmil et al., "The Influence of Femoral Lytic Tumors Segmentation on Autonomous Finite Element Analyses", Clinical Biomechanics, 112, paper 106192, (2024)).

3DSN-Net: A 3-D Scale-Aware convNet With Nonlocal Context Guidance for Kidney and Tumor Segmentation From CT Volumes.

Automatic kidney and tumor segmentation from CT volumes is a critical prerequisite/tool for diagnosis and surgical treatment (such as partial nephrectomy). However, it remains a particularly challenging issue as kidneys and tumors often exhibit large-scale variations, irregular shapes, and blurring boundaries. We propose a novel 3-D network to comprehensively tackle these problems; we call it 3DSN-Net. Compared with existing solutions, it has two compelling characteristics. First, with a new scale-aware feature extraction (SAFE) module, the proposed 3DSN-Net is capable of adaptively selecting appropriate receptive fields according to the sizes of targets instead of indiscriminately enlarging them, which is particularly essential for improving the segmentation accuracy of the tumor with large scale variation. Second, we propose a novel yet efficient nonlocal context guidance (NCG) mechanism to capture global dependencies to tackle irregular shapes and blurring boundaries of kidneys and tumors. Instead of directly harnessing a 3-D NCG mechanism, which makes the number of parameters exponentially increase and hence the network difficult to be trained under limited training data, we develop a 2.5D NCG mechanism based on projections of feature cubes, which achieves a tradeoff between segmentation accuracy and network complexity. We extensively evaluate the proposed 3DSN-Net on the famous KiTS dataset with many challenging kidney and tumor cases. Experimental results demonstrate our solution consistently outperforms state-of-the-art 3-D networks after being equipped with scale aware and NCG mechanisms, particularly for tumor segmentation.