Baseline U-Net Research Articles

BRAVE-NET: Fully Automated Arterial Brain Vessel Segmentation in Patients With Cerebrovascular Disease.

Introduction: Arterial brain vessel assessment is crucial for the diagnostic process in patients with cerebrovascular disease. Non-invasive neuroimaging techniques, such as time-of-flight (TOF) magnetic resonance angiography (MRA) imaging are applied in the clinical routine to depict arteries. They are, however, only visually assessed. Fully automated vessel segmentation integrated into the clinical routine could facilitate the time-critical diagnosis of vessel abnormalities and might facilitate the identification of valuable biomarkers for cerebrovascular events. In the present work, we developed and validated a new deep learning model for vessel segmentation, coined BRAVE-NET, on a large aggregated dataset of patients with cerebrovascular diseases.Methods: BRAVE-NET is a multiscale 3-D convolutional neural network (CNN) model developed on a dataset of 264 patients from three different studies enrolling patients with cerebrovascular diseases. A context path, dually capturing high- and low-resolution volumes, and deep supervision were implemented. The BRAVE-NET model was compared to a baseline Unet model and variants with only context paths and deep supervision, respectively. The models were developed and validated using high-quality manual labels as ground truth. Next to precision and recall, the performance was assessed quantitatively by Dice coefficient (DSC); average Hausdorff distance (AVD); 95-percentile Hausdorff distance (95HD); and via visual qualitative rating.Results: The BRAVE-NET performance surpassed the other models for arterial brain vessel segmentation with a DSC = 0.931, AVD = 0.165, and 95HD = 29.153. The BRAVE-NET model was also the most resistant toward false labelings as revealed by the visual analysis. The performance improvement is primarily attributed to the integration of the multiscaling context path into the 3-D Unet and to a lesser extent to the deep supervision architectural component.Discussion: We present a new state-of-the-art of arterial brain vessel segmentation tailored to cerebrovascular pathology. We provide an extensive experimental validation of the model using a large aggregated dataset encompassing a large variability of cerebrovascular disease and an external set of healthy volunteers. The framework provides the technological foundation for improving the clinical workflow and can serve as a biomarker extraction tool in cerebrovascular diseases.

Automatic Mapping of Landslides by the ResU-Net

Massive landslides over large regions can be triggered by heavy rainfalls or major seismic events. Mapping regional landslides quickly is important for disaster mitigation. In recent years, deep learning methods have been successfully applied in many fields, including landslide automatic identification. In this work, we proposed a deep learning approach, the ResU-Net, to map regional landslides automatically. This method and a baseline model (U-Net) were collectively tested in Tianshui city, Gansu province, where a heavy rainfall triggered more than 10,000 landslides in July 2013. All models were performed on a 3-band (near infrared, red, and green) GeoEye-1 image with a spatial resolution of 0.5 m. At such a fine spatial resolution, the study area is spatially heterogeneous. The tested study area is 128 km2, 80% of which was used to train models and the remaining 20% was used to validate accuracy of the models. This proposed ResU-Net achieved higher accuracy than the baseline U-Net model in this mountain region, where F1 improved by 0.09. Compared with the U-Net model, this proposed model (ResU-Net) performs better in discriminating landslides from bare floodplains along river valleys and unplanted terraces. By incorporating environmental information, this ResU-Net may also be applied to other landslide mapping, such as landslide susceptibility and hazard assessment.

Automated fibroglandular tissue segmentation in breast MRI using generative adversarial networks

Fibroglandular tissue (FGT) segmentation is a crucial step for quantitative analysis of background parenchymal enhancement (BPE) in magnetic resonance imaging (MRI), which is useful for breast cancer risk assessment. In this study, we develop an automated deep learning method based on a generative adversarial network (GAN) to identify the FGT region in MRI volumes and evaluate its impact on a specific clinical application. The GAN consists of an improved U-Net as a generator to generate FGT candidate areas and a patch deep convolutional neural network (DCNN) as a discriminator to evaluate the authenticity of the synthetic FGT region. The proposed method has two improvements compared to the classical U-Net: (1) the improved U-Net is designed to extract more features of the FGT region for a more accurate description of the FGT region; (2) a patch DCNN is designed for discriminating the authenticity of the FGT region generated by the improved U-Net, which makes the segmentation result more stable and accurate. A dataset of 100 three-dimensional (3D) bilateral breast MRI scans from 100 patients (aged 22–78 years) was used in this study with Institutional Review Board (IRB) approval. 3D hand-segmented FGT areas for all breasts were provided as a reference standard. Five-fold cross-validation was used in training and testing of the models. The Dice similarity coefficient (DSC) and Jaccard index (JI) values were evaluated to measure the segmentation accuracy. The previous method using classical U-Net was used as a baseline in this study. In the five partitions of the cross-validation set, the GAN achieved DSC and JI values of 87.0 ± 7.0% and 77.6 ± 10.1%, respectively, while the corresponding values obtained through by the baseline method were 81.1 ± 8.7% and 69.0 ± 11.3%, respectively. The proposed method is significantly superior to the previous method using U-Net. The FGT segmentation impacted the BPE quantification application in the following manner: the correlation coefficients between the quantified BPE value and BI-RADS BPE categories provided by the radiologist were 0.46 ± 0.15 (best: 0.63) based on GAN segmented FGT areas, while the corresponding correlation coefficients were 0.41 ± 0.16 (best: 0.60) based on baseline U-Net segmented FGT areas. BPE can be quantified better using the FGT areas segmented by the proposed GAN model than using the FGT areas segmented by the baseline U-Net.

Automatic Pancreas Segmentation Using Coarse-Scaled 2D Model of Deep Learning: Usefulness of Data Augmentation and Deep U-Net

Combinations of data augmentation methods and deep learning architectures for automatic pancreas segmentation on CT images are proposed and evaluated. Images from a public CT dataset of pancreas segmentation were used to evaluate the models. Baseline U-net and deep U-net were chosen for the deep learning models of pancreas segmentation. Methods of data augmentation included conventional methods, mixup, and random image cropping and patching (RICAP). Ten combinations of the deep learning models and the data augmentation methods were evaluated. Four-fold cross validation was performed to train and evaluate these models with data augmentation methods. The dice similarity coefficient (DSC) was calculated between automatic segmentation results and manually annotated labels and these were visually assessed by two radiologists. The performance of the deep U-net was better than that of the baseline U-net with mean DSC of 0.703–0.789 and 0.686–0.748, respectively. In both baseline U-net and deep U-net, the methods with data augmentation performed better than methods with no data augmentation, and mixup and RICAP were more useful than the conventional method. The best mean DSC was obtained using a combination of deep U-net, mixup, and RICAP, and the two radiologists scored the results from this model as good or perfect in 76 and 74 of the 82 cases.

Contrast Phase Classification with a Generative Adversarial Network.

Dynamic contrast enhanced computed tomography (CT) is an imaging technique that provides critical information on the relationship of vascular structure and dynamics in the context of underlying anatomy. A key challenge for image processing with contrast enhanced CT is that phase discrepancies are latent in different tissues due to contrast protocols, vascular dynamics, and metabolism variance. Previous studies with deep learning frameworks have been proposed for classifying contrast enhancement with networks inspired by computer vision. Here, we revisit the challenge in the context of whole abdomen contrast enhanced CTs. To capture and compensate for the complex contrast changes, we propose a novel discriminator in the form of a multi-domain disentangled representation learning network. The goal of this network is to learn an intermediate representation that separates contrast enhancement from anatomy and enables classification of images with varying contrast time. Briefly, our unpaired contrast disentangling GAN(CD-GAN) Discriminator follows the ResNet architecture to classify a CT scan from different enhancement phases. To evaluate the approach, we trained the enhancement phase classifier on 21060 slices from two clinical cohorts of 230 subjects. The scans were manually labeled with three independent enhancement phases (non-contrast, portal venous and delayed). Testing was performed on 9100 slices from 30 independent subjects who had been imaged with CT scans from all contrast phases. Performance was quantified in terms of the multi-class normalized confusion matrix. The proposed network significantly improved correspondence over baseline UNet, ResNet50 and StarGAN's performance of accuracy scores 0.54. 0.55, 0.62 and 0.91, respectively (p-value<0.0001 paired t-test for ResNet versus CD-GAN). The proposed discriminator from the disentangled network presents a promising technique that may allow deeper modeling of dynamic imaging against patient specific anatomies.

Segmentation of mouse skin layers in optical coherence tomography image data using deep convolutional neural networks.

Optical coherence tomography (OCT) enables the non-invasive acquisition of high-resolution three-dimensional cross-sectional images at micrometer scale and is mainly used in the field of ophthalmology for diagnosis as well as monitoring of eye diseases. Also in other areas, such as dermatology, OCT is already well established. Due to its non-invasive nature, OCT is also employed for research studies involving animal models. Manual evaluation of OCT images of animal models is a challenging task due to the lack of imaging standards and the varying anatomy among models. In this paper, we present a deep learning algorithm for the automatic segmentation of several layers of mouse skin in OCT image data using a deep convolutional neural network (CNN). The architecture of our CNN is based on the U-net and is modified by densely connected convolutions. We compared our adapted CNN with our previous algorithm, a combination of a random forest classification and a graph-based refinement, and a baseline U-net. The results showed that, on average, our proposed CNN outperformed our previous algorithm and the baseline U-net. In addition, a reduction of outliers could be observed through the use of densely connected convolutions.

Model-free prostate cancer segmentation from dynamic contrast-enhanced MRI with recurrent convolutional networks: A feasibility study

Dynamic contrast enhanced (DCE) magnetic resonance imaging (MRI) is a method of temporal imaging that is commonly used to aid in prostate cancer (PCa) diagnosis and staging. Typically, machine learning models designed for the segmentation and detection of PCa will use an engineered scalar image called Ktrans to summarize the information in the DCE time-series images. This work proposes a new model that amalgamates the U-net and the convGRU neural network architectures for the purpose of interpreting DCE time-series in a temporal and spatial basis for segmenting PCa in MR images. Ultimately, experiments show that the proposed model using the DCE time-series images can outperform a baseline U-net segmentation model using Ktrans. However, when other types of scalar MR images are considered by the models, no significant advantage is observed for the proposed model.