Multi-atlas Label Fusion Research Articles

Automated analysis of low-field brain MRI in cerebral malaria.

A central challenge of medical imaging studies is to extract biomarkers that characterize disease pathology or outcomes. Modern automated approaches have found tremendous success in high-resolution, high-quality magnetic resonance images. These methods, however, may not translate to low-resolution images acquired on magnetic resonance imaging (MRI) scanners with lower magnetic field strength. In low-resource settings where low-field scanners are more common and there is a shortage of radiologists to manually interpret MRI scans, it is critical to develop automated methods that can augment or replace manual interpretation, while accommodating reduced image quality. We present a fully automated framework for translating radiological diagnostic criteria into image-based biomarkers, inspired by a project in which children with cerebral malaria (CM) were imaged using low-field 0.35 Tesla MRI. We integrate multiatlas label fusion, which leverages high-resolution images from another sample as prior spatial information, with parametric Gaussian hidden Markov models based on image intensities, to create a robust method for determining ventricular cerebrospinal fluid volume. We also propose normalized image intensity and texture measurements to determine the loss of gray-to-white matter tissue differentiation and sulcal effacement. These integrated biomarkers have excellent classification performance for determining severe brain swelling due toCM.

Vol2Brain: A New Online Pipeline for Whole Brain MRI Analysis.

Automatic and reliable quantitative tools for MR brain image analysis are a very valuable resource for both clinical and research environments. In the past few years, this field has experienced many advances with successful techniques based on label fusion and more recently deep learning. However, few of them have been specifically designed to provide a dense anatomical labeling at the multiscale level and to deal with brain anatomical alterations such as white matter lesions (WML). In this work, we present a fully automatic pipeline (vol2Brain) for whole brain segmentation and analysis, which densely labels (N > 100) the brain while being robust to the presence of WML. This new pipeline is an evolution of our previous volBrain pipeline that extends significantly the number of regions that can be analyzed. Our proposed method is based on a fast and multiscale multi-atlas label fusion technology with systematic error correction able to provide accurate volumetric information in a few minutes. We have deployed our new pipeline within our platform volBrain (www.volbrain.upv.es), which has been already demonstrated to be an efficient and effective way to share our technology with the users worldwide.

A robust discriminative multi-atlas label fusion method for hippocampus segmentation from MR image

Accurate and automatic segmentation of the hippocampus plays a vital role in the diagnosis and treatment of nervous system diseases. However, due to the anatomical variability of different subjects, the registered atlas images are not always perfectly aligned with the target image. This makes the segmentation of the hippocampus still face great challenges. In this paper, we propose a robust discriminative label fusion method under the multi-atlas framework. It is a patch embedding label fusion method based on conditional random field (CRF) model that integrates the metric learning and the graph cuts by an integrated formulation. Unlike most current label fusion methods with fixed (non-learning) distance metrics, a novel distance metric learning is presented to enhance discriminative observation and embed it into the unary potential function. In particular, Bayesian inference is utilized to extend a classic distance metric learning, in which large margin constraints are instead of pairwise constraints to obtain a more robust distance metric. And the pairwise homogeneity is fully considered in the spatial prior term based on classification labels and voxel intensity. The resulting integrated formulation is globally minimized by the efficient graph cuts algorithm. Further, sparse patch based method is utilized to polish the obtained segmentation results in label space. The proposed method is evaluated on IABA dataset and ADNI dataset for hippocampus segmentation. The Dice scores achieved by our method are 87.2%, 87.8%, 88.2% and 88.9% on left and right hippocampus on both two datasets, while the best Dice scores obtained by other methods are 86.0%, 86.9%, 86.8% and 88.0% on IABA dataset and ADNI dataset respectively. Experiments show that our approach achieves higher accuracy than state-of-the-art methods. We hope the proposed model can be transferred to combine with other promising distance measurement algorithms.

Brain-derived neurotrophic factor Val66Met variant on brain volumes in infants.

The brain-derived neurotrophic factor (BDNF) has many important roles in neurogenesis and neuronal health. BDNF is also involved in learning and memory. Individuals with BDNF-Val66Met variant (Met +) are at higher risk for neuropsychiatric disorders and have smaller hippocampi and amgydalae compared to those without this variant (Met-). Whether these smaller brain volumes are already present at birth is unknown and were evaluated. 66 newborn infants were genotyped for BDNF-rs6265 and had brain MRI scans. The T1-weighted images were automatically parcellated for hippocampus and amygdala, as well as the intracranial volume (ICV), total brain volume, total gray and white matter, using a multi-atlas label fusion method implemented in the MRICloud ( https://braingps.anatomyworks.org ). The segmented brain volumes were normalized to the ICV for group comparisons. The two infant groups were not different in their demographics and birth characteristics. However, compared to Met- infants, the Met + infants had smaller hippocampi (p = 0.013), smaller amygdalae (p = 0.041), and less steep age-related declines in total brain volume and % white matter volume. The smaller relative hippocampal and amygdala volumes in Met + infants suggest that the Met + genotype affected prenatal developmental processes. In addition, the slower age-dependent declines in the relative total brain and white matter volumes of the Met + group in this cross-sectional dataset suggest the BDNF-Val66Met variant might have an ongoing negative influence on the postnatal developmental processes.

In Vivo Image-Based 4D Modeling of Competent and Regurgitant Mitral Valve Dynamics.

In vivo characterization of mitral valve dynamics relies on image analysis algorithms that accurately reconstruct valve morphology and motion from clinical images. The goal of such algorithms is to provide patient-specific descriptions of both competent and regurgitant mitral valves, which can be used as input to biomechanical analyses and provide insights into the pathophysiology of diseases like ischemic mitral regurgitation (IMR). The goal is to generate accurate image-based representations of valve dynamics that visually and quantitatively capture normal and pathological valve function. We present a novel framework for 4D segmentation and geometric modeling of the mitral valve in real-time 3D echocardiography (rt-3DE), an imaging modality used for pre-operative surgical planning of mitral interventions. The framework integrates groupwise multi-atlas label fusion and template-based medial modeling with Kalman filtering to generate quantitatively descriptive and temporally consistent models of valve dynamics. The algorithm is evaluated on rt-3DE data series from 28 patients: 14 with normal mitral valve morphology and 14 with severe IMR. In these 28 data series that total 613 individual 3DE images, each 3D mitral valve segmentation is validated against manual tracing, and temporal consistency between segmentations is demonstrated. Automated 4D image analysis allows for reliable non-invasive modeling of the mitral valve over the cardiac cycle for comparison of annular and leaflet dynamics in pathological and normal mitral valves. Future studies can apply this algorithm to cardiovascular mechanics applications, including patient-specific strain estimation, fluid dynamics simulation, inverse finite element analysis, and risk stratification for surgical treatment.

Minimally interactive placenta segmentation from three-dimensional ultrasound images.

Purpose: Placental size in early pregnancy has been associated with important clinical outcomes, including fetal growth. However, extraction of placental size from three-dimensional ultrasound (3DUS) requires time-consuming interactive segmentation methods and is prone to user variability. We propose a semiautomated segmentation technique that requires minimal user input to robustly measure placental volume from 3DUS images. Approach: For semiautomated segmentation, a single, central 2D slice was manually annotated to initialize an automated multi-atlas label fusion (MALF) algorithm. The dataset consisted of 47 3DUS volumes obtained at 11 to 14 weeks in singleton pregnancies (28 anterior and 19 posterior). Twenty-six of these subjects were imaged twice within the same session. Dice overlap and surface distance were used to quantify the automated segmentation accuracy compared to expert manual segmentations. The mean placental volume measurements obtained by our method and VOCAL (virtual organ computer-aided analysis), a leading commercial semiautomated method, were compared to the manual reference set. The test-retest reliability was also assessed. Results: The overlap between our automated segmentation and manual (mean Dice: , median: 0.831) was within the range reported by other methods requiring extensive manual input. The average surface distance was . The correlation coefficient between test-retest volumes was , and the intraclass correlation was . Conclusions: MALF is a promising method that can allow accurate and reliable segmentation of the placenta with minimal user interaction. Further refinement of this technique may allow for placental biometry to be incorporated into clinical pregnancy surveillance.

PBrain: A novel pipeline for Parkinson related brain structure segmentation.

Parkinson is a very prevalent neurodegenerative disease impacting the life of millions of people worldwide. Although its cause remains unknown, its functional and structural analysis is fundamental to advance in the search of a cure or symptomatic treatment. The automatic segmentation of deep brain structures related to Parkinson`s disease could be beneficial for the follow up and treatment planning. Unfortunately, there is not broadly available segmentation software to automatically measure Parkinson related structures. In this paper, we present a novel pipeline to segment three deep brain structures related to Parkinson's disease (substantia nigra, subthalamic nucleus and red nucleus). The proposed method is based on the multi-atlas label fusion technology that works on standard and high-resolution T2-weighted images. The proposed method also includes as post-processing a new neural network-based error correction step to minimize systematic segmentation errors. The proposed method has been compared to other state-of-the-art methods showing competitive results in terms of accuracy and execution time.

Multi-atlas label fusion with random local binary pattern features: Application to hippocampus segmentation

Automatic and reliable segmentation of the hippocampus from magnetic resonance (MR) brain images is extremely important in a variety of neuroimage studies. To improve the hippocampus segmentation performance, a local binary pattern based feature extraction method is developed for machine learning based multi-atlas hippocampus segmentation. Under the framework of multi-atlas image segmentation (MAIS), a set of selected atlases are registered to images to be segmented using a non-linear image registration algorithm. The registered atlases are then used as training data to build linear regression models for segmenting the images based on the image features, referred to as random local binary pattern (RLBP), extracted using a novel image feature extraction method. The RLBP based MAIS algorithm has been validated for segmenting hippocampus based on a data set of 135 T1 MR images which are from the Alzheimer’s Disease Neuroimaging Initiative database (adni.loni.usc.edu). By using manual segmentation labels produced by experienced tracers as the standard of truth, six segmentation evaluation metrics were used to evaluate the image segmentation results by comparing automatic segmentation results with the manual segmentation labels. We further computed Cohen’s d effect size to investigate the sensitivity of each segmenting method in detecting volumetric differences of the hippocampus between different groups of subjects. The evaluation results showed that our method was competitive to state-of-the-art label fusion methods in terms of accuracy. Hippocampal volumetric analysis showed that the proposed RLBP method performed well in detecting the volumetric differences of the hippocampus between groups of Alzheimer’s disease patients, mild cognitive impairment subjects, and normal controls. These results have demonstrated that the RLBP based multi-atlas image segmentation method could facilitate efficient and accurate extraction of the hippocampus and may help predict Alzheimer’s disease. The codes of the proposed method is available (https://www.nitrc.org/frs/?group_id=1242).

An adaptive probabilistic atlas for anomalous brain segmentation in MR images.

Automated segmentation of brain structures (objects) in MR three-dimensional (3D) images for quantitative analysis has been a challenge and probabilistic atlases (PAs) are among the most well-succeeded approaches. However, the existing models do not adapt to possible object anomalies due to the presence of a disease or a surgical procedure. Post-processing operation does not solve the problem, for example, tissue classification to detect and remove such anomalies inside the resulting segmentation mask, because segmentation errors on healthy tissues cannot be fixed. Such anomalies very often alter the shape and texture of the brain structures, making them different from the appearance of the model. In this paper, we present an effective and efficient adaptive probabilistic atlas, named AdaPro, to circumvent the problem and evaluate it on a challenging task - the segmentation of the left hemisphere, right hemisphere, and cerebellum, without pons and medulla, in 3D MR-T1 brain images of Epilepsy patients. This task is challenging due to temporal lobe resections, artifacts, and the absence of contrast in some parts between the structures of interest. In AdaPro, we first build one probabilistic atlas per object of interest from a training set with normal 3D images and the corresponding 3D object masks. Second, we incorporate a texture classifier based on convex optimization which dynamically indicates the regions of the target 3D image where the PAs (shape constraints) should be further adapted. This strategy is mathematically more elegant and avoids problems with post-processing. Third, we add a new object-based delineation algorithm based on combinatorial optimization and diffusion filtering. AdaPro can then be used to locate and delineate the objects in the coordinate space of the atlas or of the test image. We also compare AdaPro with three other state-of-the-art methods: an statistical shape model based on synergistic object search and delineation, and two methods based on multi-atlas label fusion (MALF). We evaluate the methods quantitatively on 3D MR-T1 brain images of 2T and 3T from epilepsy patients, before and after temporal lobe resections, and on the template and native coordinate spaces. The results show that AdaPro is considerably faster and consistently more accurate than the baselines with statistical significance in both coordinate spaces. AdaPro can be used as a fast and effective step for brain tissue segmentation and it can also be easily extended to segment subcortical brain structures. By choice of its components, probabilistic atlas, texture classifier, and delineation algorithm, it can also be extended to other organs and imaging modalities.

A Multi-Atlas Label Fusion Tool for Neonatal Brain MRI Parcellation and Quantification.

Structure-by-structure analysis, in which the brain magnetic resonance imaging (MRI) is parcellated based on its anatomical units, is widely used to investigate chronological changes in morphology or signal intensity during normal development, as well as to identify the alterations seen in various diseases or conditions. The multi-atlas label fusion (MALF) method is considered a highly accurate parcellation approach, and anticipated for clinical application to quantitatively evaluate early developmental processes. However, the current MALF methods, which are designed for neonatal brain segmentations, are not widely available. In this study, we developed a T1-weighted, neonatal, multi-atlas repository and integrated it into the MALF-based brain segmentation tools in the cloud-based platform, MRICloud. The cloud platform ensures users instant access to the advanced MALF tool for neonatal brains, with no software or installation requirements for the client. The Web platform by braingps.mricloud.org will eliminate the dependence on a particular operating system (eg, Windows, Macintosh, or Linux) and the requirement for high computational performance of the user's computers. The MALF-based, fully automated, image parcellation could achieve excellent agreement with manual parcellation, and the whole and regional brain volumes quantified through this method demonstrated developmental trajectories comparable to those from a previous publication. This solution will make the latest MALF tools readily available to users, with minimum barriers, and will expedite and accelerate advancements in developmental neuroscience research, neonatology, and pediatric neuroradiology.

Reliability-based robust multi-atlas label fusion for brain MRI segmentation.

Label fusion is one of the key steps in multi-atlas based segmentation of structural magnetic resonance (MR) images. Although a number of label fusion methods have been developed in literature, most of those existing methods fail to address two important problems, i.e., (1) compared with boundary voxels, inner voxels usually have higher probability (or reliability) to be correctly segmented, and (2) voxels with high segmentation reliability (after initial segmentation) can help refine the segmentation of voxels with low segmentation reliability in the target image. To this end, we propose a general reliability-based robust label fusion framework for multi-atlas based MR image segmentation. Specifically, in the first step, we perform initial segmentation for MR images using a conventional multi-atlas label fusion method. In the second step, for each voxel in the target image, we define two kinds of reliability, including the label reliability and spatial reliability that are estimated based on the soft label and spatial information from the initial segmentation, respectively. Finally, we employ voxels with high label-spatial reliability to help refine the label fusion process of those with low reliability in the target image. We incorporate our proposed framework into four well-known label fusion methods, including locally-weighted voting (LWV), non-local mean patch-based method (PBM), joint label fusion (JLF) and sparse patch-based method (SPBM), and obtain four novel label-spatial reliability-based label fusion approaches (called ls-LWV, ls-PBM, ls-JLF, and ls-SPBM). We validate the proposed methods in segmenting ROIs of brain MR images from the NIREP, LONI-LPBA40 and ADNI datasets. The experimental results demonstrate that our label-spatial reliability-based label fusion methods outperform the state-of-the-art methods in multi-atlas image segmentation.

Semi-automated Image Segmentation of the Midsystolic Left Ventricular Mitral Valve Complex in Ischemic Mitral Regurgitation.

Ischemic mitral regurgitation (IMR) is primarily a left ventricular disease in which the mitral valve is dysfunctional due to ventricular remodeling after myocardial infarction. Current automated methods have focused on analyzing the mitral valve and left ventricle independently. While these methods have allowed for valuable insights into mechanisms of IMR, they do not fully integrate pathological features of the left ventricle and mitral valve. Thus, there is an unmet need to develop an automated segmentation algorithm for the left ventricular mitral valve complex, in order to allow for a more comprehensive study of this disease. The objective of this study is to generate and evaluate segmentations of the left ventricular mitral valve complex in pre-operative 3D transesophageal echocardiography using multi-atlas label fusion. These patient-specific segmentations could enable future statistical shape analysis for clinical outcome prediction and surgical risk stratification. In this study, we demonstrate a preliminary segmentation pipeline that achieves an average Dice coefficient of 0.78 ± 0.06.

Brain structure segmentation in the presence of multiple sclerosis lesions.

Intensity-based multi-atlas segmentation strategies have shown to be particularly successful in segmenting brain images of healthy subjects. However, in the same way as most of the methods in the state of the art, their performance tends to be affected by the presence of MRI visible lesions, such as those found in multiple sclerosis (MS) patients. Here, we present an approach to minimize the effect of the abnormal lesion intensities on multi-atlas segmentation. We propose a new voxel/patch correspondence model for intensity-based multi-atlas label fusion strategies that leads to more accurate similarity measures, having a key role in the final brain segmentation. We present the theory of this model and integrate it into two well-known fusion strategies: Non-local Spatial STAPLE (NLSS) and Joint Label Fusion (JLF). The experiments performed show that our proposal improves the segmentation performance of the lesion areas. The results indicate a mean Dice Similarity Coefficient (DSC) improvement of 1.96% for NLSS (3.29% inside and 0.79% around the lesion masks) and, an improvement of 2.06% for JLF (2.31% inside and 1.42% around lesions). Furthermore, we show that, with the proposed strategy, the well-established preprocessing step of lesion filling can be disregarded, obtaining similar or even more accurate segmentation results.

基于U-Net的多图谱标签融合算法

基于U-Net的多图谱标签融合算法

Integrating Semi-supervised and Supervised Learning Methods for Label Fusion in Multi-Atlas Based Image Segmentation.

A novel label fusion method for multi-atlas based image segmentation method is developed by integrating semi-supervised and supervised machine learning techniques. Particularly, our method is developed in a pattern recognition based multi-atlas label fusion framework. We build random forests classification models for each image voxel to be segmented based on its corresponding image patches of atlas images that have been registered to the image to be segmented. The voxelwise random forests classification models are then applied to the image to be segmented to obtain a probabilistic segmentation map. Finally, a semi-supervised label propagation method is adapted to refine the probabilistic segmentation map by propagating its reliable voxelwise segmentation labels, taking into consideration consistency of local and global image appearance of the image to be segmented. The proposed method has been evaluated for segmenting the hippocampus in MR images and compared with alternative machine learning based multi-atlas based image segmentation methods. The experiment results have demonstrated that our method could obtain competitive segmentation performance (average Dice index > 0.88), compared with alternative multi-atlas based image segmentation methods under comparison. Source codes of the methods under comparison are publicly available at www.nitrc.org/frs/?group_id=1242.

Sparse patch‐based representation with combined information of atlas for multi‐atlas label fusion

To obtain a higher accuracy in the multi-atlas patch-based label fusion method, it is essential to have the accurate similarity measure of selected patches. In this study, the authors propose a new sparse patch-based representation method using a local binary texture (LBT) in the atlas image and atlas label information for the multi-atlas label fusion. In the proposed method, the intensity information in a patch is converted into a LBT which is then combined with the labels of corresponding patches from the atlas to form an atom of a dictionary. The initial labels of target images are estimated through a rough segmentation. The voxel in a patch to be labelled is also constructed as a vector similar to the atom. The voxel vector is then modelled as a sparse linear combination of the atoms in the dictionary. Experimental results on two MR brain data sets demonstrated that the proposed method is efficient in the segmentation which can achieve competitive performance compared with the state-of-the-art methods.

Neural multi-atlas label fusion: Application to cardiac MR images.

Multi-atlas segmentation approach is one of the most widely-used image segmentation techniques in biomedical applications. There are two major challenges in this category of methods, i.e., atlas selection and label fusion. In this paper, we propose a novel multi-atlas segmentation method that formulates multi-atlas segmentation in a deep learning framework for better solving these challenges. The proposed method, dubbed deep fusion net (DFN), is a deep architecture that integrates a feature extraction subnet and a non-local patch-based label fusion (NL-PLF) subnet in a single network. The network parameters are learned by end-to-end training for automatically learning deep features that enable optimal performance in a NL-PLF framework. The learned deep features are further utilized in defining a similarity measure for atlas selection. By evaluating on two public cardiac MR datasets of SATA-13 and LV-09 for left ventricle segmentation, our approach achieved 0.833 in averaged Dice metric (ADM) on SATA-13 dataset and 0.95 in ADM for epicardium segmentation on LV-09 dataset, comparing favorably with the other automatic left ventricle segmentation methods. We also tested our approach on Cardiac Atlas Project (CAP) testing set of MICCAI 2013 SATA Segmentation Challenge, and our method achieved 0.815 in ADM, ranking highest at the time of writing.

Fast anatomy segmentation by combining coarse scale multi-atlas label fusion with fine scale corrective learning

Deformable registration based multi-atlas segmentation has been successfully applied in a broad range of anatomy segmentation applications. However, the excellent performance comes with a high computational burden due to the requirement for deformable image registration and voxel-wise label fusion. To address this problem, we investigate the role of corrective learning (Wang et al., 2011) in speeding up multi-atlas segmentation. We propose to combine multi-atlas segmentation with corrective learning in a multi-scale analysis fashion for faster speeds. First, multi-atlas segmentation is applied in a low spatial resolution. After resampling the segmentation result back to the native image space, learning-based error correction is applied to correct systematic errors due to performing multi-atlas segmentation in a low spatial resolution. In cardiac CT and brain MR segmentation experiments, we show that applying multi-atlas segmentation in a coarse scale followed by learning-based error correction in the native space can substantially reduce the overall computational cost, with only modest or no sacrificing segmentation accuracy.

Multi-atlas segmentation of the hydrocephalus brain using an adaptive ventricle atlas.

Normal pressure hydrocephalus (NPH) is a brain disorder caused by disruption of the flow of cerebrospinal fluid (CSF). The dementia-like symptoms of NPH are often mistakenly attributed to Alzheimer's disease. However, if correctly diagnosed, NPH patients can potentially be treated and their symptoms reversed through surgery. Observing the dilated ventricles through magnetic resonance imaging (MRI) is one element in diagnosing NPH. Diagnostic accuracy therefore benefits from accurate, automatic parcellation of the ventricular system into its sub-compartments. We present an improvement to a whole brain segmentation approach designed for subjects with enlarged and deformed ventricles. Our method incorporates an adaptive ventricle atlas from an NPH-atlas-based segmentation as a prior and uses a more robust relaxation scheme for the multi-atlas label fusion approach that accurately labels the four sub-compartments of the ventricular system. We validated our method on NPH patients, demonstrating improvement over state-of-the-art segmentation techniques.

Automatic Multi-Organ Segmentation on Abdominal CT With Dense V-Networks.

Automatic segmentation of abdominal anatomy on computed tomography (CT) images can support diagnosis, treatment planning, and treatment delivery workflows. Segmentation methods using statistical models and multi-atlas label fusion (MALF) require inter-subject image registrations, which are challenging for abdominal images, but alternative methods without registration have not yet achieved higher accuracy for most abdominal organs. We present a registration-free deep-learning-based segmentation algorithm for eight organs that are relevant for navigation in endoscopic pancreatic and biliary procedures, including the pancreas, the gastrointestinal tract (esophagus, stomach, and duodenum) and surrounding organs (liver, spleen, left kidney, and gallbladder). We directly compared the segmentation accuracy of the proposed method to the existing deep learning and MALF methods in a cross-validation on a multi-centre data set with 90 subjects. The proposed method yielded significantly higher Dice scores for all organs and lower mean absolute distances for most organs, including Dice scores of 0.78 versus 0.71, 0.74, and 0.74 for the pancreas, 0.90 versus 0.85, 0.87, and 0.83 for the stomach, and 0.76 versus 0.68, 0.69, and 0.66 for the esophagus. We conclude that the deep-learning-based segmentation represents a registration-free method for multi-organ abdominal CT segmentation whose accuracy can surpass current methods, potentially supporting image-guided navigation in gastrointestinal endoscopy procedures.