Segmentation Of White Matter Tracts Research Articles

Fibre orientation atlas guided rapid segmentation of white matter tracts.

Fibre tract delineation from diffusion magnetic resonance imaging (MRI) is a valuable clinical tool for neurosurgical planning and navigation, as well as in research neuroimaging pipelines. Several popular methods are used for this task, each with different strengths and weaknesses making them more or less suited to different contexts. For neurosurgical imaging, priorities include ease of use, computational efficiency, robustness to pathology and ability to generalise to new tracts of interest. Many existing methods use streamline tractography, which may require expert neuroimaging operators for setting parameters and delineating anatomical regions of interest, or suffer from as a lack of generalisability to clinical scans involving deforming tumours and other pathologies. More recently, data-driven approaches including deep-learning segmentation models and streamline clustering methods have improved reproducibility and automation, although they can require large amounts of training data and/or computationally intensive image processing at the point of application. We describe an atlas-based direct tract mapping technique called 'tractfinder', utilising tract-specific location and orientation priors. Our aim was to develop a clinically practical method avoiding streamline tractography at the point of application while utilising prior anatomical knowledge derived from only 10-20 training samples. Requiring few training samples allows emphasis to be placed on producing high quality, neuro-anatomically accurate training data, and enables rapid adaptation to new tracts of interest. Avoiding streamline tractography at the point of application reduces computational time, false positives and vulnerabilities to pathology such as tumour deformations or oedema. Carefully filtered training streamlines and track orientation distribution mapping are used to construct tract specific orientation and spatial probability atlases in standard space. Atlases are then transformed to target subject space using affine registration and compared with the subject's voxel-wise fibre orientation distribution data using a mathematical measure of distribution overlap, resulting in a map of the tract's likely spatial distribution. This work includes extensive performance evaluation and comparison with benchmark techniques, including streamline tractography and the deep-learning method TractSeg, in two publicly available healthy diffusion MRI datasets (from TractoInferno and the Human Connectome Project) in addition to a clinical dataset comprising paediatric and adult brain tumour scans. Tract segmentation results display high agreement with established techniques while requiring less than 3 min on average when applied to a new subject. Results also display higher robustness than compared methods when faced with clinical scans featuring brain tumours and resections. As well as describing and evaluating a novel proposed tract delineation technique, this work continues the discussion on the challenges surrounding the white matter segmentation task, including issues of anatomical definitions and the use of quantitative segmentation comparison metrics.

Assessing informative tract segmentation and nTMS for pre-operative planning

BackgroundDeep learning-based (DL) methods are the best-performing methods for white matter tract segmentation in anatomically healthy subjects. However, tract annotations are variable or absent in clinical data and manual annotations are especially difficult in patients with tumors where normal anatomy may be distorted. Direct cortical and subcortical stimulation is the gold standard ground truth to determine the cortical and sub-cortical lo- cation of motor-eloquent areas intra-operatively. Nonetheless, this technique is invasive, prolongs the surgical procedure, and may cause patient fatigue. Navigated Transcranial Magnetic Stimulation (nTMS) has a well-established correlation to direct cortical stimulation for motor mapping and the added advantage of being able to be acquired pre-operatively. New methodIn this work, we evaluate the feasibility of using nTMS motor responses as a method to assess corticospinal tract (CST) binary masks and estimated uncertainty generated by a DL-based tract segmentation in patients with diffuse gliomas. ResultsOur results show CST binary masks have a high overlap coefficient (OC) with nTMS response masks. A strong negative correlation is found between estimated uncertainty and nTMS response mask distance to the CST binary mask. Comparison with existing methodsWe compare our approach (UncSeg) with the state-of-the-art TractSeg in terms of OC between the CST binary masks and nTMS response masks. ConclusionsIn this study, we demonstrate that estimated uncertainty from UncSeg is a good measure of the agreement between the CST binary masks and nTMS response masks distance to the CST binary mask boundary.

A comparison of manual and automated neural architecture search for white matter tract segmentation

Segmentation of white matter tracts in diffusion magnetic resonance images is an important first step in many imaging studies of the brain in health and disease. Similar to medical image segmentation in general, a popular approach to white matter tract segmentation is to use U-Net based artificial neural network architectures. Despite many suggested improvements to the U-Net architecture in recent years, there is a lack of systematic comparison of architectural variants for white matter tract segmentation. In this paper, we evaluate multiple U-Net based architectures specifically for this purpose. We compare the results of these networks to those achieved by our own various architecture changes, as well as to new U-Net architectures designed automatically via neural architecture search (NAS). To the best of our knowledge, this is the first study to systematically compare multiple U-Net based architectures for white matter tract segmentation, and the first to use NAS. We find that the recently proposed medical imaging segmentation network UNet3+ slightly outperforms the current state of the art for white matter tract segmentation, and achieves a notably better mean Dice score for segmentation of the fornix (+ 0.01 and + 0.006 mean Dice increase for left and right fornix respectively), a tract that the current state of the art model struggles to segment. UNet3+ also outperforms the current state of the art when little training data is available. Additionally, manual architecture search found that a minor segmentation improvement is observed when an additional, deeper layer is added to the U-shape of UNet3+. However, all networks, including those designed via NAS, achieve similar results, suggesting that there may be benefit in exploring networks that deviate from the general U-Net paradigm.

Volumetric segmentation of white matter tracts with label embedding

Convolutional neural networks have achieved state-of-the-art performance for white matter (WM) tract segmentation based on diffusion magnetic resonance imaging (dMRI). However, the segmentation can still be difficult for challenging WM tracts with thin bodies or complicated shapes; the segmentation is even more problematic in challenging scenarios with reduced data quality or domain shift between training and test data, which can be easily encountered in clinical settings. In this work, we seek to improve the segmentation of WM tracts, especially for challenging WM tracts in challenging scenarios. In particular, our method is based on volumetric WM tract segmentation, where voxels are directly labeled without performing tractography. To improve the segmentation, we exploit the characteristics of WM tracts that different tracts can cross or overlap and revise the network design accordingly. Specifically, because multiple tracts can co-exist in a voxel, we hypothesize that the different tract labels can be correlated. The tract labels at a single voxel are concatenated as a label vector, the length of which is the number of tract labels. Due to the tract correlation, this label vector can be projected into a lower-dimensional space—referred to as the embedded space—for each voxel, which allows the segmentation network to solve a simpler problem. By predicting the coordinate in the embedded space for the tracts at each voxel and subsequently mapping the coordinate to the label vector with a reconstruction module, the segmentation result can be achieved. To facilitate the learning of the embedded space, an auxiliary label reconstruction loss is integrated with the segmentation accuracy loss during network training, and network training and inference are end-to-end. Our method was validated on two dMRI datasets under various settings. The results show that the proposed method improves the accuracy of WM tract segmentation, and the improvement is more prominent for challenging tracts in challenging scenarios.

Utilizing the TractSeg Tool for Automatic Corticospinal Tract Segmentation in Patients With Brain Pathology.

Purpose: White-matter tract segmentation in patients with brain pathology can guide surgical planning and can be used for tissue integrity assessment. Recently, TractSeg was proposed for automatic tract segmentation in healthy subjects. The aim of this study was to assess the use of TractSeg for corticospinal-tract (CST) segmentation in a large cohort of patients with brain pathology and to evaluate its consistency in repeated measurements. Methods: A total of 649 diffusion-tensor-imaging scans were included, of them: 625 patients and 24 scans from 12 healthy controls (scanned twice for consistency assessment). Manual CST labeling was performed in all cases, and by 2 raters for the healthy subjects. Segmentation results were evaluated based on the Dice score. In order to evaluate consistency in repeated measurements, volume, Fractional Anisotropy (FA), and Mean Diffusivity (MD) values were extracted and correlated for the manual versus automatic methods. Results: For the automatic CST segmentation Dice scores of 0.63 and 0.64 for the training and testing datasets were obtained. Higher consistency between measurements was detected for the automatic segmentation, with between measurements correlations of volume = 0.92/0.65, MD = 0.94/0.75 for the automatic versus manual segmentation. Conclusions: The TractSeg method enables automatic CST segmentation in patients with brain pathology. Superior measurements consistency was detected for the automatic in comparison to manual fiber segmentation, which indicates an advantage when using this method for clinical and longitudinal studies.

Volumetric white matter tract segmentation with nested self-supervised learning using sequential pretext tasks.

White matter(WM) tract segmentation based on diffusion magnetic resonance imaging(dMRI) provides an important tool for the analysis of brain development, function, and disease. Deep learning based methods of WM tract segmentation have been proposed, which greatly improve the accuracy of the segmentation. However, the training of the deep networks usually requires a large number of manual delineations of WM tracts, which can be especially difficult to obtain and unavailable in many scenarios. Therefore, in this work, we explore how to perform deep learning based WM tract segmentation when annotated training data is scarce. To this end, we seek to exploit the abundant unannotated dMRI data in the self-supervised learning framework. From the unannotated data, knowledge about image context can be learned with pretext tasks that do not require manual annotations. Specifically, a deep network can be pretrained for the pretext task, and the knowledge learned from the pretext task is then transferred to the subsequent WM tract segmentation task with only a small number of annotated scans via fine-tuning. We explore two designs of pretext tasks that are related to WM tracts. The first pretext task predicts the density map of fiber streamlines, which are representations of generic WM pathways, and the training data can be obtained automatically with tractography. The second pretext task learns to mimic the results of registration-based WM tract segmentation, which, although inaccurate, is more relevant to WM tract segmentation and provides a good target for learning context knowledge. Then, we combine the two pretext tasks and develop a nested self-supervised learning strategy. In the nested self-supervised learning strategy, the first pretext task provides initial knowledge for the second pretext task, and the knowledge learned from the second pretext task with the initial knowledge is transferred to the target WM tract segmentation task via fine-tuning. To evaluate the proposed method, experiments were performed on brain dMRI scans from the Human Connectome Project dataset with various experimental settings. The results show that the proposed method improves the performance of WM tract segmentation when tract annotations are scarce.

Cortically constrained shape recognition: Automated white matter tract segmentation validated in the pediatric brain.

Manual segmentation of white matter (WM) bundles requires extensive training and is prohibitively labor-intensive for large-scale studies. Automated segmentation methods are necessary in order to eliminate operator dependency and to enable reproducible studies. Significant changes in the WM landscape throughout childhood require flexible methods to capture the variance across the span of brain development. Here, we describe a novel automated segmentation tool called Cortically Constrained Shape Recognition (CCSR), which combines two complementary approaches: (1) anatomical connectivity priors based on FreeSurfer-derived regions of interest and (2) shape priors based on 3-dimensional streamline bundle atlases applied using RecoBundles. We tested the performance and repeatability of this approach by comparing volume and diffusion metrics of the main language WM tracts that were both manually and automatically segmented in a pediatric cohort acquired at the UCSF Dyslexia Center (n = 59; 25 females; average age: 11 ± 2; range: 7-14). The CCSR approach showed high agreement with the expert manual segmentations: across all tracts, the spatial overlap between tract volumes showed an average Dice Similarity Coefficient (DSC) of 0.76, and the fractional anisotropy (FA) on average had a Lin's Concordance Correlation Coefficient (CCC) of 0.81. The CCSR's repeatability in a subset of this cohort achieved a DSC of 0.92 on average across all tracts. This novel automated segmentation approach is a promising tool for reproducible large-scale tractography analyses in pediatric populations and particularly for the quantitative assessment of structural connections underlying various clinical presentations in neurodevelopmental disorders.

Deep white matter analysis (DeepWMA): Fast and consistent tractography segmentation.

White matter tract segmentation, i.e. identifying tractography fibers (streamline trajectories) belonging to anatomically meaningful fiber tracts, is an essential step to enable tract quantification and visualization. In this study, we present a deep learning tractography segmentation method (DeepWMA) that allows fast and consistent identification of 54 major deep white matter fiber tracts from the whole brain. We create a large-scale training tractography dataset of 1 million labeled fiber samples, and we propose a novel 2D multi-channel feature descriptor (FiberMap) that encodes spatial coordinates of points along each fiber. We learn a convolutional neural network (CNN) fiber classification model based on FiberMap and obtain a high fiber classification accuracy of 90.99% on the training tractography data with ground truth fiber labels. Then, the method is evaluated on a test dataset of 597 diffusion MRI scans from six independently acquired populations across genders, the lifespan (1 day - 82 years), and different health conditions (healthy control, neuropsychiatric disorders, and brain tumor patients). We perform comparisons with two state-of-the-art tract segmentation methods. Experimental results show that our method obtains a highly consistent tract segmentation result, where on average over 99% of the fiber tracts are successfully identified across all subjects under study, most importantly, including neonates and patients with space-occupying brain tumors. We also demonstrate good generalization of the method to tractography data from multiple different fiber tracking methods. The proposed method leverages deep learning techniques and provides a fast and efficient tool for brain white matter segmentation in large diffusion MRI tractography datasets.

Deep white matter analysis: fast, consistent tractography segmentation across populations and dMRI acquisitions.

We present a deep learning tractography segmentation method that allows fast and consistent white matter fiber tract identification across healthy and disease populations and across multiple diffusion MRI (dMRI) acquisitions. We create a large-scale training tractography dataset of 1 million labeled fiber samples (54 anatomical tracts are included). To discriminate between fibers from different tracts, we propose a novel 2D multi-channel feature descriptor (FiberMap) that encodes spatial coordinates of points along each fiber. We learn a CNN tract classification model based on FiberMap and obtain a high tract classification accuracy of 90.99%. The method is evaluated on a test dataset of 374 dMRI scans from three independently acquired populations across health conditions (healthy control, neuropsychiatric disorders, and brain tumor patients). We perform comparisons with two state-of-the-art white matter tract segmentation methods. Experimental results show that our method obtains a highly consistent segmentation result, where over 99% of the fiber tracts are successfully detected across all subjects under study, most importantly, including patients with space occupying brain tumors. The proposed method leverages deep learning techniques and provides a much faster and more efficient tool for large data analysis than methods using traditional machine learning techniques.

TractSeg - Fast and accurate white matter tract segmentation

The individual course of white matter fiber tracts is an important factor for analysis of white matter characteristics in healthy and diseased brains. Diffusion-weighted MRI tractography in combination with region-based or clustering-based selection of streamlines is a unique combination of tools which enables the in-vivo delineation and analysis of anatomically well-known tracts. This, however, currently requires complex, computationally intensive processing pipelines which take a lot of time to set up. TractSeg is a novel convolutional neural network-based approach that directly segments tracts in the field of fiber orientation distribution function (fODF) peaks without using tractography, image registration or parcellation. We demonstrate that the proposed approach is much faster than existing methods while providing unprecedented accuracy, using a population of 105 subjects from the Human Connectome Project. We also show initial evidence that TractSeg is able to generalize to differently acquired data sets for most of the bundles. The code and data are openly available at https://github.com/MIC-DKFZ/TractSeg/ and https://doi.org/10.5281/zenodo.1088277, respectively.

White Matter Tract Segmentation as Multiple Linear Assignment Problems

Diffusion magnetic resonance imaging (dMRI) allows to reconstruct the main pathways of axons within the white matter of the brain as a set of polylines, called streamlines. The set of streamlines of the whole brain is called the tractogram. Organizing tractograms into anatomically meaningful structures, called tracts, is known as the tract segmentation problem, with important applications to neurosurgical planning and tractometry. Automatic tract segmentation techniques can be unsupervised or supervised. A common criticism of unsupervised methods, like clustering, is that there is no guarantee to obtain anatomically meaningful tracts. In this work, we focus on supervised tract segmentation, which is driven by prior knowledge from anatomical atlases or from examples, i.e., segmented tracts from different subjects. We present a supervised tract segmentation method that segments a given tract of interest in the tractogram of a new subject using multiple examples as prior information. Our proposed tract segmentation method is based on the idea of streamline correspondence i.e., on finding corresponding streamlines across different tractograms. In the literature, streamline correspondence has been addressed with the nearest neighbor (NN) strategy. Differently, here we formulate the problem of streamline correspondence as a linear assignment problem (LAP), which is a cornerstone of combinatorial optimization. With respect to the NN, the LAP introduces a constraint of one-to-one correspondence between streamlines, that forces the correspondences to follow the local anatomical differences between the example and the target tract, neglected by the NN. In the proposed solution, we combined the Jonker-Volgenant algorithm (LAPJV) for solving the LAP together with an efficient way of computing the nearest neighbors of a streamline, which massively reduces the total amount of computations needed to segment a tract. Moreover, we propose a ranking strategy to merge correspondences coming from different examples. We validate the proposed method on tractograms generated from the human connectome project (HCP) dataset and compare the segmentations with the NN method and the ROI-based method. The results show that LAP-based segmentation is vastly more accurate than ROI-based segmentation and substantially more accurate than the NN strategy. We provide a Free/OpenSource implementation of the proposed method.

Addressing the path-length-dependency confound in white matter tract segmentation.

We derive the Iterative Confidence Enhancement of Tractography (ICE-T) framework to address the problem of path-length dependency (PLD), the streamline dispersivity confound inherent to probabilistic tractography methods. We show that PLD can arise as a non-linear effect, compounded by tissue complexity, and therefore cannot be handled using linear correction methods. ICE-T is an easy-to-implement framework that acts as a wrapper around most probabilistic streamline tractography methods, iteratively growing the tractography seed regions. Tract networks segmented with ICE-T can subsequently be delineated with a global threshold, even from a single-voxel seed. We investigated ICE-T performance using ex vivo pig-brain datasets where true positives were known via in vivo tracers, and applied the derived ICE-T parameters to a human in vivo dataset. We examined the parameter space of ICE-T: the number of streamlines emitted per voxel, and a threshold applied at each iteration. As few as 20 streamlines per seed-voxel, and a robust range of ICE-T thresholds, were shown to sufficiently segment the desired tract network. Outside this range, the tract network either approximated the complete white-matter compartment (too low threshold) or failed to propagate through complex regions (too high threshold). The parameters were shown to be generalizable across seed regions. With ICE-T, the degree of both near-seed flare due to false positives, and of distal false negatives, are decreased when compared with thresholded probabilistic tractography without ICE-T. Since ICE-T only addresses PLD, the degree of remaining false-positives and false-negatives will consequently be mainly attributable to the particular tractography method employed. Given the benefits offered by ICE-T, we would suggest that future studies consider this or a similar approach when using tractography to provide tract segmentations for tract based analysis, or for brain network analysis.

Improved segmentation of white matter tracts with adaptive Riemannian metrics.

We present a novel geodesic approach to segmentation of white matter tracts from diffusion tensor imaging (DTI). Compared to deterministic and stochastic tractography, geodesic approaches treat the geometry of the brain white matter as a manifold, often using the inverse tensor field as a Riemannian metric. The white matter pathways are then inferred from the resulting geodesics, which have the desirable property that they tend to follow the main eigenvectors of the tensors, yet still have the flexibility to deviate from these directions when it results in lower costs. While this makes such methods more robust to noise, the choice of Riemannian metric in these methods is ad hoc. A serious drawback of current geodesic methods is that geodesics tend to deviate from the major eigenvectors in high-curvature areas in order to achieve the shortest path. In this paper we propose a method for learning an adaptive Riemannian metric from the DTI data, where the resulting geodesics more closely follow the principal eigenvector of the diffusion tensors even in high-curvature regions. We also develop a way to automatically segment the white matter tracts based on the computed geodesics. We show the robustness of our method on simulated data with different noise levels. We also compare our method with tractography methods and geodesic approaches using other Riemannian metrics and demonstrate that the proposed method results in improved geodesics and segmentations using both synthetic and real DTI data.

Belief propagation based segmentation of white matter tracts in DTI.

This paper presents a belief propagation approach to the segmentation of the major white matter tracts in diffusion tensor images of the human brain. Unlike tractography methods that sample multiple fibers to be bundled together, we define a Markov field directly on the diffusion tensors to separate the main fiber tracts at the voxel level. A prior model of shape and direction guides a full segmentation of the brain into known fiber tracts; additional, unspecified fibers; and isotropic regions. The method is evaluated on various data sets from an atlasing project, healthy subjects, and multiple sclerosis patients.

Representing Diffusion MRI in 5-D Simplifies Regularization and Segmentation of White Matter Tracts

We present a new five-dimensional (5-D) space representation of diffusion magnetic resonance imaging (dMRI) of high angular resolution. This 5-D space is basically a non-Euclidean space of position and orientation in which crossing fiber tracts can be clearly disentangled, that cannot be separated in three-dimensional position space. This new representation provides many possibilities for processing and analysis since classical methods for scalar images can be extended to higher dimensions even if the spaces are not Euclidean. In this paper, we show examples of how regularization and segmentation of dMRI is simplified with this new representation. The regularization is used with the purpose of denoising and but also to facilitate the segmentation task by using several scales, each scale representing a different level of resolution. We implement in five dimensions the Chan-Vese method combined with active contours without edges for the segmentation and the total variation functional for the regularization. The purpose of this paper is to explore the possibility of segmenting white matter structures directly as entirely separated bundles in this 5-D space. We will present results from a synthetic model and results on real data of a human brain acquired with diffusion spectrum magnetic resonance imaging (MRI), one of the dMRI of high angular resolution available. These results will lead us to the conclusion that this new high-dimensional representation indeed simplifies the problem of segmentation and regularization.

Atlas-based segmentation of white matter tracts of the human brain using diffusion tensor tractography and comparison with classical dissection

The technique of diffusion tensor tractography is gaining increasing prominence as a non-invasive method for studying the architecture of the white matter pathways in the human brain. Numerous studies have been published that attempt to identify or reconstruct particular pathways of interest. An atlas or map of all the pathways in the white matter would be particularly useful for providing detailed anatomical data that is not available in studies based on conventional MRI data. In this paper we present a method for constructing a white matter atlas to define structures from diffusion tensor tractography by making use of the locations of the anatomical terminations of individual streamlines that pass through white matter. We show how a map of unique seed regions can be used to generate tracts of interest. This approach provides anatomical information that can be rapidly applied to MRI datasets for the clear identification of white matter tracts. We show close correspondence of the tracts generated from the atlas with tracts isolated with classical dissection of post-mortem brain tissue.