Simultaneous Tissue Classification and Lateral Ventricle Segmentation via a 2D U-net Driven by a 3D Fully Convolutional Neural Network.

Abstract

In this paper, we proposed and validated a novel and fully automatic pipeline for simultaneous tissue classification and lateral ventricle segmentation via a 2D U-net. The 2D U-net was driven by a 3D fully convolutional neural network (FCN). Multiple T1-weighted atlases which had been pre-segmented into six whole-brain regions including the gray matter (GM), white matter (WM), cerebrospinal fluid (CSF), lateral ventricles (LVs), skull, and the background of the entire image were used. In the proposed pipeline, probability maps of the six whole-brain regions of interest (ROIs) were obtained after a pre-segmentation through a trained 3D patch-based FCN. To further capture the global context of the entire image, the to-be-segmented image and the corresponding six probability maps were input to a trained 2D U-net in a 2D slice fashion to obtain the final segmentation map. Experiments were performed on a dataset consisting of 18 T1-weighted images. Compared to the 3D patch-based FCN on segmenting five ROIs (GM, WM, CSF, LVs, skull) and another two classical methods (SPM and FSL) on segmenting GM and WM, the proposed pipeline showed a superior segmentation performance. The proposed segmentation architecture can also be extended to other medical image segmentation tasks.