Manual validation of FreeSurfer's automated hippocampal segmentation in normal aging, mild cognitive impairment, and Alzheimer Disease subjects

Abstract

Hippocampal volume is reduced in Alzheimer Disease (AD) and has been proposed as a possible surrogate biomarker to aid early diagnosis. Whilst automated methods to segment the hippocampus from magnetic resonance images are available, manual segmentation, in spite of being time-consuming and unsuitable for large samples, is still the standard. In order to study the validity of FreeSurfer's automated method, we compared hippocampal automated measures with manual tracing in a sample composed of healthy elderly ( N = 41), Mild Cognitive Impairment (MCI) ( N = 23), and AD ( N = 25) subjects. Percent volume overlap, percent volume difference, correlations, and Bland–Altman plots were studied. Automated measures were slightly larger than hand tracing ones (mean difference 10%). Percent volume overlap showed good results, but was far from perfect (78%). Manual and automated volume correlations were approximately 0.84 and the Bland–Altman analysis showed acceptable interchangeability of methods. Within-group analysis demonstrated that patient samples obtained smaller values in validity indexes than controls. Globally, FreeSurfer's automated hippocampal volumetry showed adequate validity when compared to manual tracing, with a tendency to overestimation. Nevertheless, the greater difference between automated and manual segmentation in atrophic brains suggests that studies in AD based on this software could be more likely to produce false negatives.