Evaluation of thresholding methods for activation likelihood estimation meta-analysis via large-scale simulations.

Abstract

In recent neuroimaging studies, threshold‐free cluster enhancement (TFCE) gained popularity as a sophisticated thresholding method for statistical inference. It was shown to feature higher sensitivity than the frequently used approach of controlling the cluster‐level family‐wise error (cFWE) and it does not require setting a cluster‐forming threshold at voxel level. Here, we examined the applicability of TFCE to a widely used method for coordinate‐based neuroimaging meta‐analysis, Activation Likelihood Estimation (ALE), by means of large‐scale simulations. We created over 200,000 artificial meta‐analysis datasets by independently varying the total number of experiments included and the amount of spatial convergence across experiments. Next, we applied ALE to all datasets and compared the performance of TFCE to both voxel‐level and cluster‐level FWE correction approaches. All three multiple‐comparison correction methods yielded valid results, with only about 5% of the significant clusters being based on spurious convergence, which corresponds to the nominal level the methods were controlling for. On average, TFCE's sensitivity was comparable to that of cFWE correction, but it was slightly worse for a subset of parameter combinations, even after TFCE parameter optimization. cFWE yielded the largest significant clusters, closely followed by TFCE, while voxel‐level FWE correction yielded substantially smaller clusters, showcasing its high spatial specificity. Given that TFCE does not outperform the standard cFWE correction but is computationally much more expensive, we conclude that employing TFCE for ALE cannot be recommended to the general user.