Data-Specific Feature Selection Method Identification for Most Reproducible Connectomic Feature Discovery Fingerprinting Brain States

Abstract

Machine learning methods present unprecedented opportunities to advance our understanding of the connectomics of brain disorders. With the proliferation of extremely high-dimensional connectomic data drawn from multiple neuroimaging sources (e.g., functional and structural MRIs), effective feature selection (FS) methods have become indispensable components for (i) disentangling brain states (e.g., early vs late mild cognitive impairment) and (ii) identifying connectional features that might serve as biomarkers for treatment. Strangely, despite the extensive work on identifying stable discriminative features using a particular FS method, the challenge of choosing the best one from a large pool of existing FS techniques for optimally achieving (i) and (ii) using a dataset of interest remains unexplored. In essence, the question that we aim to address in this work is: “Given a set of feature selection methods \(\{FS_1, \dots , FS_K \}\), and a dataset of interest, which FS method might produce the most reproducible and ‘trustworthy’ connectomic features that accurately differentiate between two brain states?” This paper is an attempt to address this question by evaluating the performance of a particular feature selection for a specific data type in fulfilling criteria (i) and (ii). To this aim, we propose to model the relationships between a set of FS methods using a multi-graph architecture, where each graph quantifies the feature reproducibility power between graph nodes at a fixed number of top ranked features. Next, we integrate the reproducibility graphs with a discrepancy graph which captures the difference in classification performance between FS methods. This allows to identify, for a dataset of interest, the ‘central’ node with the highest degree, which reveals the most reliable and reproducible FS method for the target brain state classification task along with the most discriminative features fingerprinting these brain states. We evaluated our method on multi-view brain connectomic data for late mild cognitive impairment vs Alzheimer’s disease classification. Our experiments give insights into reproducible connectional features fingerprinting late dementia brain states.