Building predictive models of emotion with functional near-infrared spectroscopy

Abstract

Abstract We demonstrate the capability of discriminating between affective states on the valence and arousal dimensions using functional near-infrared spectroscopy (fNIRS), a practical non-invasive device that benefits from its ability to localize activation in functional brain regions with spatial resolution superior to the Electroencephalograph (EEG). The high spatial resolution of fNIRS enables us to identify the neural correlates of emotion with spatial precision comparable to fMRI, but without requiring the use of the constricting and impractical fMRI scanner. We make these predictions across subjects, creating the capacity to generalize the model to new participants. We designed the experiment and evaluated our results in the context of a prior experiment—based on the same basic protocol and stimulus materials—which used EEG to measure participants’ valence and arousal. The F1-scores achieved by our classifiers suggest that fNIRS is particularly useful at distinguishing between high and low levels of valence (F1-score of 0.739), which has proven to be difficult to measure with physiological sensors.