Automatic detection of a prefrontal cortical response to emotionally rated music using multi-channel near-infrared spectroscopy

Abstract

Emotional responses can be induced by external sensory stimuli. For severely disabled nonverbal individuals who have no means of communication, the decoding of emotion may offer insight into an individual’s state of mind and his/her response to events taking place in the surrounding environment. Near-infrared spectroscopy (NIRS) provides an opportunity for bed-side monitoring of emotions via measurement of hemodynamic activity in the prefrontal cortex, a brain region known to be involved in emotion processing. In this paper, prefrontal cortex activity of ten able-bodied participants was monitored using NIRS as they listened to 78 music excerpts with different emotional content and a control acoustic stimuli consisting of the Brown noise. The participants rated their emotional state after listening to each excerpt along the dimensions of valence (positive versus negative) and arousal (intense versus neutral). These ratings were used to label the NIRS trial data. Using a linear discriminant analysis-based classifier and a two-dimensional time-domain feature set, trials with positive and negative emotions were discriminated with an average accuracy of 71.94% ± 8.19%. Trials with audible Brown noise representing a neutral response were differentiated from high arousal trials with an average accuracy of 71.93% ± 9.09% using a two-dimensional feature set. In nine out of the ten participants, response to the neutral Brown noise was differentiated from high arousal trials with accuracies exceeding chance level, and positive versus negative emotional differentiation accuracies exceeded the chance level in seven out of the ten participants. These results illustrate that NIRS recordings of the prefrontal cortex during presentation of music with emotional content can be automatically decoded in terms of both valence and arousal encouraging future investigation of NIRS-based emotion detection in individuals with severe disabilities.