Taste the music: Modality-general representation of affective states derived from auditory and gustatory stimuli

Abstract

Prior studies have extensively examined modality-general representation of affect across various sensory modalities, particularly focusing on auditory and visual stimuli. However, little research has explored the modality-general representation of affect between gustatory and other sensory modalities. This study aimed to investigate whether the affective responses induced by tastes and musical pieces could be predicted within and across modalities. For each modality, eight stimuli were chosen based on four basic taste conditions (sweet, bitter, sour, and salty). Participants rated their responses to each stimulus using both taste and emotion scales. The multivariate analyses including multidimensional scaling and classification analysis were performed. The findings revealed that auditory and gustatory stimuli in the sweet category were associated with positive valence, whereas those from the other taste categories were linked to negative valence. Additionally, auditory and gustatory stimuli in sour taste category were linked to high arousal, whereas stimuli in bitter taste category were associated with low arousal. This study revealed the potential mapping of gustatory and auditory stimuli onto core affect space in everyday experiences. Moreover, it demonstrated that emotions evoked by taste and music could be predicted across modalities, supporting modality-general representation of affect.