Children cannot ignore what they hear: Incongruent emotional information leads to an auditory dominance in children

Abstract

Effective emotion recognition is imperative to successfully navigating social situations. Research suggests differing developmental trajectories for the recognition of bodily and vocal emotion, but emotions are usually studied in isolation and rarely considered as multimodal stimuli in the literature. When adults are presented with basic multimodal sensory stimuli, the Colavita effect suggests that they have a visual dominance, whereas more recent research finds that an auditory sensory dominance may be present in children under 8 years of age. However, it is not currently known whether this phenomenon holds for more complex multimodal social stimuli. Here we presented children and adults with multimodal social stimuli consisting of emotional bodies and voices, asking them to recognize the emotion in one modality while ignoring the other. We found that adults can perform this task with no detrimental effects on performance regardless of whether the ignored emotion was congruent or not. However, children find it extremely challenging to recognize bodily emotion while trying to ignore incongruent vocal emotional information. In several instances, they performed below chance level, indicating that the auditory modality actively informs their choice of bodily emotion. Therefore, this is the first evidence, to our knowledge, of an auditory dominance in children when presented with emotionally meaningful stimuli.