The interactive effects of facial expressions of emotion and verbal messages on perceptions of affective meaning

Abstract

The influence of facial expressions of emotion on perceptions of affective sentence meaning was investigated by pairing happy, angry, suprised, and sad faces of “teachers” with sentences of varying affective tone. Ninety-five students judged the overall meaning communicated by these paired stimuli. The design allowed exploration of unique facial-verbal combination effects, overall cue integration effects, and sex differences. Clear effects of cue combinations emerged. Perceived sincerity was found to be a function of the consistency of evaluative (positivity) but not dominance cues. Perceived positivity was an interactive function of both evaluative cues and dominance cues. Perceived dominance was affected by the interaction of evaluative cues. The subtleties of cue combination were clarified through open-ended dependent measures. Also, as expected, females were found to be more sensitive than males to verbal-nonverbal cue conflict in perceptions of sincerity. However, no other sex differences were found. The findings were discussed with regard to the need for a firm empirical base upon which to integrate verbal and nonverbal research traditions in the communication of affective meaning.