Knowing ‘who she is’ based on ‘where she is’: The effect of co-speech gesture on pronoun comprehension

Abstract

AbstractWe examine whether pronoun interpretation is affected by naturalistic co-speech gesture. Participants in three conditions watched narrations containing ambiguous pronouns. In one condition the narrator produced gestures consistent with order-of-mention; in another, they conflicted with order-of-mention; and in the third, she did not gesture. Results showed that when the gestures conflicted with order-of-mention participants were much less likely to interpret the pronoun as referring to the first-mentioned character. In a second experiment we ruled out the possibility that participants were simply picking up on differences within the speech itself. These results extend previous work on gesture and language processing by showing that the information in gesture can influence the way people interpret words which by their nature are ambiguous, and that this influence is similar to that of well-known speech internal cues.