Abstract
When questioning the veracity of an utterance, we perceive certain non-linguistic behaviours to indicate that a speaker is being deceptive. Recent work has highlighted that listeners’ associations between speech disfluency and dishonesty are detectable at the earliest stages of reference comprehension, suggesting that the manner of spoken delivery influences pragmatic judgements concurrently with the processing of lexical information. Here, we investigate the integration of a speaker’s gestures into judgements of deception, and ask if and when associations between nonverbal cues and deception emerge. Participants saw and heard a video of a potentially dishonest speaker describe treasure hidden behind an object, while also viewing images of both the named object and a distractor object. Their task was to click on the object behind which they believed the treasure to actually be hidden. Eye and mouse movements were recorded. Experiment 1 investigated listeners’ associations between visual cues and deception, using a variety of static and dynamic cues. Experiment 2 focused on adaptor gestures. We show that a speaker’s nonverbal behaviour can have a rapid and direct influence on listeners’ pragmatic judgements, supporting the idea that communication is fundamentally multimodal.
Highlights
In natural communication, speakers can convey information via multiple channels
In Experiment 1, we focus on how trunk movements influence judgements of deception, with filler trials presenting two further types of nonverbal behaviour
Initial analyses of eye- and mouse-tracking data used linear mixed effects regression to model the difference in empirical logit transformed proportions of fixations and cumulative mouse movements towards one object over the other
Summary
A speaker’s gestures, postures and facial expressions can all offer extralinguistic information about the speaker or message. Listeners can be affected by such information in a number of ways. They may, for example, make inferences about the speaker’s emotion [1, 2]. Their interpretation of the message itself may change, for example if extra-linguistic information causes them to believe that the speaker is being dishonest [3]. We investigate whether, and how, speakers’ postures or adaptor gestures (e.g., fidgeting movements) affect listeners’ judgements of veracity
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
