Abstract
Speech-associated gestures represent an important communication modality. However, individual differences in the production and perception of gestures are not well understood so far. We hypothesized that the perception of multisensory action consequences might play a crucial role. Verbal communication involves continuous calibration of audio–visual information produced by the speakers. The effective production and perception of gestures supporting this process could depend on the given capacities to perceive multisensory information accurately. We explored the association between the production and perception of gestures and the monitoring of multisensory action consequences in a sample of 31 participants. We applied a recently introduced gesture scale to assess self-reported gesture production and perception in everyday life situations. In the perceptual experiment, we presented unimodal (visual) and bimodal (visual and auditory) sensory outcomes with various delays after a self-initiated (active) or externally generated (passive) button press. Participants had to report whether they detected a delay between the button press and the visual stimulus. We derived psychometric functions for each condition and determined points of subjective equality, reflecting detection thresholds for delays. Results support a robust link between gesture scores and detection thresholds. Individuals with higher detection thresholds (lower performance) reported more frequent gesture production and perception and furthermore profited more from multisensory information in the experimental task. We propose that our findings indicate a compensational function of multisensory processing as a basis for individual differences in both action outcome monitoring and gesture production and perception in everyday life situations.
Highlights
Speech-associated gestures provide an important attribute of everyday communication
We explored individual differences in gesture production and perception using the recently introduced Brief Assessment of Gesture (BAG) scale that allows assessment of self-reported gesture production and perception in everyday communication (Nagels et al, 2015)
We found no significant interaction effect between feedback type and action condition, F(1,30) < 0.01, p = 0.99, η2p < 0.01
Summary
Speech-associated gestures provide an important attribute of everyday communication. Their role in communicating has been explored in detail (Goldin-Meadow and Alibali, 2013), individual differences in the production and perception of gestures are still barely understood. Listeners’ comprehension of speech is improved when accompanied by gestures and gestures improve learning of speech content (Kelly, 2001; Valenzeno et al, 2003; Straube et al, 2009) They can be considered as a fundamental additional communication modality that complements speech, i.e., the auditory modality. Individuals have been reported to differ substantially in their production and perception of gestures in everyday life (Hostetter and Alibali, 2007; Nagels et al, 2015). Cognitive skills have been found to be associated with gesture production (Hostetter and Alibali, 2007; Chu et al, 2014), but the role of perceptual processes has not been considered so far
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
