Cross-modal effects of auditory magnitude on visually guided grasping.

Abstract

Recent research has established the role of objects' semantic properties in the planning of motor actions with respect to these objects. It has been shown that visual numerical magnitude affects visuomotor control in a similar direction to the effect of physical size: The larger the numerical value, the larger the grip aperture even when physical size remains invariant. The relationship has been attributed to a common mechanism, in particular to a neural network within the parietal lobe, which mediates the processing of magnitude across different domains. In this study, we show that the effect of magnitude on grasping is not limited to visual numerical information and is in fact cross-modal in nature; presentations of auditory signals of different types of auditory-based magnitudes affected visually guided actions in two different experiments. In Experiment 1, symbolic representations of magnitudes (numerals) affected initial grasping trajectories. In Experiment 2, a nonsymbolic presentation of magnitude, i.e., tone duration, had similar effects on grasping trajectories. We conclude that different types of magnitude representations are processed by a common mechanism that cooperates with visuomotor control.