Multisensory Function Research Articles

Multisensory Calibration: A Variety of Slow and Fast Brain Processes Throughout the Lifespan.

From before we are born, throughout development, adulthood, and aging, we are immersed in a multisensory world. At each of these stages, our sensory cues are constantly changing, due to body, brain, and environmental changes. While integration of information from our different sensory cues improves precision, this only improves accuracy if the underlying cues are unbiased. Thus, multisensory calibration is a vital and ongoing process. To meet this grand challenge, our brains have evolved a variety of mechanisms. First, in response to a systematic discrepancy between sensory cues (without external feedback) the cues calibrate one another (unsupervised calibration). Second, multisensory function is calibrated to external feedback (supervised calibration). These two mechanisms superimpose. While the former likely reflects a lower level mechanism, the latter likely reflects a higher level cognitive mechanism. Indeed, neural correlates of supervised multisensory calibration in monkeys were found in higher level multisensory cortical area VIP, but not in the relatively lower level multisensory area MSTd. In addition, even without a cue discrepancy (e.g., when experiencing stimuli from different sensory cues in series) the brain monitors supra-modal statistics of events in the environment and adapts perception cross-modally. This too comprises a variety of mechanisms, including confirmation bias to prior choices, and lower level cross-sensory adaptation. Further research into the neuronal underpinnings of the broad and diverse functions of multisensory calibration, with improved synthesis of theories is needed to attain a more comprehensive understanding of multisensory brain function.

Neural Correlates of Audiovisual Speech Processing in Autistic and Non-Autistic Youth.

Autistic youth demonstrate differences in processing multisensory information, particularly in temporal processing of multisensory speech. Extensive research has identified several key brain regions for multisensory speech processing in non-autistic adults, including the superior temporal sulcus (STS) and insula, but it is unclear to what extent these regions are involved in temporal processing of multisensory speech in autistic youth. As a first step in exploring the neural substrates of multisensory temporal processing in this clinical population, we employed functional magnetic resonance imaging (fMRI) with a simultaneity-judgment audiovisual speech task. Eighteen autistic youth and a comparison group of 20 non-autistic youth matched on chronological age, biological sex, and gender participated. Results extend prior findings from studies of non-autistic adults, with non-autistic youth demonstrating responses in several similar regions as previously implicated in adult temporal processing of multisensory speech. Autistic youth demonstrated responses in fewer of the multisensory regions identified in adult studies; responses were limited to visual and motor cortices. Group responses in the middle temporal gyrus significantly interacted with age; younger autistic individuals showed reduced MTG responses whereas older individuals showed comparable MTG responses relative to non-autistic controls. Across groups, responses in the precuneus covaried with task accuracy, and anterior temporal and insula responses covaried with nonverbal IQ. These preliminary findings suggest possible differences in neural mechanisms of audiovisual processing in autistic youth while highlighting the need to consider participant characteristics in future, larger-scale studies exploring the neural basis of multisensory function in autism.

Transparent, intrinsically stretchable cellulose nanofiber-mediated conductive hydrogel for strain and humidity sensing

Conductive hydrogels (CHs) have attracted considerable attentions in the fields of wearable electronics, disease diagnosis, and artificial intelligence. However, it is still a great challenge to prepare a single CH system with integrated characteristics of high stretchability, good transparency, and multisensory function through a simple fabrication process. Herein, carboxylic cellulose nanofibers (CCNF) were used to assist the homogeneous distribution of opaque conductive poly(3,4-ethylenedioxythiophene): poly(styrene sulfonate) (PEDOT: PSS) into the crosslinked polyacrylamide network for the fabrication of stretchable and transparent interpenetrating network CH, aiming for a high-performance multisensory system. As expected, the ready formation of hydrogen bonds between the water molecules and a great deal of hydrophilic groups in the hydrogel endow the obtained CH with excellent humidity response behavior in a wide range (0–85%), and the introduction of CCNF and PEDOT: PSS is proved to be an effective strategy to enhance the humidity sensitivity, exhibiting great potential for the noncontact sensing of human respiration and finger movement. Meanwhile, it also displays excellent strain sensing behavior with favorable sensitivity in a broad range (0–837 %), fast response and reliable stability and reproducibility. Importantly, our prepared CH can also detect and discriminate complicated human activities and physiological signals. All these demonstrate the superiority of our prepared CH for the new generation of flexible wearable electronics.

Temporal binding window between three different sensory modalities: Auditory, visual, and tactile

Multisensory integration is crucial to perceptual understanding, but cues from multiple modalities do not necessarily arrive at the brain simultaneously. The window of time in which sensory inputs can be interpreted as simultaneous is termed the “temporal binding window” (TBW). Evidence suggests unimodal temporal discrimination is altered in a series of neurodevelopmental disorders but its relationship to perceptual timing of multisensory events (auditory, visual, and tactile) is not known, even in healthy populations. The purpose of this study was to characterize temporal integration of sensory modalities within a young healthy population. Twenty-five adults participated in TBW measurements with three different modalities. 100-ms stimuli (auditory: beep; visual: flash; tactile: vibration) were presented with various onset asynchrony (-500 to 500 ms) between two stimuli (AV: auditory-visual; AT: auditory-tactile; VT: visual-tactile). Participants were instructed to select “simultaneous” or “asynchronous” responses. Results show that the TBW for the AV condition ranged from 222 to 689 ms (mean ± SD = 418 ± 103), the AT condition ranged from 164 to 666 ms (376 ± 130), and the VT condition ranged from 70 to 751 ms (279 ± 131). These findings suggest that deficits in multisensory temporal function may factor into perceptual and cognitive weaknesses that characterize clinical disorders, raising the possibility that it may be a contributing pathologic factor in these conditions.

Unity Assumption in Audiovisual Emotion Perception.

We experience various sensory stimuli every day. How does this integration occur? What are the inherent mechanisms in this integration? The “unity assumption” proposes a perceiver’s belief of unity in individual unisensory information to modulate the degree of multisensory integration. However, this has yet to be verified or quantified in the context of semantic emotion integration. In the present study, we investigate the ability of subjects to judge the intensities and degrees of similarity in faces and voices of two emotions (angry and happy). We found more similar stimulus intensities to be associated with stronger likelihoods of the face and voice being integrated. More interestingly, multisensory integration in emotion perception was observed to follow a Gaussian distribution as a function of the emotion intensity difference between the face and voice—the optimal cut-off at about 2.50 points difference on a 7-point Likert scale. This provides a quantitative estimation of the multisensory integration function in audio-visual semantic emotion perception with regards to stimulus intensity. Moreover, to investigate the variation of multisensory integration across the population, we examined the effects of personality and autistic traits of participants. Here, we found no correlation of autistic traits with unisensory processing in a nonclinical population. Our findings shed light on the current understanding of multisensory integration mechanisms.

Remote Microphone Systems Can Improve Listening-in-Noise Accuracy and Listening Effort for Youth With Autism.

This study examined whether remote microphone (RM) systems improved listening-in-noise performance in youth with autism. We explored effects of RM system use on both listening-in-noise accuracy and listening effort in a well-characterized sample of participants with autism. We hypothesized that listening-in-noise accuracy would be enhanced and listening effort reduced, on average, when participants used the RM system. Furthermore, we predicted that effects of RM system use on listening-in-noise accuracy and listening effort would vary according to participant characteristics. Specifically, we hypothesized that participants who were chronologically older, had greater nonverbal cognitive and language ability, displayed fewer features of autism, and presented with more typical sensory and multisensory profiles might exhibit greater benefits of RM system use than participants who were younger, had less nonverbal cognitive or language ability, displayed more features of autism, and presented with greater sensory and multisensory disruptions. We implemented a within-subjects design to investigate our hypotheses, wherein 32 youth with autism completed listening-in-noise testing with and without an RM system. Listening-in-noise accuracy and listening effort were evaluated simultaneously using a dual-task paradigm for stimuli varying in complexity (i.e., syllable-, word-, sentence-, and passage-level). In addition, several putative moderators of RM system effects (i.e., sensory and multisensory function, language, nonverbal cognition, and broader features of autism) on outcomes of interest were evaluated. Overall, RM system use resulted in higher listening-in-noise accuracy in youth with autism compared with no RM system use. The observed benefits were all large in magnitude, although the benefits on average were greater for more complex stimuli (e.g., key words embedded in sentences) and relatively smaller for less complex stimuli (e.g., syllables). Notably, none of the putative moderators significantly influenced the effects of the RM system on listening-in-noise accuracy, indicating that RM system benefits did not vary according to any of the participant characteristics assessed. On average, RM system use did not have an effect on listening effort across all youth with autism compared with no RM system use but instead yielded effects that varied according to participant profile. Specifically, moderated effects indicated that RM system use was associated with increased listening effort for youth who had (a) average to below-average nonverbal cognitive ability, (b) below-average language ability, and (c) reduced audiovisual integration. RM system use was also associated with decreased listening effort for youth with very high nonverbal cognitive ability. This study extends prior work by showing that RM systems have the potential to boost listening-in-noise accuracy for youth with autism. However, this boost in accuracy was coupled with increased listening effort, as indexed by longer reaction times while using an RM system, for some youth with autism, perhaps suggesting greater engagement in the listening-in-noise tasks when using the RM system for youth who had lower cognitive abilities, were less linguistically able, and/or have difficulty integrating seen and heard speech. These findings have important implications for clinical practice, suggesting RM system use in classrooms could potentially improve listening-in-noise performance for some youth with autism.

Contribution of Sensory Function to Preclinical Indicators of Physical and Cognitive Functioning With Aging

There are well established associations between sensory loss and physical and cognitive deficits with aging, but gaps remain in our understanding of the associations between sensory function and early preclinical indicators of physical and cognitive decline. This symposium will present data from the Baltimore Longitudinal Study of Aging (BLSA) on a series of studies investigating the links among sensory function, motor function, and physical and cognitive outcomes in older adults. In the first study, Dr. Gross will present an operational definition of early cognitive impairment (ECI) based on a combination of two cognitive measures – the Card Rotations test and the California Verbal Learning Test Immediate Recall – to predict progression to MCI/AD. In the second study, Dr. Cai will evaluate the relationship between multisensory impairment (in vision, hearing, olfaction, proprioception and vestibular function) and the algorithmic definition of ECI. In the third study, Dr. Armstrong will evaluate the association between multisensory impairment and another biomarker of ECI or preclinical AD, specifically PET-PiB deposition. In the fourth study, Dr. Schrack, will present the joint contribution of multisensory (hearing and vision) impairment and motor function (gait speed) on risk of incident MCI/AD in longitudinal analyses. Finally, Dr. Martinez Amezcua will present the longitudinal association between hearing and vestibular function and decline in higher level physical function and endurance performance. Taken together, these studies present compelling data about the contribution of sensory function to preclinical indicators of physical and cognitive functioning with aging.

Impoverished Inhibitory Control Exacerbates Multisensory Impairments in Older Fallers

Impaired temporal perception of multisensory cues is a common phenomenon observed in older adults that can lead to unreliable percepts of the external world. For instance, the sound induced flash illusion (SIFI) can induce an illusory percept of a second flash by presenting a beep close in time to an initial flash-beep pair. Older adults that have enhanced susceptibility to a fall demonstrate significantly stronger illusion percepts during the SIFI task compared to those older adults without any history of falling. We hypothesize that a global inhibitory deficit may be driving the impairments across both postural stability and multisensory function in older adults with a fall history (FH). We investigated oscillatory activity and perceptual performance during the SIFI task, to understand how active sensory processing, measured by gamma (30–80 Hz) power, was regulated by alpha activity (8–13 Hz), oscillations that reflect inhibitory control. Compared to young adults (YA), the FH and non-faller (NF) groups demonstrated enhanced susceptibility to the SIFI. Further, the FH group had significantly greater illusion strength compared to the NF group. The FH group also showed significantly impaired performance relative to YA during congruent trials (2 flash-beep pairs resulting in veridical perception of 2 flashes). In illusion compared to non-illusion trials, the NF group demonstrated reduced alpha power (or diminished inhibitory control). Relative to YA and NF, the FH group showed reduced phase-amplitude coupling between alpha and gamma activity in non-illusion trials. This loss of inhibitory capacity over sensory processing in FH compared to NF suggests a more severe change than that consequent of natural aging.

Approaches to Understanding Multisensory Dysfunction in Autism Spectrum Disorder.

Abnormal sensory responses are a DSM-5 symptom of autism spectrum disorder (ASD), and research findings demonstrate altered sensory processing in ASD. Beyond difficulties with processing information within single sensory domains, including both hypersensitivity and hyposensitivity, difficulties in multisensory processing are becoming a core issue of focus in ASD. These difficulties may be targeted by treatment approaches such as "sensory integration," which is frequently applied in autism treatment but not yet based on clear evidence. Recently, psychophysical data have emerged to demonstrate multisensory deficits in some children with ASD. Unlike deficits in social communication, which are best understood in humans, sensory and multisensory changes offer a tractable marker of circuit dysfunction that is more easily translated into animal model systems to probe the underlying neurobiological mechanisms. Paralleling experimental paradigms that were previously applied in humans and larger mammals, we and others have demonstrated that multisensory function can also be examined behaviorally in rodents. Here, we review the sensory and multisensory difficulties commonly found in ASD, examining laboratory findings that relate these findings across species. Next, we discuss the known neurobiology of multisensory integration, drawing largely on experimental work in larger mammals, and extensions of these paradigms into rodents. Finally, we describe emerging investigations into multisensory processing in genetic mouse models related to autism risk. By detailing findings from humans to mice, we highlight the advantage of multisensory paradigms that can be easily translated across species, as well as the potential for rodent experimental systems to reveal opportunities for novel treatments. LAY SUMMARY: Sensory and multisensory deficits are commonly found in ASD and may result in cascading effects that impact social communication. By using similar experiments to those in humans, we discuss how studies in animal models may allow an understanding of the brain mechanisms that underlie difficulties in multisensory integration, with the ultimate goal of developing new treatments. Autism Res 2020, 13: 1430-1449. © 2020 International Society for Autism Research, Wiley Periodicals, Inc.

Incident dementia and faster rates of cognitive decline are associated with worse multisensory function summary scores.

We created a summary score for multiple sensory (multisensory) impairment and evaluated its association with dementia. We studied 1794 adults aged 70 to 79 who were dementia-free at enrollment and followed for up to 10 years in the Health, Aging, and Body Composition Study. The multisensory function score (0 to 12 points) was based on sample quartiles of objectively measured vision, hearing, smell, and touch summed overall. Risk of incident dementia and cognitive decline (measured by two cognitive tests) associated with the score were assessed in regression models adjusting for demographics and health conditions. Dementia risk was 2.05 times higher (95% confidence interval [CI] 1.50-2.81) comparing "poor" to "good" multisensory score tertiles and 1.45 times higher comparing the "middle" to "good" tertiles (95% CI 1.09-1.91). Each point worse in the multisensory function score was associated with faster rates of cognitive decline (P<.05). Worsening multisensory function, even at mild levels, was associated with accelerated cognitive aging.

Stability of Variables Derived From Measures of Multisensory Function in Children With Autism Spectrum Disorder.

Children with autism spectrum disorder (ASD) display differences in multisensory function as quantified by several different measures. This study estimated the stability of variables derived from commonly used measures of multisensory function in school-aged children with ASD. Participants completed: a simultaneity judgment task for audiovisual speech, tasks designed to elicit the McGurk effect, listening-in-noise tasks, electroencephalographic recordings, and eye-tracking tasks. Results indicate the stability of indices derived from tasks tapping multisensory processing is variable. These findings have important implications for measurement in future research. Averaging scores across repeated observations will often be required to obtain acceptably stable estimates and, thus, to increase the likelihood of detecting effects of interest, as it relates to multisensory processing in children with ASD.

Audiovisual temporal integration and rapid temporal recalibration in adolescents and adults: Age-related changes and its correlation with autistic traits.

Temporal structure is a key factor in determining the relatedness of multisensory stimuli. Stimuli that are close in time are more likely to be integrated into a unified perceptual representation. To investigate the age-related developmental differences in audiovisual temporal integration and rapid temporal recalibration, we administered simultaneity judgment (SJ) tasks to a group of adolescents (11-14 years) and young adults (18-28 years). No age-related changes were found in the width of the temporal binding window within which participants are highly likely to combine multisensory stimuli. The main distinction between adolescents and adults was audiovisual temporal recalibration. Although participants of both age groups could rapidly recalibrate based on the previous trial for speech stimuli (i.e., syllable utterances), only adults but not adolescents showed short-term recalibration for simple and non-speech stimuli. In both adolescents and adults, no significant correlation was found between audiovisual temporal integration ability and autistic or schizotypal traits. These findings provide new information on the developmental trajectory of basic multisensory function and may have implications for neurodevelopmental disorders (e.g., autism) with altered audiovisual temporal integration. Autism Res 2020, 13: 615-626. © 2019 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: Utilizing temporal cues to integrate and separate audiovisual information is a fundamental ability underlying higher order social communicative functions. This study examines the developmental changes of the ability to detect audiovisual asynchrony and rapidly adjust sensory decisions based on previous sensory input. In healthy adolescents and young adults, the correlation between autistic traits and audiovisual integration ability failed to reach a significant level. Therefore, more research is needed to examine whether impairment in basic sensory functions is correlated with broader autism phenotype in nonclinical populations. These results may help us understand altered multisensory integration in people with autism.

Multisensory Integration as a Window into Orderly and Disrupted Cognition and Communication.

During our everyday lives, we are confronted with a vast amount of information from several sensory modalities. This multisensory information needs to be appropriately integrated for us to effectively engage with and learn from our world. Research carried out over the last half century has provided new insights into the way such multisensory processing improves human performance and perception; the neurophysiological foundations of multisensory function; the time course for its development; how multisensory abilities differ in clinical populations; and, most recently, the links between multisensory processing and cognitive abilities. This review summarizes the extant literature on multisensory function in typical and atypical circumstances, discusses the implications of the work carried out to date for theory and research, and points toward next steps for advancing the field.

Geniculate Ganglion Neurons are Multimodal and Variable in Receptive Field Characteristics

Afferent chorda tympani (CT) fibers innervating anterior tongue fungiform papillae have neuron cell bodies in the geniculate ganglion (GG). To characterize electrophysiological and receptive field properties, we recorded extracellular responses from single GG neurons to lingual application with chemical, thermal and mechanical stimuli. Receptive field size was mapped by electrical stimulation of individual fungiform papillae. Responses of GG neurons to room temperature chemical stimuli representing five taste qualities, and distilled water at 4 °C and mechanical stimulation were used. Based on responses to these stimuli, GG neurons were divided into CHEMICAL, CHEMICAL/THERMAL, THERMAL and TACTILE groups. Neurons in the CHEMICAL group responded to taste stimuli but not to either cold water or stroking stimuli. CHEMICAL/THERMAL neurons responded to both taste stimuli and cold water. THERMAL neurons responded only to cold water and TACTILE neurons responded only to light stroking stimuli. The receptive field sizes for CHEMICAL, and CHEMICAL/THERMAL neurons averaged five papillae exceeding the field size of THERMAL and TACTILE neurons which averaged about two papillae. Detailed analysis of the receptive field of CHEMICAL/THERMAL neurons revealed that within one field only a subset of the fungiform papillae making up the receptive field responded to the cold stimuli, whereas the other papillae responded only to chemical stimuli. These finding demonstrate that fungiform papilla are complex sensory organs with a multisensory function suggesting a unique role in detecting and sampling food components prior to ingestion.

Disrupted integration of exteroceptive and interoceptive signaling in autism spectrum disorder

Studies have shown that individuals with autism have difficulty in separating auditory and visual events in time. People with autism also weight sensory evidence originating from the external world and from their body differently. We measured simultaneity judgments regarding visual and auditory events and between visual and heartbeat events. Results suggest that while individuals with autism show unusual temporal function across the senses in a general manner, this deficit is greater when pairings bridged between the external world and the internal body.

Multisensory temporal function and EEG complexity in patients with epilepsy and psychogenic nonepileptic events.

Cognitive and perceptual comorbidities frequently accompany epilepsy and psychogenic nonepileptic events (PNEE). However, and despite the fact that perceptual function is built upon a multisensory foundation, little knowledge exists concerning multisensory function in these populations. Here, we characterized facets of multisensory processing abilities in patients with epilepsy and PNEE, and probed the relationship between individual resting-state EEG complexity and these psychophysical measures in each patient. We prospectively studied a cohort of patients with epilepsy (N=18) and PNEE (N=20) patients who were admitted to Vanderbilt's Epilepsy Monitoring Unit (EMU) and weaned off of anticonvulsant drugs. Unaffected age-matched persons staying with the patients in the EMU (N=15) were also recruited as controls. All participants performed two tests of multisensory function: an audio-visual simultaneity judgment and an audio-visual redundant target task. Further, in the cohort of patients with epilepsy and PNEE we quantified resting state EEG gamma power and complexity. Compared with both patients with epilepsy and control subjects, patients with PNEE exhibited significantly poorer acuity in audiovisual temporal function as evidenced in significantly larger temporal binding windows (i.e., they perceived larger stimulus asynchronies as being presented simultaneously). These differences appeared to be specific for temporal function, as there was no difference among the three groups in a non-temporally based measure of multisensory function - the redundant target task. Further, patients with PNEE exhibited more complex resting state EEG patterns as compared to their patients with epilepsy, and EEG complexity correlated with multisensory temporal performance on a subject-by-subject manner. Taken together, findings seem to indicate that patients with PNEE bind information from audition and vision over larger temporal intervals when compared with control subjects as well as patients with epilepsy. This difference in multisensory function appears to be specific to the temporal domain, and may be a contributing factor to the behavioral and perceptual alterations seen in this population.

An autism-associated serotonin transporter variant disrupts multisensory processing

Altered sensory processing is observed in many children with autism spectrum disorder (ASD), with growing evidence that these impairments extend to the integration of information across the different senses (that is, multisensory function). The serotonin system has an important role in sensory development and function, and alterations of serotonergic signaling have been suggested to have a role in ASD. A gain-of-function coding variant in the serotonin transporter (SERT) associates with sensory aversion in humans, and when expressed in mice produces traits associated with ASD, including disruptions in social and communicative function and repetitive behaviors. The current study set out to test whether these mice also exhibit changes in multisensory function when compared with wild-type (WT) animals on the same genetic background. Mice were trained to respond to auditory and visual stimuli independently before being tested under visual, auditory and paired audiovisual (multisensory) conditions. WT mice exhibited significant gains in response accuracy under audiovisual conditions. In contrast, although the SERT mutant animals learned the auditory and visual tasks comparably to WT littermates, they failed to show behavioral gains under multisensory conditions. We believe these results provide the first behavioral evidence of multisensory deficits in a genetic mouse model related to ASD and implicate the serotonin system in multisensory processing and in the multisensory changes seen in ASD.

Serotonergic Modulation of Sensory and Multisensory Processing in Superior Colliculus

The ability to integrate information across the senses is vital for coherent perception of and interaction with the world. While much is known regarding the organization and function of multisensory neurons within the mammalian superior colliculus (SC), very little is understood at a mechanistic level. One open question in this regard is the role of neuromodulatory networks in shaping multisensory responses. While the SC receives substantial serotonergic projections from the raphe nuclei, and serotonergic receptors are distributed throughout the SC, the potential role of serotonin (5-HT) signaling in multisensory function is poorly understood. To begin to fill this knowledge void, the current study provides physiological evidence for the influences of 5-HT signaling on auditory, visual and audiovisual responses of individual neurons in the intermediate and deep layers of the SC, with a focus on the 5HT2a receptor. Using single-unit extracellular recordings in combination with pharmacological methods, we demonstrate that alterations in 5HT2a receptor signaling change receptive field (RF) architecture as well as responsivity and integrative abilities of SC neurons when assessed at the level of the single neuron. In contrast, little changes were seen in the local field potential (LFP). These results are the first to implicate the serotonergic system in multisensory processing, and are an important step to understanding how modulatory networks mediate multisensory integration in the SC.

Atypical rapid audio-visual temporal recalibration in autism spectrum disorders.

Changes in sensory and multisensory function are increasingly recognized as a common phenotypic characteristic of Autism Spectrum Disorders (ASD). Furthermore, much recent evidence suggests that sensory disturbances likely play an important role in contributing to social communication weaknesses-one of the core diagnostic features of ASD. An established sensory disturbance observed in ASD is reduced audiovisual temporal acuity. In the current study, we substantially extend these explorations of multisensory temporal function within the framework that an inability to rapidly recalibrate to changes in audiovisual temporal relations may play an important and under-recognized role in ASD. In the paradigm, we present ASD and typically developing (TD) children and adolescents with asynchronous audiovisual stimuli of varying levels of complexity and ask them to perform a simultaneity judgment (SJ). In the critical analysis, we test audiovisual temporal processing on trial t as a condition of trial t - 1. The results demonstrate that individuals with ASD fail to rapidly recalibrate to audiovisual asynchronies in an equivalent manner to their TD counterparts for simple and non-linguistic stimuli (i.e., flashes and beeps, hand-held tools), but exhibit comparable rapid recalibration for speech stimuli. These results are discussed in terms of prior work showing a speech-specific deficit in audiovisual temporal function in ASD, and in light of current theories of autism focusing on sensory noise and stability of perceptual representations. Autism Res 2017, 10: 121-129. © 2016 International Society for Autism Research, Wiley Periodicals, Inc.

Above the Mean: Examining Variability in Behavioral and Neural Responses to Multisensory Stimuli

Even when experimental conditions are kept constant, a robust and consistent finding in both behavioral and neural experiments designed to examine multisensory processing is striking variability. Although this variability has often been considered uninteresting noise (a term that is laden with strong connotations), emerging work suggests that differences in variability may be an important aspect in describing differences in performance between individuals and groups. In the current review, derived from a symposium at the 2015 International Multisensory Research Forum in Pisa, Italy, we focus on several aspects of variability as it relates to multisensory function. This effort seeks to expand our understanding of variability at levels of coding and analysis ranging from the single neuron through large networks and on to behavioral processes, and encompasses a number of the multimodal approaches that are used to evaluate and characterize multisensory processing including single-unit neurophysiology, electroencephalography (EEG), functional magnetic resonance imaging (fMRI), and electrocorticography (ECoG).