Cross-modal Inhibition Research Articles

The effect of viscosity on flavour, mouthfeel and koku enhancement by tastants and yeast extracts in beef broths

This study investigated the effect of viscosity on the dynamic sensory perception of savoury beef broths enriched with savoury enhancers to evaluate the effect of perceived thickness on the koku enhancement effect (i.e. thickness, flavour duration, and complexity). Beef broths were enriched with five combinations of tastants and taste enhancers [none (control); sodium chloride (NaCl); a combination of monosodium glutamate (MSG) and inosine monophosphate (IMP); yeast extract (Kokumax-100); a combination of yeast extract (Kokumax-100) with MSG and IMP]. Three levels of viscosity [low (ƞ=0.72 mPa.s); medium (ƞ=2.94 mPa.s); high (ƞ=12.65 mPa.s)] were obtained by adding different concentrations of locust bean gum (0.00, 0.20, 0.40 w/w%) to beef broths. Temporal-Check-All-That-Apply (TCATA) profiling showed that yeast extract with MSG-IMP enhanced the intensity, richness, body, and duration of savoury sensations of low-viscous beef broths, demonstrating a koku enhancement effect. Increasing the viscosity of broths decreased the perception of taste (i.e. saltiness and savouriness) and flavour (i.e. beef flavour) for most broths, demonstrating a cross-modal suppression of taste and flavour by viscosity. Only broths with yeast extract (Kokumax-100) with MSG-IMP demonstrated stable flavour and taste enhancement across all broth viscosity levels. Koku enhancement by yeast extract (Kokumax-100) with MSG-IMP, MSG-IMP, and NaCl was observed for mouthfeel properties in broths with low and medium viscosity, but not in broths with high viscosity suggesting a suppression of koku enhancement at high broth viscosity. We conclude that (i) yeast extract (Kokumax-100) produces koku enhancement in liquid savoury broths when combined with taste enhancers monosodium glutamate (MSG) and inosine monophosphate (IMP), and (ii) the magnitude of the koku enhancement depends on the presence of taste enhancers and is attenuated at higher broth viscosity.

Rewards weaken cross-modal inhibition of return with visual targets.

Previous studies have shown that rewards weaken visual inhibition of return (IOR). However, the specific mechanisms underlying the influence of rewards on cross-modal IOR remain unclear. Based on the Posner exogenous cue-target paradigm, the present study was conducted to investigate the effect of rewards on exogenous spatial cross-modal IOR in both visual cue with auditory target (VA) and auditory cue with visual target (AV) conditions. The results showed the following: in the AV condition, the IOR effect size in the high-reward condition was significantly lower than that in the low-reward condition. However, in the VA condition, there was no significant IOR in either the high- or low-reward condition and there was no significant difference between the two conditions. In other words, the use of rewards modulated exogenous spatial cross-modal IOR with visual targets; specifically, high rewards may have weakened IOR in the AV condition. Taken together, our study extended the effect of rewards on IOR to cross-modal attention conditions and demonstrated for the first time that higher motivation among individuals under high-reward conditions weakened the cross-modal IOR with visual targets. Moreover, the present study provided evidence for future research on the relationship between reward and attention.

Cross-modal modulation gates nociceptive inputs in Drosophila

Animals' response to a stimulus in one sensory modality is usually influenced by other modalities.1 One important type of multisensory integration is the cross-modal modulation, in which one sensory modality modulates (typically inhibits) another. Identification of the mechanisms underlying cross-modal modulations is crucial for understanding how sensory inputs shape animals' perception and for understanding sensory processing disorders.2,3,4 However, the synaptic and circuit mechanisms that underlie cross-modal modulation are poorly understood. This is due to the difficulty of separating cross-modal modulation from multisensory integrations in neurons that receive excitatory inputs from two or more sensory modalities5-in which case it is unclear what the modulating or modulated modality is. In this study, we report a unique system for studying cross-modal modulation by taking advantage of the genetic resources in Drosophila. We show that gentle mechanical stimuli inhibit nociceptive responses in Drosophila larvae. Low-threshold mechanosensory neurons inhibit a key second-order neuron in the nociceptive pathway through metabotropic GABA receptors on nociceptor synaptic terminals. Strikingly, this cross-modal inhibition is only effective when nociceptor inputs are weak, thus serving as a gating mechanism for filtering out weak nociceptive inputs. Our findings unveil a novel cross-modal gating mechanism for sensory pathways.

Multisensory-Guided Associative Learning Enhances Multisensory Representation in Primary Auditory Cortex.

Sensory cortices, classically considered to represent modality-specific sensory information, are also found to engage in multisensory processing. However, how sensory processing in sensory cortices is cross-modally modulated remains an open question. Specifically, we understand little of cross-modal representation in sensory cortices in perceptual tasks and how perceptual learning modifies this process. Here, we recorded neural responses in primary auditory cortex (A1) both while freely moving rats discriminated stimuli in Go/No-Go tasks and when anesthetized. Our data show that cross-modal representation in auditory cortices varies with task contexts. In the task of an audiovisual cue being the target associating with water reward, a significantly higher proportion of auditory neurons showed a visually evoked response. The vast majority of auditory neurons, if processing auditory-visual interactions, exhibit significant multisensory enhancement. However, when the rats performed tasks with unisensory cues being the target, cross-modal inhibition, rather than enhancement, predominated. In addition, multisensory associational learning appeared to leave a trace of plastic change in A1, as a larger proportion of A1 neurons showed multisensory enhancement in anesthesia. These findings indicate that multisensory processing in principle sensory cortices is not static, and having cross-modal interaction in the task requirement can substantially enhance multisensory processing in sensory cortices.

Examination of the development and aging of brain deactivation using a unimanual motor task

In the central nervous system, regional neuronal inhibition plays important roles in functional segregation. Here, we showed how brain deactivation, which is a putative index of neuronal inhibition, develops and ages using a unimanual motor task. Healthy right-handed children (8–11 years), adolescents (12–15 years), young adults (20–24 years), and older adults (69–75 years; 21 participants in each group) underwent functional magnetic resonance imaging with their eyes closed while they performed 1-Hz alternating extension–flexion of the right wrist. In young adults, we found deactivations in the hand/arm section of the ipsilateral primary sensorimotor cortices (SM1) including the dorsal premotor cortex (interhemispheric inhibition), foot and face SM1 sections (cross-somatotopic inhibition), visual and auditory cortices (cross-modal inhibition), and precuneus and medial prefrontal cortex of the default mode network (DMN; DMN inhibition). Interhemispheric, cross-modal, and DMN inhibitions developed from childhood to adulthood, but cross-somatotopic inhibition showed no developmental changes. Conversely, interhemispheric, cross-somatotopic, and cross-modal inhibitions, but not DMN inhibition, decreased with aging. Thus, neuronal inhibition generally progresses with development and deteriorates with aging, with some noted regional differences. This was the first study to systematically describe the development and aging of brain deactivation, which may reflect regional neuronal inhibition.

Effects of trial history on cross-modal non-spatial inhibition of return

Effects of trial history on cross-modal non-spatial inhibition of return

The Cross-Modal Suppressive Role of Visual Context on Speech Intelligibility: An ERP Study.

The efficacy of audiovisual (AV) integration is reflected in the degree of cross-modal suppression of the auditory event-related potentials (ERPs, P1-N1-P2), while stronger semantic encoding is reflected in enhanced late ERP negativities (e.g., N450). We hypothesized that increasing visual stimulus reliability should lead to more robust AV-integration and enhanced semantic prediction, reflected in suppression of auditory ERPs and enhanced N450, respectively. EEG was acquired while individuals watched and listened to clear and blurred videos of a speaker uttering intact or highly-intelligible degraded (vocoded) words and made binary judgments about word meaning (animate or inanimate). We found that intact speech evoked larger negativity between 280–527-ms than vocoded speech, suggestive of more robust semantic prediction for the intact signal. For visual reliability, we found that greater cross-modal ERP suppression occurred for clear than blurred videos prior to sound onset and for the P2 ERP. Additionally, the later semantic-related negativity tended to be larger for clear than blurred videos. These results suggest that the cross-modal effect is largely confined to suppression of early auditory networks with weak effect on networks associated with semantic prediction. However, the semantic-related visual effect on the late negativity may have been tempered by the vocoded signal’s high-reliability.

Cross-modal suppression model of speech perception: Visual information drives suppressive interactions between visual and auditory speech in pSTG

Cross-modal suppression model of speech perception: Visual information drives suppressive interactions between visual and auditory speech in pSTG

Inducing tunable single-mode operation of Fabry-Perot semiconductor laser coupled with very-short cavity with selective optical feedback

We report on achieving tuned single mode operation of a multimode semiconductor laser by coupling it to a very-short external cavity with selective feedback. We show that the induced uniform feedback light from the very-short external cavity can induce single-mode oscillation over a broad range of optical feedback. Then by applying selective external to the optimum settings of the single-mode oscillation, we predict tuning of the single-mode output over a wavelength range of ~ 20 nm by detuning the peak wavelength of optical feedback from the central wavelength of the modal gain. The study is based on modeling of the dynamics of multimode semiconductor laser subject to selective optical feedback. The model takes into account mechanisms of both self- and cross-modal gain suppression, and the study is concerned with the very-short external cavity that corresponds to stable continuous-wave (CW) operation.

Audiovisual Speech Enhancement via Cross-Modal Suppression of Auditory Association Cortex by Visual Speech

Abstract INTRODUCTION Speech is multisensory. The addition of visual speech to auditory speech greatly improves comprehension, especially under noisy auditory conditions. However, the neural mechanism for this visual enhancement of auditory speech is poorly understood. We used electrocorticography (ECoG) to study how auditory, visual, and audiovisual speech is processed in the posterior superior temporal gyrus (pSTG), an area of auditory association cortex involved in audiovisual speech integration. We hypothesized that early visual mouth movements modulate audiovisual speech integration through a mechanism of cross-modal suppression, suggesting that the pSTG response to early mouth movements should correlate with comprehension benefits gained by the addition of visual speech to auditory speech. METHODS Words were presented under auditory-only (AUD), visual-only (VIS), and audiovisual (AV) conditions to epilepsy patients (n = 8) implanted with intracranial electrodes for phase-2 monitoring. We measured high-frequency broadband activity (75-150 Hz), a marker for local neuronal firing, in 28 electrodes over the pSTG. RESULTS The early neural response to visual-only words was compared to the reduction in neural response seen from AUD to AV words, a reduction correlated with an improvement in speech comprehension that occurs with the addition of visual to auditory speech. In words that showed a comprehension benefit with the addition of visual speech, there was a strong early response to visual speech and a correlation between early visual response and the AUD-AV difference (r = 0.64, P = 104). In words where visual speech did not provide any comprehension benefit, there was a weak early visual response and no correlation (r = 0.18, P = .35). CONCLUSION Words with a visual speech comprehension benefit also elicit a strong neural response to early visual speech in pSTG, while words with no comprehension benefit do not cause a strong early response. This suggests that cross-modal suppression of auditory association cortex (pSTG) by early visual plays an important role in audiovisual speech perception.

Overlapping Anatomical Networks Convey Cross-Modal Suppression in the Sighted and Coactivation of “Visual” and Auditory Cortex in the Blind

In the present combined DTI/fMRI study we investigated adaptive plasticity of neural networks involved in controlling spatial and nonspatial auditory working memory in the early blind (EB). In both EB and sighted controls (SC), fractional anisotropy (FA) within the right inferior longitudinal fasciculus correlated positively with accuracy in a one-back sound localization but not sound identification task. The neural tracts passing through the cluster of significant correlation connected auditory and "visual" areas in the right hemisphere. Activity in these areas during both sound localization and identification correlated with FA within the anterior corpus callosum, anterior thalamic radiation, and inferior fronto-occipital fasciculus. In EB, FA in these structures correlated positively with activity in both auditory and "visual" areas, whereas FA in SC correlated positively with activity in auditory and negatively with activity in visual areas. The results indicate that frontal white matter conveys cross-modal suppression of occipital areas in SC, while it mediates coactivation of auditory and reorganized "visual" cortex in EB.

Mechanisms underlying auditory and cross-modal emotional attentional biases: Engagement with and disengagement from aversive auditory stimuli

There has been no consistent conclusion concerning whether auditory spatial attention or visual spatial attention could be modulated by auditory aversive cues. In three experiments, we used direct aversive auditory stimuli (white noise) as cues and explored which subcomponents of attentional bias contribute to auditory and cross-modal spatial attention in unselected samples. In Experiment 1, in a dot-probe paradigm, we adopted auditory stimuli (aversive or neutral) as cues and a tick sound as target, and we set two stimulus onset asynchrony (SOA) conditions: 150 ms and 500 ms. The results of experiment 1 showed that participants performed faster on congruent trials than on incongruent trials and participants exhibited an auditory emotional attentional bias to aversive auditory stimuli in 150 ms SOA condition. Subsequently, in experiment 2 and experiment 3, we employed an auditory emotional spatial cueing task using neutral and negative auditory stimuli as cues. Targets were auditory stimuli (Experiment 2) or visual stimuli (Experiment 3). The results of experiment 2 showed that participants performed faster to targets primed by negative cues than to those primed by neutral cues in valid condition; and performed slower to targets primed by negative cues than to those primed by neutral cues in invalid condition in 150 ms SOA condition. Experiment 2 revealed that speeded engagement with and delayed disengagement from aversive auditory stimuli were both present at a 150 ms SOA condition; at 500 ms SOA condition, only the former effect was present, and auditory inhibition of return was also observed. Experiment 3 produced similar results cross-modally, but cross-modal inhibition of return was not observed. In all experiments, we conclude that emotional attention can operate within the auditory modality and across sensory modalities, and that both engagement and disengagement bias contribute to auditory and cross-modal emotional attention.

Electrophysiological evidence of an attentional bias in crossmodal inhibition of return

Inhibition of return (IOR) refers to a delay in responding to targets when they appear at recently attended locations, relative to unattended locations. Within the visual modality, this attentional bias has been associated with a reduction in the N2pc event-related potential (ERP) component at previously attended locations. The present study examined whether a similar attentional bias was observed in crossmodal audio-visual IOR. Our results demonstrate that for visual targets, the attentional component of IOR behaves similarly for both unimodal and crossmodal target pairs, as indexed by a reduction in the N2pc component for targets appearing at previously attended locations. Further, similar IOR-related modulations on the auditory-evoked N2ac indicated that an attentional bias can be observed for auditory targets as well. Finally, we identified two additional ERP components – the ACOP and VCAN – that appear to reflect biasing of attention in the currently unattended sensory modality. These results suggest that the inhibitory attentional bias that underlies the IOR effect may be supramodal and bias attention away from previously attended locations regardless of sensory modality.

A Neural Signature of Divisive Normalization at the Level of Multisensory Integration in Primate Cortex

Studies of multisensory integration by single neurons have traditionally emphasized empirical principles that describe nonlinear interactions between inputs from two sensory modalities. We previously proposed that many of these empirical principles could be explained by a divisive normalization mechanism operating in brain regions where multisensory integration occurs. This normalization model makes a critical diagnostic prediction: a non-preferred sensory input from one modality, which activates the neuron on its own, should suppress the response to a preferred input from another modality. We tested this prediction by recording from neurons in macaque area MSTd that integrate visual and vestibular cues regarding self-motion. We show that many MSTd neurons exhibit the diagnostic form of cross-modal suppression, whereas unisensory neurons in area MT do not. The normalization model also fits population responses better than a model based on subtractive inhibition. These findings provide strong support for a divisive normalization mechanism in multisensory integration.

Parallel linear dynamic models can mimic the McGurk effect in clinical populations.

One of the most common examples of audiovisual speech integration is the McGurk effect. As an example, an auditory syllable /ba/ recorded over incongruent lip movements that produce "ga" typically causes listeners to hear "da". This report hypothesizes reasons why certain clinical and listeners who are hard of hearing might be more susceptible to visual influence. Conversely, we also examine why other listeners appear less susceptible to the McGurk effect (i.e., they report hearing just the auditory stimulus without being influenced by the visual). Such explanations are accompanied by a mechanistic explanation of integration phenomena including visual inhibition of auditory information, or slower rate of accumulation of inputs. First, simulations of a linear dynamic parallel interactive model were instantiated using inhibition and facilitation to examine potential mechanisms underlying integration. In a second set of simulations, we systematically manipulated the inhibition parameter values to model data obtained from listeners with autism spectrum disorder. In summary, we argue that cross-modal inhibition parameter values explain individual variability in McGurk perceptibility. Nonetheless, different mechanisms should continue to be explored in an effort to better understand current data patterns in the audiovisual integration literature.

When audiovisual correspondence disturbs visual processing

Multisensory integration is known to create a more robust and reliable perceptual representation of one's environment. Specifically, a congruent auditory input can make a visual stimulus more salient, consequently enhancing the visibility and detection of the visual target. However, it remains largely unknown whether a congruent auditory input can also impair visual processing. In the current study, we demonstrate that temporally congruent auditory input disrupts visual processing, consequently slowing down visual target detection. More importantly, this cross-modal inhibition occurs only when the contrast of visual targets is high. When the contrast of visual targets is low, enhancement of visual target detection is observed, consistent with the prediction based on the principle of inverse effectiveness (PIE) in cross-modal integration. The switch of the behavioral effect of audiovisual interaction from benefit to cost further extends the PIE to encompass the suppressive cross-modal interaction.

Left ventral occipitotemporal activation during orthographic and semantic processing of auditory words

The present fMRI study investigated the hypothesis that activation of the left ventral occipitotemporal cortex (vOT) in response to auditory words can be attributed to lexical orthographic rather than lexico-semantic processing. To this end, we presented auditory words in both an orthographic (“three or four letter word?”) and a semantic (“living or nonliving?”) task. In addition, a auditory control condition presented tones in a pitch evaluation task. The results showed that the left vOT exhibited higher activation for orthographic relative to semantic processing of auditory words with a peak in the posterior part of vOT. Comparisons to the auditory control condition revealed that orthographic processing of auditory words elicited activation in a large vOT cluster. In contrast, activation for semantic processing was only weak and restricted to the middle part vOT. We interpret our findings as speaking for orthographic processing in left vOT. In particular, we suggest that activation in left middle vOT can be attributed to accessing orthographic whole-word representations. While activation of such representations was experimentally ascertained in the orthographic task, it might have also occurred automatically in the semantic task. Activation in the more posterior vOT region, on the other hand, may reflect the generation of explicit images of word-specific letter sequences required by the orthographic but not the semantic task. In addition, based on cross-modal suppression, the finding of marked deactivations in response to the auditory tones is taken to reflect the visual nature of representations and processes in left vOT.

Brain activity during divided and selective attention to auditory and visual sentence comprehension tasks.

Using functional magnetic resonance imaging (fMRI), we measured brain activity of human participants while they performed a sentence congruence judgment task in either the visual or auditory modality separately, or in both modalities simultaneously. Significant performance decrements were observed when attention was divided between the two modalities compared with when one modality was selectively attended. Compared with selective attention (i.e., single tasking), divided attention (i.e., dual-tasking) did not recruit additional cortical regions, but resulted in increased activity in medial and lateral frontal regions which were also activated by the component tasks when performed separately. Areas involved in semantic language processing were revealed predominantly in the left lateral prefrontal cortex by contrasting incongruent with congruent sentences. These areas also showed significant activity increases during divided attention in relation to selective attention. In the sensory cortices, no crossmodal inhibition was observed during divided attention when compared with selective attention to one modality. Our results suggest that the observed performance decrements during dual-tasking are due to interference of the two tasks because they utilize the same part of the cortex. Moreover, semantic dual-tasking did not appear to recruit additional brain areas in comparison with single tasking, and no crossmodal inhibition was observed during intermodal divided attention.

Balanced Crossmodal Excitation and Inhibition Essential for Maximizing Multisensory Gain

We examined whether and how the balancing of crossmodal excitation and inhibition affects intersensory facilitation. A neural network model, comprising lower-order unimodal networks (X, Y) and a higher-order multimodal network (M), was simulated. Crossmodal excitation was made by direct activation of principal cells of the X network by the Y network. Crossmodal inhibition was made in an indirect manner: the Y network activated glial cells of the X network. This let glial plasma membrane transporters export GABA molecules into the extracellular space and increased the level of ambient GABA. The ambient GABA molecules were accepted by extrasynaptic GABAa receptors and tonically inhibited principal cells of the X network. Namely, crossmodal inhibition was made through GABAergic gliotransmission. Intersensory facilitation was assessed in terms of multisensory gain: the difference between the numbers of spikes evoked by multisensory (XY) stimulation and unisensory (X-alone) stimulation. The maximal multisensory gain (XY-X) could be achieved at an intermediate noise level by balancing crossmodal excitation and inhibition. This result supports an experimentally derived conclusion: intersensory facilitation under noisy environmental conditions is not necessarily in accord with the principle of inverse effectiveness; rather, multisensory gain is maximal at intermediate signal-to-noise ratio (SNR) levels. The maximal multisensory gain was available at the weakest signal if noise was not present, indicating that the principle of inverse effectiveness is a special case of the intersensory facilitation model proposed here. We suggest that the balancing of crossmodal excitation and inhibition may be crucial for intersensory facilitation. The GABAergic glio-transmission-mediated crossmodal inhibitory mechanism effectively works for intersensory facilitation and on determining the maximal multisensory gain in the entire SNR range between the two extremes: low and high SNRs.

Are you listening? Brain activation associated with sustained nonspatial auditory attention in the presence and absence of stimulation

Neuroimaging studies investigating the voluntary (top-down) control of attention largely agree that this process recruits several frontal and parietal brain regions. Since most studies used attention tasks requiring several higher-order cognitive functions (e.g. working memory, semantic processing, temporal integration, spatial orienting) as well as different attentional mechanisms (attention shifting, distractor filtering), it is unclear what exactly the observed frontoparietal activations reflect. The present functional magnetic resonance imaging study investigated, within the same participants, signal changes in (1) a "Simple Attention" task in which participants attended to a single melody, (2) a "Selective Attention" task in which they simultaneously ignored another melody, and (3) a "Beep Monitoring" task in which participants listened in silence for a faint beep. Compared to resting conditions with identical stimulation, all tasks produced robust activation increases in auditory cortex, cross-modal inhibition in visual and somatosensory cortex, and decreases in the default mode network, indicating that participants were indeed focusing their attention on the auditory domain. However, signal increases in frontal and parietal brain areas were only observed for tasks 1 and 2, but completely absent for task 3. These results lead to the following conclusions: under most conditions, frontoparietal activations are crucial for attention since they subserve higher-order cognitive functions inherently related to attention. However, under circumstances that minimize other demands, nonspatial auditory attention in the absence of stimulation can be maintained without concurrent frontal or parietal activations.