Neural Evidence Research Articles

Pre-attentive fundamental frequency processing in Mandarin-speaking children with cochlear implants as revealed by the peak latency of positive mismatch response.

Fundamental frequency (F0) serves as the primary acoustic cue for Mandarin tone perception. Recent behavioral studies suggest that F0 information may be differently processed between Mandarin-speaking normal-hearing (NH) children and children with cochlear implants (CIs), which may partially explain the unsatisfactory outcome of lexical tone recognition using CIs with tonal language-oriented speech processing strategies. The aim of the current study was to provide neural evidence of F0 processing in Mandarin-speaking kindergarten-aged children with CIs compared with NH children. Positive mismatch responses (p-MMRs) to the change of the two acoustic dimensions of F0 (F0 contour and F0 level) in Mandarin-speaking kindergarten-aged children with CIs (n = 19) and their age-matched NH peers (n = 21). The two groups of children did not show any significant difference on the mean amplitude of p-MMR to either F0 contour or F0 level change. While the CI group exhibited a significantly shorter peak latency of p-MMR to F0 contour change than to F0 level change, an opposite pattern was observed in the NH group. This study revealed a higher sensitivity to F0 contour change than to F0 level change in children with CIs, which was different from that in NH children. The neural evidence of discrepant F0 processing between children with CIs and NH children in this study was consistent with the previously reported behavioral findings and may serve as a reference for the development and improvement of tonal language-oriented speech processing strategies.

Effect of exogenous testosterone in the context of energy deficit on risky choice: Behavioural and neural evidence from males

Previous research has shown greater risk aversion when people make choices about lives than cash. We tested the hypothesis that compared to placebo, exogenous testosterone administration would lead to riskier choices about cash than lives, given testosterone’s association with financial risk-taking and reward sensitivity. A double-blind, placebo-controlled, randomized trial was conducted to test this hypothesis (Clinical Trials Registry: NCT02734238, www.clinicaltrials.gov). We collected functional magnetic resonance imaging (fMRI) data from 50 non-obese males before and shortly after 28 days of severe exercise-and-diet-induced energy deficit, during which testosterone (200 mg testosterone enanthate per week in sesame oil) or placebo (sesame seed oil only) was administered. Because we expected circulating testosterone levels to be reduced due to severe energy deficit, testosterone administration served a restorative function to mitigate the impact of energy deficit on testosterone levels. The fMRI task involved making choices under uncertainty for lives and cash. We also manipulated whether the outcomes were presented as gains or losses. Consistent with prospect theory, we observed the reflection effect such that participants were more risk averse when outcomes were presented as gains than losses. Brain activation in the thalamus covaried with individual differences in exhibiting the reflection effect. Testosterone did not impact choice, but it increased sensitivity to negative feedback following risky choices. These results suggest that exogenous testosterone administration in the context of energy deficit can impact some aspects of risky choice, and that individual differences in the reflection effect engage a brain structure involved in processing emotion, reward and risk.

Programming ability prediction: Applying an attention-based convolutional neural network to functional near-infrared spectroscopy analyses of working memory.

Although theoretical studies have suggested that working-memory capacity is crucial for academic achievement, few empirical studies have directly investigated the relationship between working-memory capacity and programming ability, and no direct neural evidence has been reported to support this relationship. The present study aimed to fill this gap in the literature. Using a between-subject design, 17 programming novices and 18 advanced students performed an n-back working-memory task. During the experiment, their prefrontal hemodynamic responses were measured using a 48-channel functional near-infrared spectroscopy (fNIRS) device. The results indicated that the advanced students had a higher working-memory capacity than the novice students, validating the relationship between programming ability and working memory. The analysis results also showed that the hemodynamic responses in the prefrontal cortex can be used to discriminate between novices and advanced students. Additionally, we utilized an attention-based convolutional neural network to analyze the spatial domains of the fNIRS signals and demonstrated that the left prefrontal cortex was more important than other brain regions for programming ability prediction. This result was consistent with the results of statistical analysis, which in turn improved the interpretability of neural networks.

The functional connectivity between left insula and left medial superior frontal gyrus underlying the relationship between rumination and procrastination

Procrastination is regarded as a prevalent problematic behavior that impairs people’s physical and mental health. Although previous studies have indicated that trait rumination is robustly positively correlated with procrastination, it remains unknown about the neural substrates underlying the relationship between trait rumination and procrastination. To address this issue, we used voxel-based morphometry (VBM) and resting-state functional connectivity (RSFC) approaches to explore the neural basis of the relationship between trait rumination and procrastination. Our behavior results found that trait rumination was significantly positively correlated to procrastination, while the VBM analysis showed that trait rumination was negatively correlated with gray matter volume of the insula. Furthermore, the RSFC results revealed a negative association of the left insula-lmSFG (left medial superior frontal gyrus) functional connectivity with trait rumination. More importantly, the mediation analysis showed that trait rumination could completely mediate the relationship between left insula-lmSFG functional connectivity and procrastination. These results suggest that the left insula-lmSFG functional connectivity involved in emotion regulation modulates the association between trait rumination and procrastination, which provides neural evidence for the relationship between trait rumination and procrastination.

Neural evidence suggests phonological acceptability judgments reflect similarity, not constraint evaluation

Acceptability judgments are a primary source of evidence in formal linguistic research. Within the generative linguistic tradition, these judgments are attributed to evaluation of novel forms based on implicit knowledge of rules or constraints governing well-formedness. In the domain of phonological acceptability judgments, other factors including ease of articulation and similarity to known forms have been hypothesized to influence evaluation. We used data-driven neural techniques to identify the relative contributions of these factors. Granger causality analysis of magnetic resonance imaging (MRI)-constrained magnetoencephalography (MEG) and electroencephalography (EEG) data revealed patterns of interaction between brain regions that support explicit judgments of the phonological acceptability of spoken nonwords. Comparisons of data obtained with nonwords that varied in terms of onset consonant cluster attestation and acceptability revealed different cortical regions and effective connectivity patterns associated with phonological acceptability judgments. Attested forms produced stronger influences of brain regions implicated in lexical representation and sensorimotor simulation on acoustic-phonetic regions, whereas unattested forms produced stronger influence of phonological control mechanisms on acoustic-phonetic processing. Unacceptable forms produced widespread patterns of interaction consistent with attempted search or repair. Together, these results suggest that speakers' phonological acceptability judgments reflect lexical and sensorimotor factors.

Pleasure of paying when using mobile payment: Evidence from EEG studies.

Mobile payment has emerged as a popular payment method in many countries. While much research has focused on the antecedents of mobile payment adoption, limited research has investigated the consequences of mobile payment usage relating to how it would influence consumer behaviors (e.g., purchase intention or willingness to pay). Here, we propose that mobile payment not just reduces the "pain of paying," a traditional view explaining why cashless payment stimulates spending, but it also evokes the "pleasure of paying," raising from the enhanced processing fluency in completing transactions. We tested this new conceptualization of "pleasure of paying" using EEG, complementing other behavioral measures. In two studies, we found that mobile payment effectively enhanced purchase likelihood (study 1, N = 66) and such an enhancement is generalizable to both hedonic and utilitarian products (study 2, N = 29). By employing EEG measures, we provided the first neural evidence of "pleasure of paying" in addition to the signal of "pain of paying." Critically, we demonstrated that the "pleasure of paying" is a distinctive psychological mechanism that is induced by mobile payment usage and that the "pleasure of paying" joins the "pain of paying" to mediate the increased purchase intention. We discuss the contributions and implications of these results to the ongoing evolution of cashless payment societies.

Motivation from Agency and Reward in Typical Development and Autism: Narrative Review of Behavioral and Neural Evidence.

Our ability to perform voluntary actions and make choices is shaped by the motivation from having control over the resulting effects (agency) and positive outcomes (reward). We offer an overview of distinct and common behavioral and neural signatures of agency and reward. We discuss their typical and atypical developmental trajectories, focusing on autism spectrum disorder (ASD), which is characterized by neurodiverse processes underlying action selection. We propose that reduced sensitivity to agency and reward in ASD may be related to atypical multisensory processes and motor planning, with potential for understanding restricted and repetitive behaviors. We emphasize the limitations of the existing literature, and prospects for future research. Understanding the neurocognitive processes that shape the way people with ASD select actions and perceive outcomes is essential to support not only learning, but also volition and self-determination.

A comparison of the functional connectome in mild traumatic brain injury and post-traumatic stress disorder.

Post-traumatic stress disorder (PTSD) and mild traumatic brain injury (mTBI) often co-occur in the context of threat to one's life. These conditions also have an overlapping symptomatology and include symptoms of anxiety, poor concentration and memory problems. A major challenge has been articulating the underlying neurobiology of these overlapping conditions. The primary aim of this study was to compare intrinsic functional connectivity between mTBI (without PTSD) and PTSD (without mTBI). The study included functional MRI data from 176 participants: 42 participants with mTBI, 67 with PTSD and a comparison group of 66 age and sex-matched healthy controls. We used network-based statistical analyses for connectome-wide comparisons of intrinsic functional connectivity between mTBI relative to PTSD and controls. Our results showed no connectivity differences between mTBI and PTSD groups. However, we did find that mTBI had significantly reduced connectivity relative to healthy controls within an extensive network of regions including default mode, executive control, visual and auditory networks. The mTBI group also displayed hyperconnectivity between dorsal and ventral attention networks and perceptual regions. The PTSD group also demonstrated abnormal connectivity within these networks relative to controls. Connectivity alterations were not associated with severity of PTSD or post-concussive symptoms in either clinical group. Taken together, the similar profiles of intrinsic connectivity alterations in these two conditions provide neural evidence that can explain, in part, the overlapping symptomatology between mTBI and PTSD.

Neural evidence for a separation of semantic and phonological control processes

There remain major doubts about the nature and domain specificity of inhibitory control processes, both within and between cognitive domains. This study examined inhibitory processes within the language domain, by contrasting semantic versus phonological inhibitory control. In an fMRI experiment, elderly participants performed phonological and semantic inhibitory control tasks involving resistance to highly or weakly interfering stimuli. In the semantic domain, inhibitory control effects, contrasting high vs. low interference control levels, were observed at univariate and multivariate levels in all fronto-parieto-temporal region-of-interests. In the phonological domain, inhibitory control effects were observed only at multivariate levels, and were restricted to the pars triangularis of the bilateral inferior frontal gyrus and to the left middle temporal gyrus. Critically, no reliable multivariate cross-domain prediction of neural patterns associated with inhibitory control was observed. This study supports a functional dissociation of the neural substrates associated with inhibitory control for phonological vs. semantic domains.

“Neurotic people tend to eat less when disinhibited”: The mediating role of food-related cognitive flexibility in restrained eaters

ObjectivesThis study aims to reveal the individual differences in Neuroticism and cognitive flexibility among successful restrained eaters (SREs), unsuccessful restrained eaters (UREs), and non-restrained eaters (NREs). Moreover, this study is dedicated to investigating whether certain personality traits and cognitive flexibility could concurrently influence disinhibited eating behaviors among restrained eaters and reveal the pathways through which they interact. MethodsFemale participants aged 17 and 24 years (NREs = 23; SREs = 24; UREs = 23) were assessed with body mass index (BMI) and appetite state measurement, the Dutch Eating Behavior Questionnaire (DEBQ), the NEO Five-Factor Inventory (NEO-FFI), and the Positive and Negative Affect Schedule. To measure behavioral and neural responses related to cognitive flexibility, participants were required to complete a food-related switching task, and their brain activities were recorded through the technique of electroencephalography (EEG). Here we analyzed two widely investigated components—the N2 and P3 components that separately relate to conflict monitoring and response inhibition. ResultsThe behavioral performance of food-related task switching did not show significant between-group differences. However, in comparison to NREs and SREs, UREs elicited larger N2 and lower P3 amplitudes during task switching. In addition, UREs exhibited a lower level of Neuroticism than SREs and NREs. Furthermore, food-related task switching induced N2 amplitude fully mediated the association between Neuroticism and disinhibited eating behavior in restrained eaters controlled for BMI and negative affect. Importantly, when a parallel mediation model with N2 and P3 was built concurrently, N2 was still able to fully mediate the association. ConclusionAccording to behavioral and neural evidence, increased N2 amplitude induced by food-related task switching totally mediated the negative association between Neuroticism and disinhibited eating in restrained eaters.

Cosmetic makeup enhances facial attractiveness and affective neural responses.

Although it is well established that cosmetic makeup enhances perceived facial attractiveness, few studies have examined whether facial makeup modulates neural responses to face images. This study investigated behavioral and attractiveness-related brain responses to self-applied makeup, focusing on the N170, early posterior negativity, P300, and late positive potential components of event-related brain potentials. A total of 77 Japanese women participated in two experiments (N = 34 and 43 for Experiments 1 and 2, respectively). Experiment 1 assessed the effects of self-applied makeup on attractiveness-related event-related potential amplitudes using facial images during a makeup identification task in which makeup was directly relevant to task demands. Experiment 2 examined the effects of self-applied makeup using images of one's own face and another female's face when performing a gender classification task, where the presence of makeup had no explicit connection to facial gender classification. In both experiments, faces with makeup were rated as more attractive and elicited more negative early posterior negativity and more positive late positive potential components, regardless of the participant's own face or another person's face. These findings suggest that people are spontaneously motivated to pay visual attention to faces with makeup, which supports the idea that makeup adds reward value to the facial appearance of the human. Moreover, neural evidence empirically confirmed that the benefits of makeup are not just limited to how others see your face but also extend to how you see your own face.

Neural evidence for non-orofacial triggers in mild misophonia.

Misophonia, an extreme aversion to certain environmental sounds, is a highly prevalent yet understudied condition plaguing roughly 20% of the general population. Although neuroimaging research on misophonia is scant, recent work showing higher resting-state functional connectivity (rs-fMRI) between auditory cortex and orofacial motor cortex in misophonia vs. controls has led researchers to speculate that misophonia is caused by orofacial mirror neurons. Since orofacial motor cortex was defined using rs-fMRI, we attempted to theoretically replicate these findings using orofacial cortex defined by task-based fMRI instead. Further, given our recent work showing that a wide variety of sounds can be triggering (i.e., not just oral/nasal sounds), we investigated whether there is any neural evidence for misophonic aversion to non-orofacial stimuli. Sampling 19 adults with varying misophonia from the community, we collected resting state data and an fMRI task involving phoneme articulation and finger-tapping. We first defined “orofacial” cortex in each participant using rs-fMRI as done previously, producing what we call resting-state regions of interest (rsROIs). Additionally, we functionally defined regions (fROIs) representing “orofacial” or “finger” cortex using phoneme or finger-tapping activation from the fMRI task, respectively. To investigate the motor specificity of connectivity differences, we subdivided the rsROIs and fROIs into separate sensorimotor areas based on their overlap with two common atlases. We then calculated rs-fMRI between each rsROI/fROI and a priori non-sensorimotor ROIs. We found increased connectivity in mild misophonia between rsROIs and both auditory cortex and insula, theoretically replicating previous results, with differences extending across multiple sensorimotor regions. However, the orofacial task-based fROIs did not show this pattern, suggesting the “orofacial” cortex described previously was not capturing true orofacial cortex; in fact, using task-based fMRI evidence, we find no selectivity to orofacial action in these previously described “orofacial” regions. Instead, we observed higher connectivity between finger fROIs and insula in mild misophonia, demonstrating neural evidence for non-orofacial triggers. These results provide support for a neural representation of misophonia beyond merely an orofacial/motor origin, leading to important implications for the conceptualization and treatment of misophonia.

Learning from Ingroup Experiences Changes Intergroup Impressions.

Humans form impressions toward individuals of their own social groups (ingroup members) and of different social groups (outgroup members). Outgroup-focused theories predict that intergroup impressions are mainly shaped by experiences with outgroup individuals, while ingroup-focused theories predict that ingroup experiences play a dominant role. Here we test predictions from these two psychological theories by estimating how intergroup impressions are dynamically shaped when people learn from both ingroup and outgroup experiences. While undergoing fMRI, male participants had identical experiences with different ingroup or outgroup members and rated their social closeness and impressions toward the ingroup and the outgroup. Behavioral results showed an initial ingroup bias in impression ratings which was significantly reduced over the course of learning, with larger effects in individuals with stronger ingroup identification. Computational learning models revealed that these changes in intergroup impressions were predicted by the weight given to ingroup prediction errors. Neurally, the individual weight for ingroup prediction errors was related to the coupling between the left inferior parietal lobule and the left anterior insula, which, in turn, predicted learning-related changes in intergroup impressions. Our findings provide computational and neural evidence for ingroup-focused theories, highlighting the importance of ingroup experiences in shaping social impressions in intergroup settings.SIGNIFICANCE STATEMENT Living in multicultural societies, humans interact with individuals of their own social groups (ingroup members) and of different social groups (outgroup members). However, little is known about how people learn from the mixture of ingroup and outgroup interactions, the most natural experiences in current societies. Here, participants had identical, intermixed experiences with different ingroup and outgroup individuals and rated their closeness and impressions toward the ingroup and the outgroup. Combining computational models and fMRI, we find that the weight given to ingroup experiences (ingroup prediction errors) is the main source of intergroup impression change, captured by changes in connectivity between the parietal lobe and insula. These findings highlight the importance of ingroup experiences in shaping intergroup impressions in complex social environments.

Personality traits modulate the neural responses to handwriting processing.

Handwriting is a vital skill for everyday human activities. It has a wealth of information about writers' characteristics and can hint toward underlying neurological conditions, such as Parkinson's disease, autism, dyslexia, and attention-deficit/hyperactivity disorder (ADHD). Many previous studies have reported a link between personality and individual differences in handwriting, but the evidence for the relationship tends to be anecdotal in nature. Using functional magnetic resonance imaging (fMRI), we examined whether the association between personality traits and handwriting was instantiated at the neural level. Results showed that the personality trait of conscientiousness modulated brain activation in the left premotor cortex and right inferior/middle frontal gyrus, which may reflect the impact of personality on orthography-to-grapheme transformation and executive control involved in handwriting. Such correlations were not observed in symbol-drawing or word-reading tasks, suggesting the specificity of the link between conscientiousness and handwriting in these regions. Moreover, using a connectome-based predictive modeling approach, we found that individuals' conscientiousness scores could be predicted based on handwriting-related functional brain networks, suggesting that the influence of personality on handwriting may occur within a broader network. Our findings provide neural evidence for the link between personality and handwriting processing, extending our understanding of the nature of individual differences in handwriting.

Neural dissociation of visual attention span and phonological deficits in developmental dyslexia: A hub-based white matter network analysis.

It has been suggested that developmental dyslexia may have two dissociable causes-a phonological deficit and a visual attention span (VAS) deficit. Yet, neural evidence for such a dissociation is still lacking. This study adopted a data-driven approach to white matter network analysis to explore hubs and hub-related networks corresponding to VAS and phonological accuracy in a group of French dyslexic children aged from 9 to 14 years. A double dissociation in brain-behavior relations was observed. Structural connectivity of the occipital-parietal network surrounding the left superior occipital gyrus hub accounted for individual differences in dyslexic children's VAS, but not in phonological processing accuracy. In contrast, structural connectivity of two networks: the temporal-parietal-occipital network surrounding the left middle temporal gyrus hub and the frontal network surrounding the left medial orbital superior frontal gyrus hub, accounted for individual differences in dyslexic children's phonological processing accuracy, but not in VAS. Our findings provide evidence in favor of distinct neural circuits corresponding to VAS and phonological deficits in developmental dyslexia. The study points to connectivity-constrained white matter subnetwork dysfunction as a key principle for understanding individual differences of cognitive deficits in developmental dyslexia.

Neuroscientific Evidence for Processing Without Awareness.

The extent to which we are affected by perceptual input of which we are unaware is widely debated. By measuring neural responses to sensory stimulation, neuroscientific data could complement behavioral results with valuable evidence. Here we review neuroscientific findings of processing of high-level information, as well as interactions with attention and memory. Although the results are mixed, we find initial support for processing object categories and words, possibly to the semantic level, as well as emotional expressions. Robust neural evidence for face individuation and integration of sentences or scenes is lacking. Attention affects the processing of stimuli that are not consciously perceived, and such stimuli may exogenously but not endogenously capture attention when relevant, and be maintained in memory over time. Sources of inconsistency in the literature include variability in control for awareness as well as individual differences, calling for future studies that adopt stricter measures of awareness and probe multiple processes within subjects.

Alienation and identification in addiction

ABSTRACT A recent strand in the philosophical literature on addiction emphasizes problems with diachronic self-control. Hanna Pickard, for example, argues that an important aspect of addiction consists in inability to identify with a non-addicted future self. This literature sits alongside another that treats addiction as the product of neural changes that “hijack” mechanisms of reward prediction, habit formation decision making and cognitive control. This hijacking literature originates in accounts that treat the neural changes characteristic of addiction as a brain disease. This paper provides a framework based on predictive processing accounts of self-awareness that integrates the hijacking and diachronic accounts. I discuss a hijacking account proposed to explain disruption of addiction following lesion to the anterior insula cortex. I show how insula activity contributes to the type of identification implicated in diachronic accounts and how deactivation of the anterior insula can disrupt addiction by alienating the subject from her addictive tendencies. This is consistent with neural evidence but also incorporates the personal level features of addiction that are opaque to neural level explanation

Country-Brand Fit: The Effect of COO Stereotypes and Brand Positioning Consistency on Consumer Behavior: Evidence From EEG Theta-Band Oscillation.

Grounded on the cognitive consistency theory, this paper adopts the prime-probe paradigm and Electroencephalography (EEG) experiment to examine the impact of country-of-origin (COO) stereotypes-brand positioning congruence on consumer behavior, the boundary effect of brand positioning strategy, as well as the underlying cognitive mechanism. Behaviorally, consumers show a higher purchase intention in the congruence condition. Moreover, this congruence effect of purchase intention can be found for competence brand positioning strategies rather than warmth brand positioning strategies. At the brain level, we found that compared with the congruence condition, the incongruence condition enhances consumers' cognitive conflict, reflected in enhanced frontal theta-band oscillation. Furthermore, the cognitive conflict effect is accentuated in the competence positioning strategy condition rather than the warmth strategy positioning condition, confirming the boundary effect of brand positioning strategy from the brain level. These findings provide neural evidence that the congruence between COO stereotypes and brand positioning influences consumer purchase behavior, reveals a boundary effect in the COO stereotype-brand positioning congruence, and highlights the importance of the competence dimension. Finally, the theoretical and practical implications are discussed.

Facial attractiveness is more associated with individual warmth than with competence: Behavioral and neural evidence

ABSTRACT Individuals appear to infer others’ psychological characteristics according to facial attractiveness and these psychological characteristics can be classified into two categories in social cognition, that is, warmth and competence. However, which category of psychological characteristic is more associated with face attractiveness and its neural mechanisms have not been explored. To address this, participants were asked to judge others’ warmth and competence traits based on face attractiveness, while their brains were scanned using functional magnetic resonance imaging (fMRI). They also assessed the attractiveness of faces after scanning. Behavioral results showed that the correlation between face attractiveness and warmth ratings was significantly higher than that with competence ratings. fMRI results demonstrated that the dorsomedial prefrontal cortex (dmPFC), temporoparietal junction (TPJ), lateral prefrontal cortex, and lateral temporal lobe were more involved in the warmth task. Moreover, attractiveness ratings were negatively correlated with activation of the dmPFC and TPJ only in the warmth task. Furthermore, the attractiveness ratings were negatively correlated with the defined dmPFC, region related to attractiveness judgment, only in the warmth task. In conclusion, people are more inclined to infer others’ warmth than competence characteristics from face attractiveness, that is, face attractiveness is more associated with warmth than with competence.

The modality shifting effects in the multisensory integration paradigm

<p id="p00005">Signals from different sensory channels can be integrated and processed in the brain. Compared with stimuli from a single sensory modality, individual responses are faster for multisensory target signals; this is defined as the redundant signal effect. One of the main theories explaining the redundant signal effect is the co-activation model. According to the co-activation model, the signal input through multiple sensory channels is integrated into specialized brain regions, such as the intraparietal sulcus, superior temporal sulcus, and prefrontal lobe regions. Related regions collaborate through neural oscillations. The strength of the integrated signal is stronger relative to the signal in single channel, which can trigger the reaction more quickly. However, the phase of cognitive processing at which the integration of the multisensory signals occurs is not confirmed. <br/>Task switching is an important paradigm for studying cognitive control. Participants are slower when completing the switch task than when completing the repetitive task. At the same time, the error rate is greater because of the switching cost. When a shift occurs between different modal stimuli, there is also a cost in relation to the sensory channel changing—the modality shift effect. That is, owing to the modality shifting between successive sensory channels, individuals have a longer reaction time. Nevertheless, few studies have thoroughly explored the neural mechanisms of the modality shift effect. When the task is switched between different modalities, modal and task are all shifted. The cost of task switching associated with the cross-modal is more than the single modality switching cost or the task switching cost but less than the sum of the two kinds of loss. This provides evidence for the hypothesis that the switching cost associated with different sensory channels is derived from inertia and interference of the task set. In addition, the modality shift effect also exists in the paradigm of the redundant signal effect. Due to the shift of the sensory channel, the reaction time of the participants would be slower for the single sensory channel. Therefore, the existence of modality shift loss provides a different approach to the two classical theoretical models to explain the source of the redundant signal effect. Moreover, when modality switching occurs between single-modal and multi-sensory signals, the modality switching cost will decrease or even disappear, which is due to the multisensory integration offsetting a part of the loss. This supports the co-activation model. <br/>Finally, if the stimulation in the task switch paradigm is present in a multisensory channel, there is simultaneous task shifting and multisensory integration. The redundant signal effect may offset the switching cost, affecting the synchronous changes in neural oscillations and the intensity of activation in the relevant brain regions. However, it is unclear how multisensory integration affects the neural processing of the task switch, which would require more brain and neural evidence to demonstrate. Further studies could try to solve this problem by combining the multisensory integration research paradigm with the classic task-switching paradigm, exploring whether task-switching and cross-modal shifting share a common cognitive processing center. Furthermore, future studies could help to determine the processing mechanism of the cross-modal shift, source of loss, and processing phase of multisensory integration.