Cross-modal Reorganization Research Articles

Bidirectional remodeling of the central auditory system caused by unilateral auditory deprivation.

Unilateral auditory deprivation (UAD) results in cross-modal reorganization of the auditory cortex (AC), which can impair auditory and cognitive functions and diminish the recovery effect of cochlear implantation. Moreover, the subcortical areas provide extensive ascending projections to the AC. To date, a thorough systematic study of subcortical auditory neural plasticity has not been undertaken. Therefore, this review aims to summarize the current evidence on the bidirectional remodeling of the central auditory system caused by UAD, particularly the changes in subcortical neural plasticity. Lateral changes occur in the cochlear nucleus, lateral superior olive, medial nucleus of the trapezoid body, inferior colliculus, and AC of individuals with UAD. Moreover, asymmetric neural activity becomes less prominent in the higher auditory nuclei, which may be due to cross-projection regulation of the bilateral pathway. As a result, subcortical auditory neural plasticity caused by UAD may contribute to the outcomes of cochlear implantation in patients with single-sided deafness (SSD), and the development of intervention strategies for patients with SSD is crucial. Considering that previous studies have focused predominantly on the neural plasticity of the AC, we believe that bidirectional remodeling of subcortical areas after UAD is also crucial for investigating the mechanisms of interventions.

Cross-modal plasticity in children with cochlear implant: converging evidence from electroencephalography and functional near-infrared spectroscopy

Abstract Over the first years of life, the brain undergoes substantial organization in response to environmental stimulation. In a silent world, it may promote vision by 1) recruiting resources from the auditory cortex and 2) making the visual cortex more efficient. It is unclear when such changes occur and how adaptive they are, questions that children with cochlear implants can help address. Here, we examined 7 to 18 years old children: 50 had cochlear implants, with delayed or age-appropriate language abilities, and 25 had typical hearing and language. High-density electroencephalography and functional near-infrared spectroscopy were used to evaluate cortical responses to a low-level visual task. Evidence for a weaker visual cortex response and less synchronized or less inhibitory activity of auditory association areas in the implanted children with language delays suggests that cross-modal reorganization can be maladaptive and does not necessarily strengthen the dominant visual sense.

Speech Comprehension by Cochlear Implant Users Assessed with Evoked Potentials and Response Times

Introduction: Cochlear implant (CI) users differ greatly in their rehabilitation outcomes, including speech understanding in noise. This variability may be related to brain changes associated with intact senses recruiting cortical areas from stimulation-deprived senses. Numerous studies have demonstrated such cross-modal reorganization in individuals with untreated hearing loss. How it is affected by regular use of hearing devices remains unclear, however. To shed light on this, the current study measured cortical responses reflecting comprehension abilities in experienced CI users and normal-hearing controls. Methods: Using multichannel electroencephalography, we tested CI users who had used their devices for at least 12 months and closely matched controls (N = 2 × 13). Cortical responses reflecting comprehension abilities – the N400 and late positive complex (LPC) components – were evoked using congruent and incongruent digit-triplet stimuli. The participants’ task was to assess digit-triplet congruency by means of timed button presses. All measurements were performed in speech-shaped noise 15 dB above individually measured speech recognition thresholds. Three stimulus presentation modes were used: auditory-only, visual-only, and visual-then-auditory. Results: The analyses revealed no group differences in the N400 and LPC responses. In terms of response times, the CI users were slower and differentially affected by the three stimulus presentation modes relative to the controls. Conclusion: Compared to normal-hearing controls, experienced CI users may need more time to comprehend speech in noise. Response times can serve as a proxy for speech comprehension by CI users.

Anatomical and Functional Impacts of Congenital Bilateral Visual Deprivation on the Visual Pathway-A Comprehensive Review.

Neuroplasticity is a complex process that is heightened during time-sensitive periods of pre- and postnatal brain development. It continues, albeit to a lesser extent, throughout adolescence and young adulthood. Congenital visual deprivation is well-known and explored in human-model behavioral research. In this study, we review existing research on neuroadaptations and neuroplasticity of the visual pathway as a result of inherited retinal diseases (IRD), focusing on data concerning congenital bilateral visual deprivation in humans published in PubMed in the past 5 years, including 18 articles. We highlight evidence about the anatomical and behavioral aspects of neuroplasticity as different brain responses to different types of visual deprivation. We also focus on various very interesting aspects of the cross-modal functional reorganization of the visual and auditory cortex as an example of brain plasticity due to combined visual and auditory loss. Our study shows that central nervous system magnetic resonance imaging (MRI) advancements have allowed researchers to report previously elusive anatomical evidence. Patients with a known mechanism of IRD-examined with high magnetic field MRI and functional MRI-have been proven to be adequate models to explore neuroadaptations of the visual pathway due to bilateral, early, and late visual deprivation.

Exploring cross-modal plasticity in the auditory-visual cortex post cochlear implantation: implications for auditory and speech function recovery and mechanisms.

The aim of this is to explore changes in cross-modal reorganization within the auditory-visual cortex after cochlear implantation, examining their influence on auditory and speech functions along with their underlying mechanisms. Twenty prelingually deaf children who received cochlear implantation and rehabilitation training at our hospital between February 2022 and February 2023 comprised the prelingual deaf group. Simultaneously, 20 healthy children served as the control group. The prelingual deaf group underwent brain cortical activity assessment and evaluation of auditory-speech recovery pre-surgery, at postoperative weeks 1 and 2, and at months 1, 3, 6, 9, and 12. The control group underwent parallel assessments and evaluations. We analyzed the correlation between cortical activity in the auditory-visual cortex of patients and their auditory-speech functional recovery. The group with prelingual deafness displayed elevated levels of auditory and visual cortical electromagnetic intensity compared to the control group, both prior to and 9 months after surgery. However, by the 12-month mark post-surgery, there was no discernible distinction between the two groups. Following surgery, the prelingually deaf group exhibited a progressive improvement in both Categories of Auditory Performance (CAP) and Speech Intelligibility Rate (SIR), initially lagging behind the control group. Notably, a negative correlation emerged between auditory and visual cortical electromagnetic intensity values and CAP/SIR scores at the 12-month post-surgery assessment. Cochlear implantation in prelingually deaf children results in elevated activity within the auditory and visual cortices, demonstrated by heightened electromagnetic intensity readings. Cross-modal reorganization is observed temporarily at 3 months post-surgery, which resolves to baseline levels by 12 months post-surgery. This phenomenon of reversal correlates with the restoration of auditory and speech functions in these children.

Alterations in Diffusion Tensor Imaging-derived Indices of Auditory Pathway-related Fiber Tracts in Children With Sensorineural Hearing Loss.

Hearing loss is the most common sensory-neurological defect in humans. The most common hearing impairment is sensorineural hearing loss (SNHL) caused by the inner ear and related nerves. Diffusion tensor imaging (DTI) is an advanced MRI technique that can provide valuable information about auditory neural pathways and their microstructural changes. The present study was designed to investigate the microstructural changes in auditory pathways-related fiber tracts in children with SNHL. Twenty-two children including 11 subjects with SNHL aged 1-4 years and 11 healthy children were examined as controls. Then, DTI-derived parameters, such as fractional anisotropy (FA), mean diffusivity (MD), axial diffusivity (AxD), and radial diffusivity (RD), and volume of fiber tracts were extracted from the inferior longitudinal fasciculus, acoustic radiation, and uncinate fasciculus. The results showed an increase in MD, RD, and AxD as well as a decrease in FA, volume, and diameter of auditory-pathway-related fiber tracts. Interestingly, there was an increase in the FA of acoustic radiation. White matter connections in the auditory canal decrease and AR integrity increases due to compensatory effects. These probably reflect atrophy or degradation as well as compensatory cross-modal reorganization in the absence of auditory input and the use of sign language. Diffusion tensor imaging (DTI) plays an important role in preoperative planning.Anatomical knowledge of the auditory tract is essential for lacrimal drainage surgeries, such as cochlear implantation.DTI-based biomarkers for brain changes and allows us to better understand the pathophysiological changes of auditory tract.Microstructural changes in the fiber tracts associated with the auditory pathway can distinguish sensorineural hearing loss (SNHL) from healthy subjects. Sensorineural hearing loss (SNHL) is the most common type and accounts for the majority of all hearing loss. SNHL is a congenital deficit and refers to any cause of hearing loss due to a pathology of the cochlea, auditory nerve, or central nervous system. One of the chief treatment planning is cochlear implant for these patients. So, it is necessary to evaluate the auditory system by imaging devices such as MRI (magnetic resonance imaging) before treatment. Diffusion tensor imaging tractography, or diffusion tensor imaging (DTI) tractography, is an MRI technique that measures the rate of water diffusion between cells to understand and create a map of the body's internal structures; it is most commonly used to provide imaging of the brain. The purpose of the present research was to assess the auditory system and its nerve routs in children before cochlear implant. This study showed that DT imaging is a novel approach for assessment of children with SNHL before and treatment.

Deafness induces complete crossmodal plasticity in a belt region of dorsal auditory cortex.

Many neural areas, where patterned activity is lost following deafness, have the capacity to become activated by the remaining sensory systems. This crossmodal plasticity can be measured at perceptual/behavioural as well as physiological levels. The dorsal zone (DZ) of auditory cortex of deaf cats is involved in supranormal visual motion detection, but its physiological level of crossmodal reorganisation is not well understood. The present study of early-deaf DZ (and hearing controls) used multiple single-channel recording methods to examine neuronal responses to visual, auditory, somatosensory and combined stimulation. In early-deaf DZ, no auditory activation was observed, but 100% of the neurons were responsive to visual cues of which 21% were also influenced by somatosensory stimulation. Visual and somatosensory responses were not anatomically organised as they are in hearing cats, and fewer multisensory neurons were present in the deaf condition. These crossmodal physiological results closely correspond with and support the perceptual/behavioural enhancements that occur following hearing loss.

Cortical responses correlate with speech performance in pre-lingually deaf cochlear implant children.

Cochlear implantation is currently the most successful intervention for severe-to-profound sensorineural hearing loss, particularly in deaf infants and children. Nonetheless, there remains a significant degree of variability in the outcomes of CI post-implantation. The purpose of this study was to understand the cortical correlates of the variability in speech outcomes with a cochlear implant in pre-lingually deaf children using functional near-infrared spectroscopy (fNIRS), an emerging brain-imaging technique. In this experiment, cortical activities when processing visual speech and two levels of auditory speech, including auditory speech in quiet and in noise with signal-to-noise ratios of 10 dB, were examined in 38 CI recipients with pre-lingual deafness and 36 normally hearing children whose age and sex matched CI users. The HOPE corpus (a corpus of Mandarin sentences) was used to generate speech stimuli. The regions of interest (ROIs) for the fNIRS measurements were fronto-temporal-parietal networks involved in language processing, including bilateral superior temporal gyrus, left inferior frontal gyrus, and bilateral inferior parietal lobes. The fNIRS results confirmed and extended findings previously reported in the neuroimaging literature. Firstly, cortical responses of superior temporal gyrus to both auditory and visual speech in CI users were directly correlated to auditory speech perception scores, with the strongest positive association between the levels of cross-modal reorganization and CI outcome. Secondly, compared to NH controls, CI users, particularly those with good speech perception, showed larger cortical activation in the left inferior frontal gyrus in response to all speech stimuli used in the experiment. In conclusion, cross-modal activation to visual speech in the auditory cortex of pre-lingually deaf CI children may be at least one of the neural bases of highly variable CI performance due to its beneficial effects for speech understanding, thus supporting the prediction and assessment of CI outcomes in clinic. Additionally, cortical activation of the left inferior frontal gyrus may be a cortical marker for effortful listening.

Evidence of visual crossmodal reorganization positively relates to speech outcomes in cochlear implant users

Deaf individuals who use a cochlear implant (CI) have remarkably different outcomes for auditory speech communication ability. One factor assumed to affect CI outcomes is visual crossmodal plasticity in auditory cortex, where deprived auditory regions begin to support non-auditory functions such as vision. Previous research has viewed crossmodal plasticity as harmful for speech outcomes for CI users if it interferes with sound processing, while others have demonstrated that plasticity related to visual language may be beneficial for speech recovery. To clarify, we used electroencephalography (EEG) to measure brain responses to a partial face speaking a silent single-syllable word (visual language) in 15 CI users and 13 age-matched typical-hearing controls. We used source analysis on EEG activity to measure crossmodal visual responses in auditory cortex and then compared them to CI users’ speech-in-noise listening ability. CI users’ brain response to the onset of the video stimulus (face) was larger than controls in left auditory cortex, consistent with crossmodal activation after deafness. CI users also produced a mixture of alpha (8–12 Hz) synchronization and desynchronization in auditory cortex while watching lip movement while controls instead showed desynchronization. CI users with higher speech scores had stronger crossmodal responses in auditory cortex to the onset of the video, but those with lower speech scores had increases in alpha power during lip movement in auditory areas. Therefore, evidence of crossmodal reorganization in CI users does not necessarily predict poor speech outcomes, and differences in crossmodal activation during lip reading may instead relate to strategies or differences that CI users use in audiovisual speech communication.

Cross-Modal Reorganization From Both Visual and Somatosensory Modalities in Cochlear Implanted Children and Its Relationship to Speech Perception.

We hypothesized that children with cochlear implants (CIs) who demonstrate cross-modal reorganization by vision also demonstrate cross-modal reorganization by somatosensation and that these processes are interrelated and impact speech perception. Cross-modal reorganization, which occurs when a deprived sensory modality's cortical resources are recruited by other intact modalities, has been proposed as a source of variability underlying speech perception in deaf children with CIs. Visual and somatosensory cross-modal reorganization of auditory cortex have been documented separately in CI children, but reorganization in these modalities has not been documented within the same subjects. Our goal was to examine the relationship between cross-modal reorganization from both visual and somatosensory modalities within a single group of CI children. We analyzed high-density electroencephalogram responses to visual and somatosensory stimuli and current density reconstruction of brain activity sources. Speech perception in noise testing was performed. Current density reconstruction patterns were analyzed within the entire subject group and across groups of CI children exhibiting good versus poor speech perception. Positive correlations between visual and somatosensory cross-modal reorganization suggested that neuroplasticity in different sensory systems may be interrelated. Furthermore, CI children with good speech perception did not show recruitment of frontal or auditory cortices during visual processing, unlike CI children with poor speech perception. Our results reflect changes in cortical resource allocation in pediatric CI users. Cross-modal recruitment of auditory and frontal cortices by vision, and cross-modal reorganization of auditory cortex by somatosensation, may underlie variability in speech and language outcomes in CI children.

The Effects of Cortical Reorganization and Applications of Functional Near-Infrared Spectroscopy in Deaf People and Cochlear Implant Users.

A cochlear implant (CI) is currently the only FDA-approved biomedical device that can restore hearing for the majority of patients with severe-to-profound sensorineural hearing loss (SNHL). While prelingually and postlingually deaf individuals benefit substantially from CI, the outcomes after implantation vary greatly. Numerous studies have attempted to study the variables that affect CI outcomes, including the personal characteristics of CI candidates, environmental variables, and device-related variables. Up to 80% of the results remained unexplainable because all these variables could only roughly predict auditory performance with a CI. Brain structure/function differences after hearing deprivation, that is, cortical reorganization, has gradually attracted the attention of neuroscientists. The cross-modal reorganization in the auditory cortex following deafness is thought to be a key factor in the success of CI. In recent years, the adaptive and maladaptive effects of this reorganization on CI rehabilitation have been argued because the neural mechanisms of how this reorganization impacts CI learning and rehabilitation have not been revealed. Due to the lack of brain processes describing how this plasticity affects CI learning and rehabilitation, the adaptive and deleterious consequences of this reorganization on CI outcomes have recently been the subject of debate. This review describes the evidence for different roles of cross-modal reorganization in CI performance and attempts to explore the possible reasons. Additionally, understanding the core influencing mechanism requires taking into account the cortical changes from deafness to hearing restoration. However, methodological issues have restricted longitudinal research on cortical function in CI. Functional near-infrared spectroscopy (fNIRS) has been increasingly used for the study of brain function and language assessment in CI because of its unique advantages, which are considered to have great potential. Here, we review studies on auditory cortex reorganization in deaf patients and CI recipients, and then we try to illustrate the feasibility of fNIRS as a neuroimaging tool in predicting and assessing speech performance in CI recipients. Here, we review research on the cross-modal reorganization of the auditory cortex in deaf patients and CI recipients and seek to demonstrate the viability of using fNIRS as a neuroimaging technique to predict and evaluate speech function in CI recipients.

Cochlear implants: Visual evoked potentials study

Cochlear implants (CIs) are a successful alternative in cases with severe-to-profound HL. In these individuals, visual cross-modal re-organization can occur because of hearing loss where the visual cortex will recruit auditory cortical areas for visual processing. ObjectivesThis work is designed to study visual evoked potentials (VEPs) in children fitted with CIs in comparison to normal hearing children. MethodThis work included 2 groups of children: Group I included 20 normal hearing children and study group included 25 children fitted with unilateral CIs. All cases were subjected to Thorough otological history. Check up on CIs performance using physical check and Aided sound field examination, ophthalmic examination and Pattern Visual Evoked Potentials (pVEPs). ResultsBoth groups showed no significant difference as regard age or sex. And both had normal ophthalmic examinations. Children of the study groups showed satisfactory aided response. As regard pVEPs, the study group showed significant higher P100 amplitude in comparison to the control group. ConclusionThis study showed that deafness could induced cortical organization in the visual cortex and not limited to the auditory cortex only.

The recognition of human voice in deaf and hearing infants

Purpose: Deafness in infancy has longlasting consequences on brain organization. To achieve the best developmental outcomes in case of profound deafness, cochlear implantation (CI) needs to take place in a critical period during the first year of life, before the cross-modal reorganization of the brain due to auditory deprivation stabilises, preventing the typical development of the auditory cortices. Despite its importance for implantation outcomes, the nature of this critical period and the underlying neural reorganization have not been fully explored. Materials and methods: To fill this knowledge gap, we investigated the cortical responses of 12-month-old profoundly deaf infants and their age-matched controls to sounds produced by a human voice as compared to non-human sounds using functional near-infrared spectroscopy (fNIRS). The deaf infants were tested before undergoing CI surgery and wore hearing aids, allowing them to perceive low frequencies. Human voice stimuli have been shown to trigger brain responses early in development, possibly due to its evolutionary relevance for survival. Results: We found increased brain responses to the human voice in the deaf infants in the bilateral fronto-temporal areas, and their responses correlated with their residual hearing thresholds. These results suggest that even the limited sound stimulation that these deaf infants receive due to their residual hearing allowed the temporal cortices to develop sensitivity to the human voice prior to implantation. The hearing control group showed an inverted hemodynamic response to both voice and non-voice stimuli in the left parietal and right temporal areas, suggesting that by 12 months of age, they habituate rapidly to these very familiar stimuli. While both groups showed an inverted response to the non-voice stimuli, they differed in their responses to voice stimuli. Conclusions: We hypothesize that the responses found in deaf infants to human voice can be consider a good cochlear implant prognosis.

Auditory perception of ambiguous and non-ambiguous sound in early and late blind children: A functional connectivity study

IntroductionAuditory perception and associated cognition involve visual and auditory cortical areas for inference of meaningful soundscape. ObjectiveTo investigate auditory perception of ambiguous and non-ambiguous stimulation in auditory and visual cortical networks for categorical discrimination. MethodologyFunctional mapping was carried out in twenty early (EB), twenty late blind (LB) and fifteen healthy children, during auditory ambiguous and non-ambiguous stimulation task in a 3 T MR scanner to estimate hemodynamic signal alteration and its effect on functional connectivity. The degree of amplitude low-frequency fluctuation (ALFF), correlation analysis and multiple comparison was carried out to map the impact of duration of education and onset of blindness (EB and LB). Results and DiscussionIncreased functional connectivity (FC) and cross-modal reorganization was observed in auditory, visual and language networks in EB children. FC was increased in contralateral hemisphere in both the blind children (EB and LB) groups and was positively correlated with duration of education performance. Cognitive assessment scores correlated (p < 0.01) with cluster coefficient of FC and BOLD response. ConclusionFC alterations depend on onset age and audio-haptic training in children associated with increased auditory language and memory perception.

Structural and Functional Network-Level Reorganization in the Coding of Auditory Motion Directions and Sound Source Locations in the Absence of Vision.

hMT+/V5 is a region in the middle occipitotemporal cortex that responds preferentially to visual motion in sighted people. In cases of early visual deprivation, hMT+/V5 enhances its response to moving sounds. Whether hMT+/V5 contains information about motion directions and whether the functional enhancement observed in the blind is motion specific, or also involves sound source location, remains unsolved. Moreover, the impact of this cross-modal reorganization of hMT+/V5 on the regions typically supporting auditory motion processing, like the human planum temporale (hPT), remains equivocal. We used a combined functional and diffusion-weighted MRI approach and individual in-ear recordings to study the impact of early blindness on the brain networks supporting spatial hearing in male and female humans. Whole-brain univariate analysis revealed that the anterior portion of hMT+/V5 responded to moving sounds in sighted and blind people, while the posterior portion was selective to moving sounds only in blind participants. Multivariate decoding analysis revealed that the presence of motion direction and sound position information was higher in hMT+/V5 and lower in hPT in the blind group. While both groups showed axis-of-motion organization in hMT+/V5 and hPT, this organization was reduced in the hPT of blind people. Diffusion-weighted MRI revealed that the strength of hMT+/V5-hPT connectivity did not differ between groups, whereas the microstructure of the connections was altered by blindness. Our results suggest that the axis-of-motion organization of hMT+/V5 does not depend on visual experience, but that congenital blindness alters the response properties of occipitotemporal networks supporting spatial hearing in the sighted.SIGNIFICANCE STATEMENT Spatial hearing helps living organisms navigate their environment. This is certainly even more true in people born blind. How does blindness affect the brain network supporting auditory motion and sound source location? Our results show that the presence of motion direction and sound position information was higher in hMT+/V5 and lower in human planum temporale in blind relative to sighted people; and that this functional reorganization is accompanied by microstructural (but not macrostructural) alterations in their connections. These findings suggest that blindness alters cross-modal responses between connected areas that share the same computational goals.

Reorganization of large-scale brain networks in deaf signing adults: The role of auditory cortex in functional reorganization following deafness

If the brain is deprived of input from one or more senses during development, functional and structural reorganization of the deprived regions takes place. However, little is known about how sensory deprivation affects large-scale brain networks. In the present study, we use data-driven independent component analysis (ICA) to characterize large-scale brain networks in 15 deaf early signers and 24 hearing non-signers based on resting-state functional MRI data. We found differences between the groups in independent components representing the left lateralized control network, the default network, the ventral somatomotor network, and the attention network. In addition, we showed stronger functional connectivity for deaf compared to hearing individuals from the middle and superior temporal cortices to the cingulate cortex, insular cortex, cuneus and precuneus, supramarginal gyrus, supplementary motor area, and cerebellum crus 1, and stronger connectivity for hearing non-signers to hippocampus, middle and superior frontal gyri, pre- and postcentral gyri, and cerebellum crus 8. These results show that deafness induces large-scale network reorganization, with the middle/superior temporal cortex as a central node of plasticity. Cross-modal reorganization may be associated with behavioral adaptations to the environment, including superior ability in some visual functions such as visual working memory and visual attention, in deaf signers.

The Extent of Task Specificity for Visual and Tactile Sequences in the Auditory Cortex of the Deaf and Hard of Hearing.

It has been proposed that the auditory cortex in the deaf humans might undergo task-specific reorganization. However, evidence remains scarce as previous experiments used only two very specific tasks (temporal processing and face perception) in visual modality. Here, congenitally deaf/hard of hearing and hearing women and men were enrolled in an fMRI experiment as we sought to fill this evidence gap in two ways. First, we compared activation evoked by a temporal processing task performed in two different modalities, visual and tactile. Second, we contrasted this task with a perceptually similar task that focuses on the spatial dimension. Additional control conditions consisted of passive stimulus observation. In line with the task specificity hypothesis, the auditory cortex in the deaf was activated by temporal processing in both visual and tactile modalities. This effect was selective for temporal processing relative to spatial discrimination. However, spatial processing also led to significant auditory cortex recruitment which, unlike temporal processing, occurred even during passive stimulus observation. We conclude that auditory cortex recruitment in the deaf and hard of hearing might involve interplay between task-selective and pluripotential mechanisms of cross-modal reorganization. Our results open several avenues for the investigation of the full complexity of the cross-modal plasticity phenomenon.SIGNIFICANCE STATEMENT Previous studies suggested that the auditory cortex in the deaf may change input modality (sound to vision) while keeping its function (e.g., rhythm processing). We investigated this hypothesis by asking deaf or hard of hearing and hearing adults to discriminate between temporally and spatially complex sequences in visual and tactile modalities. The results show that such function-specific brain reorganization, as has previously been demonstrated in the visual modality, also occurs for tactile processing. On the other hand, they also show that for some stimuli (spatial) the auditory cortex activates automatically, which is suggestive of a take-over by a different kind of cognitive function. The observed differences in processing of sequences might thus result from an interplay of task-specific and pluripotent plasticity.

Neural correlates of visual stimulus encoding and verbal working memory differ between cochlear implant users and normal-hearing controls.

A common concern for individuals with severe‐to‐profound hearing loss fitted with cochlear implants (CIs) is difficulty following conversations in noisy environments. Recent work has suggested that these difficulties are related to individual differences in brain function, including verbal working memory and the degree of cross‐modal reorganization of auditory areas for visual processing. However, the neural basis for these relationships is not fully understood. Here, we investigated neural correlates of visual verbal working memory and sensory plasticity in 14 CI users and age‐matched normal‐hearing (NH) controls. While we recorded the high‐density electroencephalogram (EEG), participants completed a modified Sternberg visual working memory task where sets of letters and numbers were presented visually and then recalled at a later time. Results suggested that CI users had comparable behavioural working memory performance compared with NH. However, CI users had more pronounced neural activity during visual stimulus encoding, including stronger visual‐evoked activity in auditory and visual cortices, larger modulations of neural oscillations and increased frontotemporal connectivity. In contrast, during memory retention of the characters, CI users had descriptively weaker neural oscillations and significantly lower frontotemporal connectivity. We interpret the differences in neural correlates of visual stimulus processing in CI users through the lens of cross‐modal and intramodal plasticity.

Changes of the Brain Causal Connectivity Networks in Patients With Long-Term Bilateral Hearing Loss.

It remains poorly understood how brain causal connectivity networks change following hearing loss and their effects on cognition. In the current study, we investigated this issue. Twelve patients with long-term bilateral sensorineural hearing loss [mean age, 55.7 ± 2.0; range, 39–63 years; threshold of hearing level (HL): left ear, 49.0 ± 4.1 dB HL, range, 31.25–76.25 dB HL; right ear, 55.1 ± 7.1 dB HL, range, 35–115 dB HL; the duration of hearing loss, 16.67 ± 4.5, range, 3–55 years] and 12 matched normally hearing controls (mean age, 52.3 ± 1.8; range, 42–63 years; threshold of hearing level: left ear, 17.6 ± 1.3 dB HL, range, 11.25–26.25 dB HL; right ear, 19.7 ± 1.3 dB HL, range, 8.75–26.25 dB HL) participated in this experiment. We constructed and analyzed the causal connectivity networks based on functional magnetic resonance imaging data of these participants. Two-sample t-tests revealed significant changes of causal connections and nodal degrees in the right secondary visual cortex, associative visual cortex, right dorsolateral prefrontal cortex, left subgenual cortex, and the left cingulate cortex, as well as the shortest causal connectivity paths from the right secondary visual cortex to Broca’s area in hearing loss patients. Neuropsychological tests indicated that hearing loss patients presented significant cognitive decline. Pearson’s correlation analysis indicated that changes of nodal degrees and the shortest causal connectivity paths were significantly related with poor cognitive performances. We also found a cross-modal reorganization between associative visual cortex and auditory cortex in patients with hearing loss. Additionally, we noted that visual and auditory signals had different effects on neural activities of Broca’s area, respectively. These results suggest that changes in brain causal connectivity network are an important neuroimaging mark of cognitive decline. Our findings provide some implications for rehabilitation of hearing loss patients.

Working Memory for Signs with Poor Visual Resolution: fMRI Evidence of Reorganization of Auditory Cortex in Deaf Signers.

Stimulus degradation adds to working memory load during speech processing. We investigated whether this applies to sign processing and, if so, whether the mechanism implicates secondary auditory cortex. We conducted an fMRI experiment where 16 deaf early signers (DES) and 22 hearing non-signers performed a sign-based n-back task with three load levels and stimuli presented at high and low resolution. We found decreased behavioral performance with increasing load and decreasing visual resolution, but the neurobiological mechanisms involved differed between the two manipulations and did so for both groups. Importantly, while the load manipulation was, as predicted, accompanied by activation in the frontoparietal working memory network, the resolution manipulation resulted in temporal and occipital activation. Furthermore, we found evidence of cross-modal reorganization in the secondary auditory cortex: DES had stronger activation and stronger connectivity between this and several other regions. We conclude that load and stimulus resolution have different neural underpinnings in the visual–verbal domain, which has consequences for current working memory models, and that for DES the secondary auditory cortex is involved in the binding of representations when task demands are low.