Auditory Perceptual Processing Research Articles

Revealing brain's cognitive process deeply: a study of the consistent EEG patterns of audio-visual perceptual holistic.

To investigate the brain's cognitive process and perceptual holistic, we have developed a novel method that focuses on the informational attributes of stimuli. We recorded EEG signals during visual and auditory perceptual cognition experiments and conducted ERP analyses to observe specific positive and negative components occurring after 400ms during both visual and auditory perceptual processes. These ERP components represent the brain's perceptual holistic processing activities, which we have named Information-Related Potentials (IRPs). We combined IRPs with machine learning methods to decode cognitive processes in the brain. Our experimental results indicate that IRPs can better characterize information processing, particularly perceptual holism. Additionally, we conducted a brain network analysis and found that visual and auditory perceptual holistic processing share consistent neural pathways. Our efforts not only demonstrate the specificity, significance, and reliability of IRPs but also reveal their great potential for future brain mechanism research and BCI applications.

Representation of conspecific vocalizations in amygdala of awake marmosets.

Human speech and animal vocalizations are important for social communication and animal survival. Neurons in the auditory pathway are responsive to a range of sounds, from elementary sound features to complex acoustic sounds. For social communication, responses to distinct patterns of vocalization are usually highly specific to an individual conspecific call, in some species. This includes the specificity of sound patterns and embedded biological information. We conducted single-unit recordings in the amygdala of awake marmosets and presented calls used in marmoset communication, calls of other species and calls from specific marmoset individuals. We found that some neurons (47/262) in the amygdala distinguished 'Phee' calls from vocalizations of other animals and other types of marmoset vocalizations. Interestingly, a subset of Phee-responsive neurons (22/47) also exhibited selectivity to one out of the three Phees from two different 'caller' marmosets. Our findings suggest that, while it has traditionally been considered the key structure in the limbic system, the amygdala also represents a critical stage of socially relevant auditory perceptual processing.

Cognitive reserve disorder in age-related hearing loss: cognitive cortical compensatory to auditory perceptual processing.

The aim of this study is to ascertain the mechanisms of cognitive reserve disorder in age-related hearing loss (ARHL), to study the correlation between ARHL and cognitive decline via EEG, and to reverse the adverse remodeling of auditory-cognitive connectivity with hearing aids (HAs). In this study, 32 participants were enrolled, including 12 with ARHLs, 9 with HAs, and 11 healthy controls (HCs), to undergo EEG, Pure Tone Average (PTA), Montreal Cognitive Assessment (MoCA), and other general cognitive tests. There were the lowest MoCA in the ARHL group (P = 0.001), especially in language and abstraction. In the ARHL group, power spectral density of the gamma in right middle temporal gyrus was significantly higher than HC and HA groups, while functional connectivity between superior frontal gyrus and cingulate gyrus was weaker than HC group (P = 0.036) and HA group (P = 0.021). In the HA group, superior temporal gyrus and cuneus had higher connectivity than in the HC group (P = 0.036). In the ARHL group, DeltaTM_DTA (P = 0.042) and CTB (P = 0.011) were more frequent than in the HC group, while there was less DeltaTM_CTA (P = 0.029). PTA was found to be associated with MoCA (r = -0.580) and language (r = -0.572), DeltaTM_CTB had a likewise correlation with MoCA (r = 0.483) and language (r = 0.493), while DeltaTM_DTA was related to abstraction (r = -0.458). Cognitive cortexes compensate for worse auditory perceptual processing in ARHL, which relates to cognitive decline. The impaired functional connectivity between auditory and cognitive cortexes can be remodeled by HAs. DeltaTM may serve as a biomarker for early cognitive decline and decreased auditory speech perception in ARHL.

Auditory perceptual processing during musical imagery: An event-related potential study

The perceptual processing of a sound is facilitated when the sound matches auditory imagery. Previous studies have shown that auditory imagery and actual sound activate the auditory cortex in a similar fashion. To investigate whether auditory imagery is a modality-specific representation or an amodal representation, the current study examined how watching silent music videos affected the auditory processing of sound excerpts. Twenty university students were asked to form musical imagery of Japanese popular songs while watching the official music videos. Event-related brain potentials were recorded in response to short sound excerpts from the on-screen video or from a different video. The results showed that the amplitude of the exogenous N1 component (90–110 ms) was smaller for imagery-matched than for unmatched sound excerpts. The electrical source of the difference was estimated in the auditory cortex. After the N1, the matched excerpts elicited a larger late positive potential (400–800 ms) than the unmatched excerpts. These findings suggest that auditory imagery involves modality-specific neural processing and that imagery-matched sounds are processed efficiently at an early stage, inducing additional cognitive processing at a later stage.

Functional hierarchy for tactile processing in the visual cortex of sighted adults

Perception via different sensory modalities was traditionally believed to be supported by largely separate brain systems. However, a growing number of studies demonstrate that the visual cortices of typical, sighted adults are involved in tactile and auditory perceptual processing. Here, we investigated the spatiotemporal dynamics of the visual cortex’s involvement in a complex tactile task: Braille letter recognition. Sighted subjects underwent Braille training and then participated in a transcranial magnetic stimulation (TMS) study in which they tactually identified single Braille letters. During this task, TMS was applied to their left early visual cortex, visual word form area (VWFA), and left early somatosensory cortex at five time windows from 20 to 520 ms following the Braille letter presentation’s onset. The subjects’ response accuracy decreased when TMS was applied to the early visual cortex at the 120–220 ms time window and when TMS was applied to the VWFA at the 320–420 ms time window. Stimulation of the early somatosensory cortex did not have a time-specific effect on the accuracy of the subjects’ Braille letter recognition, but rather caused a general slowdown during this task. Our results indicate that the involvement of sighted people’s visual cortices in tactile perception respects the canonical visual hierarchy—the early tactile processing stages involve the early visual cortex, whereas more advanced tactile computations involve high-level visual areas. Our findings are compatible with the metamodal account of brain organization and suggest that the whole visual cortex may potentially support spatial perception in a task-specific, sensory-independent manner.

Is auditory perceptual timing a core deficit of developmental coordination disorder?

Time is an essential dimension for perceiving and processing auditory events, and for planning and producing motor behaviors. Developmental coordination disorder (DCD) is a neurodevelopmental disorder affecting 5–6% of children that is characterized by deficits in motor skills. Studies show that children with DCD have motor timing and sensorimotor timing deficits. We suggest that auditory perceptual timing deficits may also be core characteristics of DCD. This idea is consistent with evidence from several domains, (1) motor‐related brain regions are often involved in auditory timing process; (2) DCD has high comorbidity with dyslexia and attention deficit hyperactivity, which are known to be associated with auditory timing deficits; (3) a few studies report deficits in auditory–motor timing among children with DCD; and (4) our preliminary behavioral and neuroimaging results show that children with DCD at age 6 and 7 have deficits in auditory time discrimination compared to typically developing children. We propose directions for investigating auditory perceptual timing processing in DCD that use various behavioral and neuroimaging approaches. From a clinical perspective, research findings can potentially benefit our understanding of the etiology of DCD, identify early biomarkers of DCD, and can be used to develop evidence‐based interventions for DCD involving auditory–motor training.

Neuroanatomical substrate of noise sensitivity

Recent functional studies suggest that noise sensitivity, a trait describing attitudes towards noise and predicting noise annoyance, is associated with altered processing in the central auditory system. In the present work, we examined whether noise sensitivity could be related to the structural anatomy of auditory and limbic brain areas. Anatomical MR brain images of 80 subjects were parcellated with FreeSurfer to measure grey matter volume, cortical thickness, cortical area and folding index of anatomical structures in the temporal lobe and insular cortex. The grey matter volume of amygdala and hippocampus was measured as well. According to our findings, noise sensitivity is associated with the grey matter volume in the selected structures. Among those, we propose and discuss particular areas, previously linked to auditory perceptual, emotional and interoceptive processing, in which larger grey matter volume seems to be related to higher noise sensitivity.

Stereotactically-guided Ablation of the Rat Auditory Cortex, and Localization of the Lesion in the Brain.

The rat auditory cortex (AC) is becoming popular among auditory neuroscience investigators who are interested in experience-dependence plasticity, auditory perceptual processes, and cortical control of sound processing in the subcortical auditory nuclei. To address new challenges, a procedure to accurately locate and surgically expose the auditory cortex would expedite this research effort. Stereotactic neurosurgery is routinely used in pre-clinical research in animal models to engraft a needle or electrode at a pre-defined location within the auditory cortex. In the following protocol, we use stereotactic methods in a novel way. We identify four coordinate points over the surface of the temporal bone of the rat to define a window that, once opened, accurately exposes both the primary (A1) and secondary (Dorsal and Ventral) cortices of the AC. Using this method, we then perform a surgical ablation of the AC. After such a manipulation is performed, it is necessary to assess the localization, size, and extension of the lesions made in the cortex. Thus, we also describe a method to easily locate the AC ablation postmortem using a coordinate map constructed by transferring the cytoarchitectural limits of the AC to the surface of the brain.The combination of the stereotactically-guided location and ablation of the AC with the localization of the injured area in a coordinate map postmortem facilitates the validation of information obtained from the animal, and leads to a better analysis and comprehension of the data.

Stereotactically-guided Ablation of the Rat Auditory Cortex, and Localization of the Lesion in the Brain

The rat auditory cortex (AC) is becoming popular among auditory neuroscience investigators who are interested in experience-dependence plasticity, auditory perceptual processes, and cortical control of sound processing in the subcortical auditory nuclei. To address new challenges, a procedure to accurately locate and surgically expose the auditory cortex would expedite this research effort. Stereotactic neurosurgery is routinely used in pre-clinical research in animal models to engraft a needle or electrode at a pre-defined location within the auditory cortex. In the following protocol, we use stereotactic methods in a novel way. We identify four coordinate points over the surface of the temporal bone of the rat to define a window that, once opened, accurately exposes both the primary (A1) and secondary (Dorsal and Ventral) cortices of the AC. Using this method, we then perform a surgical ablation of the AC. After such a manipulation is performed, it is necessary to assess the localization, size, and extension of the lesions made in the cortex. Thus, we also describe a method to easily locate the AC ablation postmortem using a coordinate map constructed by transferring the cytoarchitectural limits of the AC to the surface of the brain.The combination of the stereotactically-guided location and ablation of the AC with the localization of the injured area in a coordinate map postmortem facilitates the validation of information obtained from the animal, and leads to a better analysis and comprehension of the data.

Cognitive Training Enhances Auditory Attention Efficiency in Older Adults.

Auditory cognitive training (ACT) improves attention in older adults; however, the underlying neurophysiological mechanisms are still unknown. The present study examined the effects of ACT on the P3b event-related potential reflecting attention allocation (amplitude) and speed of processing (latency) during stimulus categorization and the P1-N1-P2 complex reflecting perceptual processing (amplitude and latency). Participants completed an auditory oddball task before and after 10 weeks of ACT (n = 9) or a no contact control period (n = 15). Parietal P3b amplitudes to oddball stimuli decreased at post-test in the trained group as compared to those in the control group, and frontal P3b amplitudes show a similar trend, potentially reflecting more efficient attentional allocation after ACT. No advantages for the ACT group were evident for auditory perceptual processing or speed of processing in this small sample. Our results provide preliminary evidence that ACT may enhance the efficiency of attention allocation, which may account for the positive impact of ACT on the everyday functioning of older adults.

Abnormal auditory pattern perception in schizophrenia

Mismatch negativity (MMN) in response to deviation from physical sound parameters (e.g., pitch, duration) is reduced in individuals with long-term schizophrenia (Sz), suggesting deficits in deviance detection. However, MMN can appear at several time intervals as part of deviance detection. Understanding which part of the processing stream is abnormal in Sz is crucial for understanding MMN pathophysiology. We measured MMN to complex pattern deviants, which have been shown to produce multiple MMNs in healthy controls (HC). Both simple and complex MMNs were recorded from 27 Sz and 27 matched HC. For simple MMN, pitch- and duration-deviants were presented among frequent standard tones. For complex MMN, patterns of five single tones were repeatedly presented, with the occasional deviant group of tones containing an extra sixth tone. Sz showed smaller pitch MMN (p=0.009, ~110ms) and duration MMN (p=0.030, ~170ms) than healthy controls. For complex MMN, there were two deviance-related negativities. The first (~150ms) was not significantly different between HC and SZ. The second was significantly reduced in Sz (p=0.011, ~400ms). The topography of the late complex MMN was consistent with generators in anterior temporal cortex. Worse late MMN in Sz was associated with increased emotional withdrawal, poor attention, lack of spontaneity/conversation, and increased preoccupation. Late MMN blunting in schizophrenia suggests a deficit in later stages of deviance processing. Correlations with negative symptoms measures are preliminary, but suggest that abnormal complex auditory perceptual processes may compound higher-order cognitive and social deficits in the disorder.

Evolução do processo terapêutico fonoaudiológico no Distúrbio Específico de Linguagem (DEL): relato de caso

O objetivo deste estudo foi descrever a evolução clínica de uma criança do gênero feminino, nove anos de idade, com diagnóstico de Distúrbio Específico da Linguagem atendida na Clínica de Linguagem Infantil da FOB-USP. Realizou-se acompanhamento longitudinal, por meio de análise de prontuário e filmagens. A intervenção fonoaudiológica iniciou quando a criança apresentava cinco anos com queixa de alterações fonológicas e prejuízos na inteligibilidade de fala. Constatou-se processos fonológicos não mais esperados para a idade, alterações semântico-lexicais, sintáticas, pragmáticas, e em processos perceptivos auditivos, estando a linguagem receptiva preservada. A intervenção teve como principal objetivo a organização dos subsistemas linguísticos principalmente da habilidade de processamento de informações. Após um ano, houve evolução dos aspectos trabalhados, exceto do aspecto fonológico, que teve evolução menos significante. Atividades direcionadas a linguagem escrita foram inseridas quando a criança iniciou o ensino fundamental. Após 42 meses de intervenção, houve evolução do aspecto fonológico. Entretanto, esta evolução ainda não é observada na fala espontânea. As alterações neste aspecto exercem grande influência no desempenho da linguagem escrita. A habilidade de consciência fonológica está adequada, entretanto, há dificuldade na conversão fonema/grafema, resultando em desempenho aquém do esperado na linguagem escrita. Ainda, há comprometimento no processamento da informação linguística, além de persistência nas alterações, que acarretam defasagens no processo de alfabetização. Acreditamos que para conduzir o processo terapêutico é necessário compreender a natureza das dificuldades linguísticas, desenvolvendo estratégias específicas voltadas principalmente ao processamento da informação linguística e a aprendizagem, proporcionando habilidades e capacitando o indivíduo para a participação ativa em ambientes sociais e escolares.

Compression of Auditory Space during Forward Self-Motion

BackgroundSpatial inputs from the auditory periphery can be changed with movements of the head or whole body relative to the sound source. Nevertheless, humans can perceive a stable auditory environment and appropriately react to a sound source. This suggests that the inputs are reinterpreted in the brain, while being integrated with information on the movements. Little is known, however, about how these movements modulate auditory perceptual processing. Here, we investigate the effect of the linear acceleration on auditory space representation.Methodology/Principal FindingsParticipants were passively transported forward/backward at constant accelerations using a robotic wheelchair. An array of loudspeakers was aligned parallel to the motion direction along a wall to the right of the listener. A short noise burst was presented during the self-motion from one of the loudspeakers when the listener’s physical coronal plane reached the location of one of the speakers (null point). In Experiments 1 and 2, the participants indicated which direction the sound was presented, forward or backward relative to their subjective coronal plane. The results showed that the sound position aligned with the subjective coronal plane was displaced ahead of the null point only during forward self-motion and that the magnitude of the displacement increased with increasing the acceleration. Experiment 3 investigated the structure of the auditory space in the traveling direction during forward self-motion. The sounds were presented at various distances from the null point. The participants indicated the perceived sound location by pointing a rod. All the sounds that were actually located in the traveling direction were perceived as being biased towards the null point.Conclusions/SignificanceThese results suggest a distortion of the auditory space in the direction of movement during forward self-motion. The underlying mechanism might involve anticipatory spatial shifts in the auditory receptive field locations driven by afferent signals from vestibular system.

Finding the right control: The mismatch negativity under investigation

ObjectiveWhen investigating auditory perceptual regularity processing, mismatch negativity (MMN) is commonly used. MMN is computed as a difference signal between the event-related potentials (ERPs) elicited by repeated standard tones and rarely occurring deviant tones. This procedure leads to an underestimation of the N1 component elicited by standards compared to the N1 to deviants which might affect the MMN. Consequently, a random control design was previously introduced. This design, however, overestimates the N1 to the deviant. Here, we developed a new paradigm that avoids previous drawbacks. MethodsWe designed a regular cascadic sequence as a control to the deviant. ERPs were measured while presenting conventional oddball blocks (standards, deviants), random control blocks and a cascadic control block. ResultsMMN was observed in each difference signal. Regarding the N1, standards elicited smallest amplitudes. The N1 for the deviant and the cascadic control was comparable. The largest N1 was elicited by the random control. ConclusionStandards underestimate N1 refractoriness effects in the responses to deviants, while random control tones overestimate. Cascadic control tones, however, provide a reasonable estimation for the N1. SignificanceThe new cascadic control design is suitable to investigate auditory perceptual regularity processes while controlling for N1 refractoriness effects.

Role of serial order in the impact of talker variability on short-term memory: testing a perceptual organization-based account

In two experiments, we examined the impact of the degree of match between sequential auditory perceptual organization processes and the demands of a short-term memory task (memory for order vs. item information). When a spoken sequence of digits was presented so as to promote its perceptual partitioning into two distinct streams by conveying it in alternating female (F) and male (M) voices (FMFMFMFM)--thereby disturbing the perception of true temporal order--recall of item order was greatly impaired (as compared to recall of item identity). Moreover, an order error type consistent with the formation of voice-based streams was committed more quickly in the alternating-voice condition (Exp. 1). In contrast, when the perceptual organization of the sequence mapped well onto an optimal two-group serial rehearsal strategy--by presenting the two voices in discrete clusters (FFFFMMMM)--order, but not item, recall was enhanced (Exp. 2). The results are consistent with the view that the degree of compatibility between perceptual and deliberate sequencing processes is a key determinant of serial short-term memory performance. Alternative accounts of talker variability effects in short-term memory, based on the concept of a dedicated phonological short-term store and a capacity-limited focus of attention, are also reviewed.

Syntactic and auditory spatial processing in the human temporal cortex: An MEG study

Processing syntax is believed to be a higher cognitive function involving cortical regions outside sensory cortices. In particular, previous studies revealed that early syntactic processes at around 100-200 ms affect brain activations in anterior regions of the superior temporal gyrus (STG), while independent studies showed that pure auditory perceptual processing is related to sensory cortex activations. However, syntax-related modulations of sensory cortices were reported recently, thereby adding diverging findings to the previous studies. The goal of the present magnetoencephalography study was to localize the cortical regions underlying early syntactic processes and those underlying perceptual processes using a within-subject design. Sentences varying the factors syntax (correct vs. incorrect) and auditory space (standard vs. change of interaural time difference (ITD)) were auditorily presented. Both syntactic and auditory spatial anomalies led to very early activations (40-90 ms) in the STG. Around 135 ms after violation onset, differential effects were observed for syntax and auditory space, with syntactically incorrect sentences leading to activations in the anterior STG, whereas ITD changes elicited activations more posterior in the STG. Furthermore, our observations strongly indicate that the anterior and the posterior STG are activated simultaneously when a double violation is encountered. Thus, the present findings provide evidence of a dissociation of speech-related processes in the anterior STG and the processing of auditory spatial information in the posterior STG, compatible with the view of different processing streams in the temporal cortex.

Peeling the Onion of Auditory Processing Disorder: A Language/Curricular-Based Perspective

This article addresses auditory processing disorder (APD) from a language-based perspective. The author asks speech-language pathologists to evaluate the functionality (or not) of APD as a diagnostic category for children and adolescents with language-learning and academic difficulties. Suggestions are offered from a curriculum-relevant/strategic-based language approach that places APD symptoms within a broader framework and takes into account the complex interaction among the language knowledge, skills, and strategies needed for academic success. Using the metaphor of peeling an onion to get to its core, the author demonstrates how auditory perceptual processing is influenced by and dependent on language abilities. Examples of curricular content are used to highlight the language savvy needed by students with language-learning disabilities (LLDs) to access the curriculum. At the heart of the article is the question of what is (or are) the most effective way(s) to treat problems defined as "auditory" in nature. The article concludes with 10 suggestions that remind clinicians to consider the usefulness of viewing auditory processing problems as isolated events that can be "fixed." Practical guidelines for creating authentic and functional intervention targets at school-age levels are also provided.

Temporal attention shortens perceptual latency: A temporal prior entry effect

The prior entry hypothesis of attention holds that attended stimuli are perceived earlier than unattended stimuli. Whereas this speeding of perceptual processing has been repeatedly demonstrated for spatial attention, it has not been reported within the temporal domain. To fill this gap, we tested whether temporal attention accelerates auditory perceptual processing by employing event-related potentials as on-line indicators of perceptual processing. In a modified oddball paradigm, we presented a single tone in each trial, either a frequent standard tone or an infrequent deviant or target tone. Temporal attention to tones was manipulated via constant foreperiods. We observed that the latency of the N2, an event-related potential reflecting perceptual processing, is shortened by temporal attention. This result provides first evidence for the idea that temporal attention accelerates perceptual processing as suggested by the prior entry hypothesis.

Auditory distraction and serial memory: The avoidable and the ineluctable

One mental activity that is very vulnerable to auditory distraction is serial recall. This review of the contemporary findings relating to serial recall charts the key determinants of distraction. It is evident that there is one form of distraction that is a joint product of the cognitive characteristics of the task and of the obligatory cognitive processing of the sound. For sequences of sound, distraction appears to be an ineluctable product of similarity-of-process, specifically, the serial order processing of the visually presented items and the serial order coding that is the by-product of the streaming of the sound. However, recently emerging work shows that the distraction from a single sound (one deviating from a prevailing sequence) results in attentional capture and is qualitatively distinct from that of a sequence in being restricted in its action to encoding, not to rehearsal of list members. Capture is also sensitive to the sensory task load, suggesting that it is subject to top-down control and therefore avoidable. These two forms of distraction-conflict of process and attentional capture-may be two consequences of auditory perceptual organization processes that serve to strike the optimal balance between attentional selectivity and distractability.

New Possibilities in Cognition Enhancement for Schizophrenia

Cognitive remediation for schizophrenia and other mental disorders can be divided into two distinctly different approaches. Cognition-enhancing approaches train subjects with laboratory tasks designed to improve specific abilities in various cognitive domains, such as perception, learning, or memory. In contrast, compensatory approaches attempt to bypass cognitive deficits and teach strategies to compensate for them by relying on aids or other processes (1, 2). The article by Fisher et al. (3) in this issue of the Journal represents a new development in the cognition-enhancing approach. They applied to schizophrenia a cognitive training program that was well grounded in a neuroscientific rationale. This and similar training studies will set higher expectations for results in functional benefits for patients. To put this study in perspective, it is useful to review the key findings, establish what new terrain was covered by it, and then focus on critical missing pieces of the cognitive training puzzle.