Processing Of Auditory Stimuli Research Articles

Inhibitory deficits in Klinefelter syndrome are secondary to deficits in the auditory and motor domain

Deficits in several cognitive domains are prevalent in men with Klinefelter Syndrome (KS). Verbal deficits are among the most characteristic cognitive impairments of KS, yet other cognitive domains also exhibit deficits. Executive functions, especially working memory capacity and inhibitory control, are frequently affected as well. A common limitation of previous studies addressing potential deficits in inhibitory control is their potential conflation with language-related capabilities, as for example is the case with the Stroop task. Importantly, none of the prior studies utilized the best-accepted approach to study inhibition, namely the Stop Signal Task (SST). This study therefore tested for deficits in inhibitory control in individuals with KS and controls (HC) using a version of the SST with non-semantic auditory stimuli. In addition to the classic behavioral performance measures (e.g., the go reaction time, stopping accuracy, or stop signal reaction time), we also derived parameters of inhibition and attention from electromyography (EMG), electroencephalography (EEG), and Bayesian modeling. Men with KS exhibited prolonged stopping latencies (i.e., stop signal reaction times) and reduced stopping accuracies. Yet, whereas these model-based indices were indicative of attenuated inhibitory control, neither event-related brain potentials nor an EMG-measure of the stopping latency confirmed such deficits. Behavioral and EEG indices, however, provided evidence for deficits in motor response preparation and generation, as well as the early processing of auditory stimuli. In sum, the overall pattern of results does not support the existence of inhibitory deficits in KS per se, but rather suggests that behavioral indices of impaired inhibition may result from early low-level deficits in the auditory and motor domains, as well as a differential weighting in the processing of different aspects of the task.

Auditory discrimination learning and acoustic cue weighing in female zebra finches with localized FoxP1 knockdowns.

Rare disruptions of the transcription factor FOXP1 are implicated in a human neurodevelopmental disorder characterized by autism and/or intellectual disability with prominent problems in speech and language abilities. Avian orthologues of this transcription factor are evolutionarily conserved and highly expressed in specific regions of songbird brains, including areas associated with vocal production learning and auditory perception. Here, we investigated possible contributions of FoxP1 to song discrimination and auditory perception in juvenile and adult female zebra finches. They received lentiviral knockdowns of FoxP1 in one of two brain areas involved in auditory stimulus processing, HVC (proper name) or CMM (caudomedial mesopallium). Ninety-six females, distributed over different experimental and control groups were trained to discriminate between two stimulus songs in an operant Go/Nogo paradigm and subsequently tested with an array of stimuli. This made it possible to assess how well they recognized and categorized altered versions of training stimuli and whether localized FoxP1 knockdowns affected the role of different features during discrimination and categorization of song. Although FoxP1 expression was significantly reduced by the knockdowns, neither discrimination of the stimulus songs nor categorization of songs modified in pitch, sequential order of syllables or by reversed playback were affected. Subsequently, we analyzed the full dataset to assess the impact of the different stimulus manipulations for cue weighing in song discrimination. Our findings show that zebra finches rely on multiple parameters for song discrimination, but with relatively more prominent roles for spectral parameters and syllable sequencing as cues for song discrimination.NEW & NOTEWORTHY In humans, mutations of the transcription factor FoxP1 are implicated in speech and language problems. In songbirds, FoxP1 has been linked to male song learning and female preference strength. We found that FoxP1 knockdowns in female HVC and caudomedial mesopallium (CMM) did not alter song discrimination or categorization based on spectral and temporal information. However, this large dataset allowed to validate different cue weights for spectral over temporal information for song recognition.

Changes in visually and auditory attended audiovisual speech processing in cochlear implant users: A longitudinal ERP study

Limited auditory input, whether caused by hearing loss or by electrical stimulation through a cochlear implant (CI), can be compensated by the remaining senses. Specifically for CI users, previous studies reported not only improved visual skills, but also altered cortical processing of unisensory visual and auditory stimuli. However, in multisensory scenarios, it is still unclear how auditory deprivation (before implantation) and electrical hearing experience (after implantation) affect cortical audiovisual speech processing.Here, we present a prospective longitudinal electroencephalography (EEG) study which systematically examined the deprivation- and CI-induced alterations of cortical processing of audiovisual words by comparing event-related potentials (ERPs) in postlingually deafened CI users before and after implantation (five weeks and six months of CI use). A group of matched normal-hearing (NH) listeners served as controls. The participants performed a word-identification task with congruent and incongruent audiovisual words, focusing their attention on either the visual (lip movement) or the auditory speech signal. This allowed us to study the (top-down) attention effect on the (bottom-up) sensory cortical processing of audiovisual speech.When compared to the NH listeners, the CI candidates (before implantation) and the CI users (after implantation) exhibited enhanced lipreading abilities and an altered cortical response at the N1 latency range (90–150 ms) that was characterized by a decreased theta oscillation power (4–8 Hz) and a smaller amplitude in the auditory cortex. After implantation, however, the auditory-cortex response gradually increased and developed a stronger intra-modal connectivity. Nevertheless, task efficiency and activation in the visual cortex was significantly modulated in both groups by focusing attention on the visual as compared to the auditory speech signal, with the NH listeners additionally showing an attention-dependent decrease in beta oscillation power (13–30 Hz).In sum, these results suggest remarkable deprivation effects on audiovisual speech processing in the auditory cortex, which partially reverse after implantation. Although even experienced CI users still show distinct audiovisual speech processing compared to NH listeners, pronounced effects of (top-down) direction of attention on (bottom-up) audiovisual processing can be observed in both groups. However, NH listeners but not CI users appear to show enhanced allocation of cognitive resources in visually as compared to auditory attended audiovisual speech conditions, which supports our behavioural observations of poorer lipreading abilities and reduced visual influence on audition in NH listeners as compared to CI users.

Self-initiation enhances perceptual processing of auditory stimuli in an online study.

Understanding how the brain incorporates sensory and motor information will enable better theory building on human perception and behavior. In this study, we aimed to estimate the influence of predictive mechanisms on the magnitude and variability of sensory attenuation in two online samples. After the presentation of a visual cue stimulus, participants (Experiment 1: N = 224, Experiment 2: N = 84) compared the loudness of two consecutive tones in a two-alternative forced-choice task. In Experiment 1, the first tone was either self-initiated or not; in Experiment 2, the second tone was either self-initiated or not (active and passive condition, respectively). We further manipulated identity prediction (i.e., the congruence of pre-learned cue-sound combinations; congruent vs. incongruent), and the duration of the onset delay (to account for effects of attentional differences between the passive and active condition, 50 ms vs. 0 ms). We critically discuss our results within the framework of both classical (i.e., motor-based forward models) and contemporary approaches (i.e., predictive processing framework). Contrary to our preregistered hypothesis, we observed enhanced perceptual processing, instead of attenuation, for self-initiated auditory sensory input. Further, our results reveal an effect of fixed sound delays on the processing of motor and non-motor-based predictive information, and may point to according shifts in attention, leading to a perceptual bias. These results might best be captured by a hybrid explanatory model, combining predictions based on self-initiated motor action with a global predictive mechanism.

Effects of virtual reality working memory task difficulty on the passive processing of irrelevant auditory stimuli.

The virtual reality (VR) environment is claimed to be highly immersive. Participants may thus be potentially unaware of their real, external world. The present study presented irrelevant auditory stimuli while participants were engaged in an easy or difficult visual working memory (WM) task within the VR environment. The difficult WM task should be immersive and require many cognitive resources, thus few will be available for the processing of task-irrelevant auditory stimuli. Sixteen young adults wore a 3D head-mounted VR device. In the easy WM task, the stimuli were nameable objects. In the difficult WM task, the stimuli were abstract objects that could not be easily named. A novel paradigm using event-related potentials (ERPs) was implemented to examine the feasibility of quantifying the extent of processing of task-irrelevant stimuli occurring outside of the VR environment. Auditory stimuli irrelevant to the WM task were presented concurrently at every 1.5 or 12 s in separate conditions. Performance on the WM task varied with task difficulty, with accuracy significantly lower during the difficult task. The auditory ERPs consisted of N1 and a later P2/P3a deflection which were larger when the auditory stimuli were presented slowly. ERPs were unaffected by task difficulty, but significant correlations were found. N1 and P2/P3a amplitudes were smallest when performance on the Easy WM task was highest. It is possible that even the easy WM task was so immersive and required many processing resources that few were available for the co-processing of the task-irrelevant auditory stimuli.

Tobacco withdrawal-induced changes in sensorimotor filtering as a predictor of smoking lapse in trauma-exposed individuals

Prepulse inhibition (PPI) is a measure of sensorimotor filtering thought to shield the processing of initial weaker auditory stimuli from interruption by a later startle response. Previous studies have shown smoking withdrawal to have a negative impact on sensorimotor filtering, particularly in individuals with psychopathology. Because tobacco use may alleviate sensory and sensorimotor filtering deficits, we examined whether smoking withdrawal-induced changes in PPI were associated with maintenance of smoking abstinence in trauma-exposed individuals with and without PTSD who were attempting to quit smoking. Thirty-eight individuals (n = 24 with current or past PTSD; 14 trauma-exposed healthy controls) made an acute biochemically-verified smoking cessation attempt supported by 8 days of contingency management (CM) and cognitive behavioral therapy (CBT) for smoking. Participants completed a PPI task at the pre-quit baseline, 2 days post-quit, and 5 days post-quit. Post-quit changes in PPI were compared between those who remained abstinent for the first 8-days of the quit attempt and those who lapsed back to smoking. PPI changes induced by biochemically-verified smoking abstinence were associated with maintenance of abstinence across the 8-day CM/CBT-supported quit attempt. As compared to those who maintained tobacco abstinence, participants who lapsed to smoking had significantly lower PPI at 2 and 5 days post-quit relative to baseline. Thus, among trauma-exposed individuals, decreases in PPI during acute smoking cessation supported by CM/CBT are associated with lapse back to smoking. Interventions that improve PPI during early smoking abstinence may facilitate smoking cessation among such individuals who are at high risk for chronic, refractory tobacco use.

Estimating statistical power for ERP studies using the auditory N1, Tb, and P2 components.

The N1, Tb, and P2 components of the event-related potential (ERP) are thought to reflect the sequential processing of auditory stimuli in the human brain. Despite their extensive use in biological, cognitive, and clinical neuroscience, there are no guidelines for how to appropriately power ERP studies using these components. In the present study, we investigated how the number of trials, number of participants, effect magnitude, and study design influenced statistical power. Using Monte Carlo simulations of ERP data from a passive listening task, we determined the probability of finding a statistically significant effect in 58,900 experiments repeated 1,000 times each. We found that as the number of trials, number of participants, and effect magnitude increased, so did statistical power. We also found that increasing the number of trials had a bigger effect on statistical power for within-subjectdesigns than for between-subjectdesigns, and that within-subjectdesigns required a smaller number of trials and participants to provide the same level of statistical power for a given effect magnitude than between-subjectdesigns. These results show that it is important to carefully consider these factors when designing ERP studies, rather than relying on tradition or anecdotal evidence. To improve the robustness and reproducibility of ERP research, we have built an online statistical power calculator (https://bradleynjack.shinyapps.io/ErpPowerCalculator), which we hope will allow researchers to estimate the statistical power of previous studies, as well as help them design appropriately-powered studies in the future.

Mapping the time-varying functional brain networks in response to naturalistic movie stimuli.

One of human brain's remarkable traits lies in its capacity to dynamically coordinate the activities of multiple brain regions or networks, adapting to an externally changing environment. Studying the dynamic functional brain networks (DFNs) and their role in perception, assessment, and action can significantly advance our comprehension of how the brain responds to patterns of sensory input. Movies provide a valuable tool for studying DFNs, as they offer a naturalistic paradigm that can evoke complex cognitive and emotional experiences through rich multimodal and dynamic stimuli. However, most previous research on DFNs have predominantly concentrated on the resting-state paradigm, investigating the topological structure of temporal dynamic brain networks generated via chosen templates. The dynamic spatial configurations of the functional networks elicited by naturalistic stimuli demand further exploration. In this study, we employed an unsupervised dictionary learning and sparse coding method combing with a sliding window strategy to map and quantify the dynamic spatial patterns of functional brain networks (FBNs) present in naturalistic functional magnetic resonance imaging (NfMRI) data, and further evaluated whether the temporal dynamics of distinct FBNs are aligned to the sensory, cognitive, and affective processes involved in the subjective perception of the movie. The results revealed that movie viewing can evoke complex FBNs, and these FBNs were time-varying with the movie storylines and were correlated with the movie annotations and the subjective ratings of viewing experience. The reliability of DFNs was also validated by assessing the Intra-class coefficient (ICC) among two scanning sessions under the same naturalistic paradigm with a three-month interval. Our findings offer novel insight into comprehending the dynamic properties of FBNs in response to naturalistic stimuli, which could potentially deepen our understanding of the neural mechanisms underlying the brain's dynamic changes during the processing of visual and auditory stimuli.

The effects of visual perceptual load on detection performance and event-related potentials to auditory stimuli

Load Theory states that perceptual load prevents, or at least reduces, the processing of task-unrelated stimuli. This study systematically examined the detection and neural processing of auditory stimuli unrelated to a visual foreground task. The visual task was designed to create continuous perceptual load, alternated between low and high load, and contained performance feedback to motivate participants to focus on the visual task instead of the auditory stimuli presented in the background. The auditory stimuli varied in intensity, and participants signaled their subjective perception of these stimuli without receiving feedback. Depending on stimulus intensity, we observed load effects on detection performance and P3 amplitudes of the event-related potential (ERP). N1 amplitudes were unaffected by perceptual load, as tested by Bayesian statistics. Findings suggest that visual perceptual load affects the processing of auditory stimuli in a late time window, which is associated with a lower probability of reported awareness of these stimuli.

The effects of visual working memory load on detection and neural processing of task-unrelated auditory stimuli

While perceptual load has been proposed to reduce the processing of task-unrelated stimuli, theoretical arguments and empirical findings for other forms of task load are inconclusive. Here, we systematically investigated the detection and neural processing of auditory stimuli varying in stimulus intensity during a stimuli-unrelated visual working memory task alternating between low and high load. We found, depending on stimulus strength, decreased stimulus detection and reduced P3, but unaffected N1 amplitudes of the event-related potential to auditory stimuli under high as compared to low load. In contrast, load independent awareness effects were observed during both early (N1) and late (P3) time windows. Findings suggest a late neural effect of visual working memory load on auditory stimuli leading to lower probability of reported awareness of these stimuli.

Does insular cortex lesion cause tinnitus in rats?

Objective(s):Tinnitus is defined as ringing of the ears that is experienced when there is no external sound source, and is an auditory phantom sensation. The insula as a multimodal cortex has been shown to be involved in the processing of auditory stimuli rather than other sensory and motor processing and reported to correlate with some aspects of tinnitus. However, its exact role is not clear. The present study aimed to investigate the effect of excitotoxic lesions limited to the insular cortex on the ability to detect a gap in background noise.Materials and Methods:Gap detection test and prepulse inhibition, two objective measurements of auditory startle response, were measured, in 33 male Wistar rats, before and up to four weeks after insular lesion in three experimental groups (sham, control, and lesion). Results: The ability to detect the gap interposed between 60 db background noise was impaired at weeks 2, 3, and 4 following insular lesion, while prepulse inhibition remained intact up to four weeks after surgery.Conclusion:These findings indicated that excitotoxic lesions of the insular cortex may produce a tinnitus-like phenomenon in rats while sparing the hearing sensitivity; suggesting that the insular cortex may have a role in the development of tinnitus.

Alteration of resting-state functional connectivity network properties in patients with social anxiety disorder after virtual reality-based self-training.

Social anxiety disorder (SAD) is a mental disorder characterized by excessive anxiety in social situations. This study aimed to examine the alteration of resting-state functional connectivity in SAD patients related to the virtual reality-based self-training (VRS) which enables exposure to social situations in a controlled environment. Fifty-two SAD patients were randomly assigned to the experimental group who received the VRS, or the control group who did not. Self-report questionnaires and resting-state functional magnetic resonance imaging (fMRI) were performed to assess clinical symptoms and analyze the resting-state network properties, respectively. Significant decrease in social anxiety and an increase in self-esteem was found in the experimental group. From the resting-state fMRI analysis, alteration of local network properties in the left dorsolateral prefrontal gyrus (-10.0%, p = 0.025), left inferior frontal gyrus (-32.3%, p = 0.044), left insula (-17.2%, p = 0.046), left Heschl's gyrus (-21.2%, p = 0.011), bilateral inferior temporal gyrus (right: +122.6%, p = 0.045; left:−46.7%, p = 0.015), and right calcarine sulcus (+17.0%, p = 0.010) were found in the experimental group. Average shortest path length (+8.3%, p = 0.008) and network efficiency (-7.6%, p = 0.011) are found to be altered from the global network property analysis. In addition, the experimental group displayed more positive and more negative changes in the correlation trend of average shortest path length (p = 0.004) and global network efficiency (p = 0.014) with the severity of social anxiety, respectively. These results suggest potential effectiveness of the VRS, which is possibly related to the change of aberrant processing and control of visual and auditory linguistic stimuli and the adaptive change in rumination pattern.

Sleep-Specific Processing of Auditory Stimuli Is Reflected by Alpha and Sigma Oscillations.

Recent research revealed a surprisingly large range of cognitive operations to be preserved during sleep in humans. The new challenge is therefore to understand functions and mechanisms of processes, which so far have been mainly investigated in awake subjects. The current study focuses on dynamic changes of brain oscillations and connectivity patterns in response to environmental stimulation during non-REM sleep. Our results indicate that aurally presented names were processed and neuronally differentiated across the wake-sleep spectrum. Simultaneously recorded EEG and MEG signals revealed two distinct clusters of oscillatory power increase in response to the stimuli: (1) vigilance state-independent θ synchronization occurring immediately after stimulus onset, followed by (2) sleep-specific α/σ synchronization peaking after stimulus offset. We discuss the possible role of θ, α, and σ oscillations during non-REM sleep, and work toward a unified theory of brain rhythms and their functions during sleep.SIGNIFICANCE STATEMENT Previous research has revealed (residual) capacity of the sleeping human brain to interact with the environment. How sensory processing is realized by the neural assemblies in different stages of sleep is however unclear. To tackle this question, we examined simultaneously recorded MEG and EEG data. We discuss the possible role of θ, α, and σ oscillations during non-REM sleep. In contrast to versatile θ band response that reflected early stimulus processing step, succeeding α and σ band activity was sensitive to the saliency of the incoming information, and contingent on the sleep stage. Our findings suggest that the specific reorganization of mechanisms involved in later stages of sensory processing takes place upon falling asleep.

Laterality in Emotional Language Processing in First and Second Language.

Language is a cognitive function that is asymmetrically distributed across both hemispheres, with left dominance for most linguistic operations. One key question of interest in cognitive neuroscience studies is related to the contribution of both hemispheres in bilingualism. Previous work shows a difference of both hemispheres for auditory processing of emotional and non-emotional words in bilinguals and monolinguals. In this study, we examined the differences between both hemispheres in the processing of emotional and non-emotional words of mother tongue language and foreign language. Sixty university students with Persian mother tongue and English as their second language were included. Differences between hemispheres were compared using the dichotic listening test. We tested the effect of hemisphere, language and emotion and their interaction. The right ear (associated with the left hemisphere) showed an advantage for the processing of all words in the first language, and positive words in the second language. Overall, our findings support previous studies reporting left-hemispheric dominance in late bilinguals for processing auditory stimuli.

The Development and Neurophysiological Assessment of Newborn Auditory Cognition: A Review of Findings and Their Application.

This review article introduces the basic principles of infants' neurophysiology, while summarizing the core knowledge of the anatomical structure of the auditory pathway, and presents previous findings on newborns' neural speech processing and suggests their possible applications for clinical practice. In order to tap into the functioning of the auditory pathway in newborns, recent approaches have employed electrophysiological techniques that measure electrical activity of the brain. The neural processing of an incoming auditory stimulus is objectively reflected by means of auditory event-related potentials. The newborn's nervous system processes the incoming sound, and the associated electrical activity of the brain is measured and extracted as components characterized by amplitude, latency, and polarity. Based on the parameters of event-related potentials, it is possible to assess the maturity of a child's brain, or to identify a pathology that needs to be treated or mitigated. For instance, in children with a cochlear implant, auditory event-related potentials are employed to evaluate an outcome of the implantation procedure and to monitor the development of hearing. Event-related potentials turn out to be an irreplaceable part of neurodevelopmental care for high-risk children e.g., preterm babies, children with learning disabilities, autism and many other risk factors.

Characteristic of Communication Model in Children with ADHD

There are a number of models that describe communication processes in children of typical development, while communication models in children with developmental disabilities, especially children with ADHD, have not been researched to such extent. Communication is defined as a complex process of transmitting messages from person to person, using signals (visual/auditory) from a sender to a recipient. Since communication involves a recipient and a sender of information, there are many factors that can affect the outcome of the communication process such as attention variability, as well as auditory and visual stimuli that can enhance or interfere in communication processes. The goal of communication is to provide as accurate and unaltered information as possible, while rising noise in the communication channel increases the likelihood that the information will be transmitted only partially or might be misinterpreted. The topic of this paper is the analysis of a modern communication model where emphasis is placed on visual and auditory perception, and their particularities in relation to the variability of attention as one of the most important elements of perception. The variability of attention consists of auditory and visual information processing including the time required to respond, ommision errors and errors caused by attention lapses. By studying the results of experimental research, we gain insight into the communication processes of children with ADHD, especially the particularities of the reception, processing and interpretation of auditory and/or visual stimuli, which significantly affects the communication process itself. At the cognitive level, the scientific contribution was achieved through the presentation of the particularities of the communication model in children with ADHD, and at the methodological level through the development of original methodology for qualitative comparison of stimulus thresholds by using statistical parameter analysis, while at the practical level in originality through the application of created information concepts of the communication process.

Evaluation of sensory gating efficiency in adults with Down syndrome

AbstractBackgroundIn Down syndrome (DS), the amyloid precursor protein (APP) gene‐dosing effect drives a lifelong over‐production of amyloid‐beta (Aβ). The accumulation of Aβ begins to manifest as amyloid plaques as early as the teens and virtually in all by 40 years. The progression of Alzheimer’s Disease(AD)‐related neuropathology may underlie inhibitory disruption leading to over‐ or under‐sensitivity to auditory processing and cognitive deficits in DS. In positron electromagnetic tomography (PET) studies in DS, amyloid deposition has a defined temporal‐spatial profile that begins in the striatum and predictably progresses to the dorsolateral pre‐frontal cortex (DLPFC) and ventral pre‐frontal cortex (VPFC). Typically developing (TD) individuals with AD exhibit deficits of sensory gating, which can lead to sensory overload and disruption of higher cognitive processes. The auditory paired‐click paradigm has been used to evaluate sensory gating deficits in AD. We extend this inquiry to a cohort with DS to assess sensory gating in adults with DS by measuring the P50 and the N100 event‐related potential (ERP) components. The P50 component is elicited 50 ms post‐stimulus, involves the DLPFC and is sensitive to striatum‐dependent sensory gating. The N100 is elicited 100 ms post‐stimulus by auditory stimuli in absence of task demands.MethodIn this cross‐sectional study, data were collected using high‐density QEEG in 39 DS adults and 39 age‐matched TD controls. In this paradigm, two identical auditory stimuli (S1 and S2) were presented. For each stimuli, the response latency and amplitudes of the P50, and more salient N100 component were measured at the Cz and Fz electrode sites. General linear models examined the modulation of the ERP responses to S1 and S2 between the two groups.ResultWith P50 and N100 response amplitudes, an effect of stimulus was found. In the DS group, longer response latencies for the P50 and N100 corresponding to both S1 and S2 were observed.ConclusionIn DS, the ability to gate‐out irrelevant sensory information is intact when compared to TD; however, there is an overall slower processing of auditory stimuli, which may be attributed to amyloidopathy. The EEG‐based paired‐click paradigm offers functional insight into potential biomarkers for pre‐clinical AD in DS.

Reward magnitude enhances early attentional processing of auditory stimuli.

Reward associations are known to shape the brain's processing of visual stimuli, but relatively less is known about how reward associations impact the processing of auditory stimuli. We leveraged the high-temporal resolution of electroencephalography (EEG) and event-related potentials (ERPs) to investigate the influence of low- and high-magnitude stimulus-reward associations in an auditory oddball task. We associated fast, correct detection of certain auditory target stimuli with larger monetary rewards, and other auditory targets with smaller rewards. We found enhanced attentional processing of the more highly rewarded target stimuli, as evidenced by faster behavioral detection of those stimuli compared with lower-rewarded stimuli. Neurally, higher-reward associations enhanced the early sensory processing of auditory targets. Targets associated with higher-magnitude rewards had higher amplitude N1 and mismatch negativity (MMN) ERP components than targets associated with lower-magnitude rewards. Reward did not impact the latency of these early components. Higher-reward magnitude also decreased the latency and increased the amplitude of the longer-latency P3 component, suggesting that reward also can enhance the final processing stages of auditory target stimuli. These results provide insight into how the sensory and attentional neural processing of auditory stimuli is modulated by stimulus-reward associations and the magnitude of those associations, with higher-magnitude reward associations yielding enhanced auditory processingat both early and late stages compared with lower-magnitude reward associations.

High expectancy influences the role of cognitive load in inattentional deafness during landing decision-making

Neglecting a critical auditory alarm is a major obstacle to maintaining a safe environment, especially in aviation. Earlier studies have indicated that tasks with a higher perceptual or cognitive load in the visual modality influence the processing of auditory stimuli. It is unclear, however, whether other factors, such as memory failure, active neglect, or expectancy influence the effect of cognitive load on auditory alarm detection sensitivity during aeronautical decision-making. In this study, we investigated this issue in three laboratory experiments using the technique of signal detection analysis, in which participants were asked to make a landing decision based on indicators of the instrument landing system while also trying to detect an audible alarm. We found that the sensitivity of auditory alarm detection was reduced under conditions of high cognitive load and that this effect persisted even when the auditory detection response occurred first (before the landing decision response) and when the probability of an auditory alarm was 40%. However, the sensitivity of auditory detection was not influenced by cognitive load under high expectancy conditions (60% probability of alarm presentation). Furthermore, the value of the response bias was reduced under high cognitive load conditions when the probability of an auditory alarm was low (20%). With an increase in the level of expectancy (40% and 60% probability of alarm presentation), it was found that cognitive load did not influence the response bias. These findings indicate that visual cognitive load affects the sensitivity to an auditory alarm only at a low expectancy level (20% and 40% probability of alarm presentation). The effect of cognitive load on the sensitivity to an auditory alarm was not due to memory failure or active neglect and the response bias was more sensitive to the expectancy factor.

Explainable artificial intelligence based analysis for interpreting infant fNIRS data in developmental cognitive neuroscience

In the last decades, non-invasive and portable neuroimaging techniques, such as functional near infrared spectroscopy (fNIRS), have allowed researchers to study the mechanisms underlying the functional cognitive development of the human brain, thus furthering the potential of Developmental Cognitive Neuroscience (DCN). However, the traditional paradigms used for the analysis of infant fNIRS data are still quite limited. Here, we introduce a multivariate pattern analysis for fNIRS data, xMVPA, that is powered by eXplainable Artificial Intelligence (XAI). The proposed approach is exemplified in a study that investigates visual and auditory processing in six-month-old infants. xMVPA not only identified patterns of cortical interactions, which confirmed the existent literature; in the form of conceptual linguistic representations, it also provided evidence for brain networks engaged in the processing of visual and auditory stimuli that were previously overlooked by other methods, while demonstrating similar statistical performance.