Processing Of Speech Sounds Research Articles

Neural Processing of Speech Sounds in ASD and First-Degree Relatives

Efficient neural encoding of sound plays a critical role in speech and language, and when impaired, may have reverberating effects on communication skills. This study investigated disruptions to neural processing of temporal and spectral properties of speech in individuals with ASD and their parents and found evidence of inefficient temporal encoding of speech sounds in both groups. The ASD group further demonstrated less robust neural representation of spectral properties of speech sounds. Associations between neural processing of speech sounds and language-related abilities were evident in both groups. Parent–child associations were also detected in neural pitch processing. Together, results suggest that atypical neural processing of speech sounds is a heritable ingredient contributing to the ASD language phenotype.

Development of infants’ neural speech processing and its relation to later language skills: A MEG study

The ‘sensitive period’ for phonetic learning (∼6–12 months) is one of the earliest milestones in language acquisition where infants start to become specialized in processing speech sounds in their native language. In the last decade, advancements in neuroimaging technologies for infants are starting to shed light on the underlying neural mechanisms supporting this important learning period. The current study reports on a large longitudinal dataset with the aim to replicate and extend on two important questions: 1) what are the developmental changes during the ‘sensitive period’ for native and nonnative speech processing? 2) how does native and nonnative speech processing in infants predict later language outcomes? Fifty-four infants were recruited at 7 months of age and their neural processing of speech was measured using Magnetoencephalography (MEG). Specifically, the neural sensitivity to a native and a nonnative speech contrast was indexed by the mismatch response (MMR). They repeated the measurement again at 11 months of age and their language development was further tracked from 12 months to 30 months of age using the MacArthur-Bates Communicative Development Inventory (CDI). Using an a priori Region-of-Interest (ROI) approach, we observed significant increases for the Native MMR in the left inferior frontal region (IF) and superior temporal region (ST) from 7 to 11 months, but not for the Nonnative MMR. Complementary whole brain comparison revealed more widespread developmental changes for both contrasts. However, only individual differences in the left IF and ST for the Nonnative MMR at 11 months of age were significant predictors of individual vocabulary growth up to 30 months of age. An exploratory machine-learning based analysis further revealed that whole brain time series for both Native and Nonnative contrasts can robustly predict later outcomes, but with very different underlying spatial-temporal patterns. The current study extends our current knowledge and suggests that native and nonnative speech processing may follow different developmental trajectories and utilize different mechanisms that are relevant for later language skills.

Phonetic and Phonological Salience in Tone Processing

AbstractThe aim of this study is to determine whether it is the phonetic or phonological effect on processing that is stronger when the two effects are in conflict. Results are presented from a recall experiment, in which speakers of French and Tłı̨chǫ (Dene, Canada) recall syllables with either H or L tone. While French speakers remembered H syllables more accurately, Tłı̨chǫ speakers remembered L tones more accurately. The findings show simultaneous effects of phonetics and phonology, and have implications for notions of salience and how it can be measured as well as for the different types of salience that are active in speech sound processing.

Bilinguals’ speech perception in noise: Perceptual and neural associations

The current study characterized subcortical speech sound processing among monolinguals and bilinguals in quiet and challenging listening conditions and examined the relation between subcortical neural processing and perceptual performance. A total of 59 normal-hearing adults, ages 19–35 years, participated in the study: 29 native Hebrew-speaking monolinguals and 30 Arabic-Hebrew-speaking bilinguals. Auditory brainstem responses to speech sounds were collected in a quiet condition and with background noise. The perception of words and sentences in quiet and background noise conditions was also examined to assess perceptual performance and to evaluate the perceptual-physiological relationship. Perceptual performance was tested among bilinguals in both languages (first language (L1-Arabic) and second language (L2-Hebrew)). The outcomes were similar between monolingual and bilingual groups in quiet. Noise, as expected, resulted in deterioration in perceptual and neural responses, which was reflected in lower accuracy in perceptual tasks compared to quiet, and in more prolonged latencies and diminished neural responses. However, a mixed picture was observed among bilinguals in perceptual and physiological outcomes in noise. In the perceptual measures, bilinguals were significantly less accurate than their monolingual counterparts. However, in neural responses, bilinguals demonstrated earlier peak latencies compared to monolinguals. Our results also showed that perceptual performance in noise was related to subcortical resilience to the disruption caused by background noise. Specifically, in noise, increased brainstem resistance (i.e., fewer changes in the fundamental frequency (F0) representations or fewer shifts in the neural timing) was related to better speech perception among bilinguals. Better perception in L1 in noise was correlated with fewer changes in F0 representations, and more accurate perception in L2 was related to minor shifts in auditory neural timing. This study delves into the importance of using neural brainstem responses to speech sounds to differentiate individuals with different language histories and to explain inter-subject variability in bilinguals’ perceptual abilities in daily life situations.

Longitudinal changes in cortical responses to letter-speech sound stimuli in 8\u201311 year-old children

While children are able to name letters fairly quickly, the automatisation of letter-speech sound mappings continues over the first years of reading development. In the current longitudinal fMRI study, we explored developmental changes in cortical responses to letters and speech sounds across 3 yearly measurements in a sample of 18 8–11 year old children. We employed a text-based recalibration paradigm in which combined exposure to text and ambiguous speech sounds shifts participants’ later perception of the ambiguous sounds towards the text. Our results showed that activity of the left superior temporal and lateral inferior precentral gyri followed a non-linear developmental pattern across the measurement sessions. This pattern is reminiscent of previously reported inverted-u-shape developmental trajectories in children’s visual cortical responses to text. Our findings suggest that the processing of letters and speech sounds involves non-linear changes in the brain’s spoken language network possibly related to progressive automatisation of reading skills.

Auditory Brainstem Responses Predict Behavioral Deficits in Rats with Varying Levels of Noise-Induced Hearing Loss

Intense noise exposure is a leading cause of hearing loss, which results in degraded speech sound discrimination ability, particularly in noisy environments. The development of an animal model of speech discrimination deficits due to noise induced hearing loss (NIHL) would enable testing of potential therapies to improve speech sound processing. Rats can accurately detect and discriminate human speech sounds in the presence of quiet and background noise. Further, it is known that profound hearing loss results in functional deafness in rats. In this study, we generated rats with a range of impairments which model the large range of hearing impairments observed in patients with NIHL. One month after noise exposure, we stratified rats into three distinct deficit groups based on their auditory brainstem response (ABR) thresholds. These groups exhibited markedly different behavioral outcomes across a range of tasks. Rats with moderate hearing loss (30 dB shifts in ABR threshold) were not impaired in speech sound detection or discrimination. Rats with severe hearing loss (55 dB shifts) were impaired at discriminating speech sounds in the presence of background noise. Rats with profound hearing loss (70 dB shifts) were unable to detect and discriminate speech sounds above chance level performance. Across groups, ABR threshold accurately predicted behavioral performance on all tasks. This model of long-term impaired speech discrimination in noise, demonstrated by the severe group, mimics the most common clinical presentation of NIHL and represents a useful tool for developing and improving interventions to target restoration of hearing.

External speech processing and auditory verbal hallucinations: A systematic review of functional neuroimaging studies

It has been documented that individuals who hear auditory verbal hallucinations (AVH) exhibit diminished capabilities in processing external speech. While functional neuroimaging studies have attempted to characterise the cortical regions and networks facilitating these deficits in a bid to understand AVH, considerable methodological heterogeneity has prevented a consensus being reached. The current systematic review investigated the neurobiological underpinnings of external speech processing deficits in voice-hearers in 38 studies published between January 1990 to June 2020. AVH-specific deviations in the activity and lateralisation of the temporal auditory regions were apparent when processing speech sounds, words and sentences. During active or affective listening tasks, functional connectivity changes arose within the language, limbic and default mode networks. However, poor study quality and lack of replicable results plague the field. A detailed list of recommendations has been provided to improve the quality of future research on this topic.

Categorical perception and influence of attention on neural consistency in response to speech sounds in adults with dyslexia.

Developmental dyslexia is a common neurodevelopmental disorder that is associated with alterations in the behavioral and neural processing of speech sounds, but the scope and nature of that association is uncertain. It has been proposed that more variable auditory processing could underlie some of the core deficits in this disorder. In the current study, magnetoencephalography (MEG) data were acquired from adults with and without dyslexia while they passively listened to or actively categorized tokens from a /ba/-/da/ consonant continuum. We observed no significant group difference in active categorical perception of this continuum in either of our two behavioral assessments. During passive listening, adults with dyslexia exhibited neural responses that were as consistent as those of typically reading adults in six cortical regions associated with auditory perception, language, and reading. However, they exhibited significantly less consistency in the left supramarginal gyrus, where greater inconsistency correlated significantly with worse decoding skills in the group with dyslexia. The group difference in the left supramarginal gyrus was evident only when neural data were binned with a high temporal resolution and was only significant during the passive condition. Interestingly, consistency significantly improved in both groups during active categorization versus passive listening. These findings suggest that adults with dyslexia exhibit typical levels of neural consistency in response to speech sounds with the exception of the left supramarginal gyrus and that this consistency increases during active versus passive perception of speech sounds similarly in the two groups.

Repeated Parental Singing During Kangaroo Care Improved Neural Processing of Speech Sound Changes in Preterm Infants at Term Age.

Preterm birth carries a risk for adverse neurodevelopment. Cognitive dysfunctions, such as language disorders may manifest as atypical sound discrimination already in early infancy. As infant-directed singing has been shown to enhance language acquisition in infants, we examined whether parental singing during skin-to-skin care (kangaroo care) improves speech sound discrimination in preterm infants. Forty-five preterm infants born between 26 and 33 gestational weeks (GW) and their parents participated in this cluster-randomized controlled trial (ClinicalTrials ID IRB00003181SK). In both groups, parents conducted kangaroo care during 33–40 GW. In the singing intervention group (n = 24), a certified music therapist guided parents to sing or hum during daily kangaroo care. In the control group (n = 21), parents conducted standard kangaroo care and were not instructed to use their voices. Parents in both groups reported the duration of daily intervention. Auditory event-related potentials were recorded with electroencephalogram at term age using a multi-feature paradigm consisting of phonetic and emotional speech sound changes and a one-deviant oddball paradigm with pure tones. In the multi-feature paradigm, prominent mismatch responses (MMR) were elicited to the emotional sounds and many of the phonetic deviants in the singing intervention group and in the control group to some of the emotional and phonetic deviants. A group difference was found as the MMRs were larger in the singing intervention group, mainly due to larger MMRs being elicited to the emotional sounds, especially in females. The overall duration of the singing intervention (range 15–63 days) was positively associated with the MMR amplitudes for both phonetic and emotional stimuli in both sexes, unlike the daily singing time (range 8–120 min/day). In the oddball paradigm, MMRs for the non-speech sounds were elicited in both groups and no group differences nor connections between the singing time and the response amplitudes were found. These results imply that repeated parental singing during kangaroo care improved auditory discrimination of phonetic and emotional speech sounds in preterm infants at term age. Regular singing routines can be recommended for parents to promote the development of the auditory system and auditory processing of speech sounds in preterm infants.

Neurophysiology of non-native sound discrimination: Evidence from German vowels and consonants in successive French–German bilinguals using an MMN oddball paradigm

Abstract The present electroencephalographical multi-speaker MMN oddball experiment was designed to study the phonological processing of German native and non-native speech sounds. Precisely, we focused on the perception of German /ɪ-iː/, /ɛ-ɛː/, /a-aː/ and the fricatives [ʃ] and [ç] in German natives (GG) and French learners of German (FG). As expected, our results showed that GG were able to discriminate all the critical vowel contrasts. In contrast, FG, despite their high L2 proficiency level, were only marginally sensitive to vowel length variations. Finally, neither GG nor FG discriminated the opposition between [ʃ] and [ç], as revealed by the absence of MMN response. This latter finding was interpreted in terms of low perceptual salience. Taken together, the present findings lend partial support to the Perceptual Assimilation Model for late bilinguals (PAM-L2) for speech perception of non-native phonological contrasts.

Neural Processing of Spectral and Durational Changes in Speech and Non-speech Stimuli: An MMN Study With Czech Adults.

Neural discrimination of auditory contrasts is usually studied via the mismatch negativity (MMN) component of the event-related potentials (ERPs). In the processing of speech contrasts, the magnitude of MMN is determined by both the acoustic as well as the phonological distance between stimuli. Also, the MMN can be modulated by the order in which the stimuli are presented, thus indexing perceptual asymmetries in speech sound processing. Here we assessed the MMN elicited by two types of phonological contrasts, namely vowel quality and vowel length, assuming that both will elicit a comparably strong MMN as both are phonemic in the listeners’ native language (Czech) and perceptually salient. Furthermore, we tested whether these phonemic contrasts are processed asymmetrically, and whether the asymmetries are acoustically or linguistically conditioned. The MMN elicited by the spectral change between /a/ and /ε/ was comparable to the MMN elicited by the durational change between /ε/ and /ε:/, suggesting that both types of contrasts are perceptually important for Czech listeners. The spectral change in vowels yielded an asymmetrical pattern manifested by a larger MMN response to the change from /ε/ to /a/ than from /a/ to /ε/. The lack of such an asymmetry in the MMN to the same spectral change in comparable non-speech stimuli spoke against an acoustically-based explanation, indicating that it may instead have been the phonological properties of the vowels that triggered the asymmetry. The potential phonological origins of the asymmetry are discussed within the featurally underspecified lexicon (FUL) framework, and conclusions are drawn about the perceptual relevance of the place and height features for the Czech /ε/-/a/ contrast.

Atypical attention to voice in toddlers and pre-schoolers with autism spectrum disorder is related to unimpaired cognitive abilities. An ERP study

BackgroundSound perception in autism spectrum disorder (ASD) is usually at typical levels, even when auditory stimuli carry a social value, as it is the case for speech. Nevertheless, orienting to sounds in a speech context might be atypical in some individuals with ASD, which in ERP studies is reflected by a diminished P3a component. As P3 values and cognitive abilities seem to be inversely related under some circumstances, the current study investigates whether diminished attentional orienting to sounds in speech is equally observable in children with ASD with and without developmental delay (DD). MethodChildren with typical development (TD, n = 17) or ASD, with or without comorbid DD (ASD/DD, n = 22, and ASD/noDD, n = 12), aged 1.5 through 4 years took part in a passive auditory oddball task while EEG data were recorded. The paradigm consisted in the presentation of two deviant stimuli (one vowel sound and one complex tone) either in a speech or in a non-speech context. ResultsWe found overall more negative MMN voltages in both ASD groups compared to TD. For P3a mean voltages, we found an attenuated response in children ASD/noDD when deviant tones were presented in speech, but not in other conditions. Children with ASD/DD did not differ from TD in P3a mean voltages. ConclusionAtypical speech sound processing might be more accentuated in children with ASD/noDD than in their peers with comorbid DD. This finding is interpreted within the theoretical framework of neural adaptation.

Postural control of the vocal tract affects auditory speech perception.

Many researchers have proposed that sensorimotor information about the dynamic production of speech gestures can supplement the auditory perception of speech. Here we show that information about postural, nonspeech control of the vocal tract-such as breathing through the nose or mouth-also affects speech perception. Experimental participants breathed either through the nose or the mouth while identifying categories of speech sounds differing in nasal versus oral airflow. Participants showed an increased tendency to hear speech sounds as having nasal articulation when breathing through the nose, relative to when breathing through the mouth. These results suggest that postural information about the state of the vocal tract, like the motor configuration of the speech articulators while breathing, can modulate the perceptual processing of speech sounds. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Asymmetries in Accessing Vowel Representations Are Driven by Phonological and Acoustic Properties: Neural and Behavioral Evidence From Natural German Minimal Pairs.

In vowel discrimination, commonly found discrimination patterns are directional asymmetries where discrimination is faster (or easier) if differing vowels are presented in a certain sequence compared to the reversed sequence. Different models of speech sound processing try to account for these asymmetries based on either phonetic or phonological properties. In this study, we tested and compared two of those often-discussed models, namely the Featurally Underspecified Lexicon (FUL) model (Lahiri and Reetz, 2002) and the Natural Referent Vowel (NRV) framework (Polka and Bohn, 2011). While most studies presented isolated vowels, we investigated a large stimulus set of German vowels in a more naturalistic setting within minimal pairs. We conducted an mismatch negativity (MMN) study in a passive and a reaction time study in an active oddball paradigm. In both data sets, we found directional asymmetries that can be explained by either phonological or phonetic theories. While behaviorally, the vowel discrimination was based on phonological properties, both tested models failed to explain the found neural patterns comprehensively. Therefore, we additionally examined the influence of a variety of articulatory, acoustical, and lexical factors (e.g., formant structure, intensity, duration, and frequency of occurrence) but also the influence of factors beyond the well-known (perceived loudness of vowels, degree of openness) in depth via multiple regression analyses. The analyses revealed that the perceptual factor of perceived loudness has a greater impact than considered in the literature and should be taken stronger into consideration when analyzing preattentive natural vowel processing.

Asymmetry of Auditory-Motor Speech Processing is Determined by Language Experience.

Speech processing relies on interactions between auditory and motor systems and is asymmetrically organized in the human brain. The left auditory system is specialized for processing of phonemes, whereas the right is specialized for processing of pitch changes in speech affecting prosody. In speakers of tonal languages, however, processing of pitch (i.e., tone) changes that alter word meaning is left-lateralized indicating that linguistic function and language experience shape speech processing asymmetries. Here, we investigated the asymmetry of motor contributions to auditory speech processing in male and female speakers of tonal and non-tonal languages. We temporarily disrupted the right or left speech motor cortex using transcranial magnetic stimulation (TMS) and measured the impact of these disruptions on auditory discrimination (mismatch negativity; MMN) responses to phoneme and tone changes in sequences of syllables using electroencephalography (EEG). We found that the effect of motor disruptions on processing of tone changes differed between language groups: disruption of the right speech motor cortex suppressed responses to tone changes in non-tonal language speakers, whereas disruption of the left speech motor cortex suppressed responses to tone changes in tonal language speakers. In non-tonal language speakers, the effects of disruption of left speech motor cortex on responses to tone changes were inconclusive. For phoneme changes, disruption of left but not right speech motor cortex suppressed responses in both language groups. We conclude that the contributions of the right and left speech motor cortex to auditory speech processing are determined by the functional roles of acoustic cues in the listener's native language.SIGNIFICANCE STATEMENT The principles underlying hemispheric asymmetries of auditory speech processing remain debated. The asymmetry of processing of speech sounds is affected by low-level acoustic cues, but also by their linguistic function. By combining transcranial magnetic stimulation (TMS) and electroencephalography (EEG), we investigated the asymmetry of motor contributions to auditory speech processing in tonal and non-tonal language speakers. We provide causal evidence that the functional role of the acoustic cues in the listener's native language affects the asymmetry of motor influences on auditory speech discrimination ability [indexed by mismatch negativity (MMN) responses]. Lateralized top-down motor influences can affect asymmetry of speech processing in the auditory system.

Meter enhances the subcortical processing of speech sounds at a strong beat

The temporal structure of sound such as in music and speech increases the efficiency of auditory processing by providing listeners with a predictable context. Musical meter is a good example of a sound structure that is temporally organized in a hierarchical manner, with recent studies showing that meter optimizes neural processing, particularly for sounds located at a higher metrical position or strong beat. Whereas enhanced cortical auditory processing at times of high metric strength has been studied, there is to date no direct evidence showing metrical modulation of subcortical processing. In this work, we examined the effect of meter on the subcortical encoding of sounds by measuring human auditory frequency-following responses to speech presented at four different metrical positions. Results show that neural encoding of the fundamental frequency of the vowel was enhanced at the strong beat, and also that the neural consistency of the vowel was the highest at the strong beat. When comparing musicians to non-musicians, musicians were found, at the strong beat, to selectively enhance the behaviorally relevant component of the speech sound, namely the formant frequency of the transient part. Our findings indicate that the meter of sound influences subcortical processing, and this metrical modulation differs depending on musical expertise.

Auditory event-related potentials index faster processing of natural speech but not synthetic speech over nonspeech analogs in children

Given the crucial role of speech sounds in human language, it may be beneficial for speech to be supported by more efficient auditory and attentional neural processing mechanisms compared to nonspeech sounds. However, previous event-related potential (ERP) studies have found either no differences or slower auditory processing of speech than nonspeech, as well as inconsistent attentional processing. We hypothesized that this may be due to the use of synthetic stimuli in past experiments. The present study measured ERP responses during passive listening to both synthetic and natural speech and complexity-matched nonspeech analog sounds in 22 8–11-year-old children. We found that although children were more likely to show immature auditory ERP responses to the more complex natural stimuli, ERP latencies were significantly faster to natural speech compared to cow vocalizations, but were significantly slower to synthetic speech compared to tones. The attentional results indicated a P3a orienting response only to the cow sound, and we discuss potential methodological reasons for this. We conclude that our results support more efficient auditory processing of natural speech sounds in children, though more research with a wider array of stimuli will be necessary to confirm these results. Our results also highlight the importance of using natural stimuli in research investigating the neurobiology of language.

Evaluation of mismatch negativity as a marker for language impairment in autism spectrum disorder

BackgroundThe identification of an early and objective marker of language impairment in autism spectrum disorder (ASD) has the potential to lead to earlier language intervention for affected children. The mismatch negativity (MMN), a passive auditory evoked potential, offers insight into the brain’s ability to direct attention to novel sounds. Since exposure to speech is necessary for learning to map meaning onto phonemes, we predicted slower MMN responses to speech sounds would indicate presence of language impairment in ASD. MethodsWe explored the relationship between MMN latency in children ages 5–10 with ASD plus language impairment (ASD + LI), ASD minus language impairment (ASD–LI), and typically developing children (TD) during an auditory oddball experiment presenting speech and pure tone sounds. ResultsContrary to our prediction, children with ASD + LI demonstrated decreased MMN latency in the left hemisphere in response to novel vowel sounds compared to children with ASD–LI and TD controls. Parent responses to the Sensory Experiences Questionnaire revealed that all participating individuals with ASD were hypersensitive to sounds. ConclusionsOur results lend support to the theory that some children with ASD + LI have increased connectivity in primary sensory cortices at the expense of connectivity to association areas of the brain. This may account for faster speech sound processing despite low language scores in these children. Future studies should focus on individuals with language impairment and hyper-or hyposensitivity to sounds.

How do expectant fathers respond to infant cry? Examining brain and behavioral responses and the moderating role of testosterone.

Expectant parents’ responses to infant cry may indicate future risk and resiliency in the parent-child relationship. Most studies of parental reactivity to infant cry have focused on mothers, and few studies have focused on expectant fathers, although fathers make important contributions to parenting. Additionally, although different responses to infant cry (behavioral, psychological and neural) are hypothesized to track together, few studies have analyzed them concurrently. The current investigation aimed to address these gaps by characterizing multimodal responses to infant cry within expectant fathers and testing whether prenatal testosterone moderates these responses. Expectant fathers responded to infant cry vs frequency-matched white noise with increased activation in bilateral areas of the temporal lobe involved in processing speech sounds and social and emotional stimuli. Handgrip force, which has been used to measure parents’ reactivity to cry sounds in previous studies, did not differentiate cry from white noise within this sample. Expectant fathers with higher prenatal testosterone showed greater activation in the supramarginal gyrus, left occipital lobe and precuneus cortex to cry sounds. Expectant fathers appear to interpret and process infant cry as a meaningful speech sound and social cue, and testosterone may play a role in expectant fathers’ response to infant cry.

Deficit of long-term memory traces for words in children with cochlear implants

ObjectiveLanguage experience can develop long-term memory traces for speech units in the brain, to ensure efficient processing of speech sounds. However, prelingually deafened children lack sufficient auditory input before cochlear implantation. Whether the experience-dependent long-term memory traces exist in prelingually deafened children with cochlear implants (CIs) remains unclear. MethodsWe presented CI and normal hearing (NH) children with Mandarin Chinese spoken disyllables in an oddball paradigm and recorded event-related potentials. Each disyllable was defined as a meaningful word or a meaningless pseudoword by the tonal information in the second syllable. ResultsThe amplitude of mismatch negativity (MMN) elicited by words was larger than that elicited by pseudowords in NH children. However, this enhancement of the MMN amplitude was not found in CI children. Behavioral results showed later recognition points for words and lower accuracies for speech comprehension in CI children than in NH children. Furthermore, increased theta power for words compared with pseudowords was only found in NH children. ConclusionsOur findings indicate a deficit of long-term memory traces for words in prelingually deafened children with cochlear implants. SignificanceEarly speech input may be crucial to the formation of long-term memory traces for speech units.