Spoken Word Processing Research Articles

Speaker Demographics Modulate Listeners' Neural Correlates of Spoken Word Processing.

In language comprehension, listeners expect a speaker to be consistent in their word choice for labeling the same object. For instance, if a speaker previously refers to a piece of furniture as a "couch," in subsequent references, listeners would expect the speaker to repeat this label instead of switching to an alternative label such as "sofa." Moreover, it has been found that speakers' demographic backgrounds, often inferred from their voice, influence how listeners process their language. The question in focus, therefore, is whether speaker demographics influence how listeners expect the speaker to repeat or switch labels. In this study, we used ERPs to investigate whether listeners expect a child speaker to be less likely to switch labels compared to an adult speaker, given the common belief that children are less flexible in language use. In the experiment, we used 80 pictures with alternative labels in Mandarin Chinese (e.g., yi1sheng1 vs. dai4fu, "doctor"). Each picture was presented twice over two experimental phases: In the establishment phase, participants listened to an adult or a child naming a picture with one of the labels and decided whether the label matched the picture they saw; in the test phase, participants listened to the same speaker naming the same picture by either repeating the original label or switching to an alternative label and, again, decided whether the label matched the picture they saw. ERP results in the test phase revealed that, compared to repeated labels, switched labels elicited an N400 effect (300-600 msec after label onset) and a P600 effect (600-1000 msec after label onset). Critically, the N400 effect was larger when listeners were exposed to the child speaker than to the adult speaker, suggesting that listeners found a switched label harder to comprehend when it was produced by a child speaker than an adult speaker. Our study shows that the perceived speaker demographic backgrounds influence listeners' neural responses to spoken words, particularly in relation to their expectations regarding the speaker's label switching behavior. This finding contributes to a broader understanding of the relationship between social cognition and language processing.

Testing the involvement of low-level visual representations during spoken word processing with non-Western students and meditators practicing Sudarshan Kriya Yoga

Previous studies, using the Continuous Flash Suppression (CFS) paradigm, observed that (Western) university students are better able to detect otherwise invisible pictures of objects when they are presented with the corresponding spoken word shortly before the picture appears. Here we attempted to replicate this effect with non-Western university students in Goa (India). A second aim was to explore the performance of (non-Western) meditators practicing Sudarshan Kriya Yoga in Goa in the same task. Some previous literature suggests that meditators may excel in some tasks that tap visual attention, for example by exercising better endogenous and exogenous control of visual awareness than non-meditators. The present study replicated the finding that congruent spoken cue words lead to significantly higher detection sensitivity than incongruent cue words in non-Western university students. Our exploratory meditator group also showed this detection effect but both frequentist and Bayesian analyses suggest that the practice of meditation did not modulate it. Overall, our results provide further support for the notion that spoken words can activate low-level category-specific visual features that boost the basic capacity to detect the presence of a visual stimulus that has those features. Further research is required to conclusively test whether meditation can modulate visual detection abilities in CFS and similar tasks.

The influence of language-specific properties on the role of consonants and vowels in a statistical learning task of an artificial language: A cross-linguistic comparison.

The contribution of consonants and vowels in spoken word processing has been widely investigated, and studies have found a phenomenon of a Consonantal bias (C-bias), indicating that consonants carry more weight than vowels. However, across languages, various patterns have been documented, including that of no preference or a reverse pattern of Vowel bias. A central question is how the manifestation of the C-bias is modulated by language-specific factors. This question can be addressed by cross-linguistic studies. Comparing native Hebrew and native English speakers, this study examines the relative importance of transitional probabilities between non-adjacent consonants as opposed to vowels during auditory statistical learning (SL) of an artificial language. Hebrew is interesting because its complex Semitic morphological structure has been found to play a central role in lexical access, allowing us to examine whether morphological properties can modulate the C-bias in early phases of speech perception, namely, word segmentation. As predicted, we found a significant interaction between language and consonant/vowel manipulation, with a higher performance in the consonantal condition than in the vowel condition for Hebrew speakers, namely, C-bias, and no consonant/vowel asymmetry among English speakers. We suggest that the observed interaction is morphologically anchored, indicating that phonological and morphological processes interact during early phases of auditory word perception.

Phonological deficits in dyslexia impede lexical processing of spoken words: Linking behavioural and MEG data

Phonological difficulties have been identified as a core deficit in developmental dyslexia, yet everyday speech comprehension, which relies on phonological processing, is seemingly unaffected. This raises the question as to how dyslexic readers process spoken words to achieve normal word comprehension. Here we establish a link between neural correlates of lexical and sublexical processing in auditory words and behaviourally measured phonological deficits using magnetoencephalography (MEG). Spatiotemporally resolved cortical responses to phonological and lexico-semantic information were computed with the event-related regression technique (Hauk et al., 2009) and correlated with dyslexic and non-dyslexic subjects’ phonological skills. We found that phonological deficits reduced cortical responses to both phonological and lexico-semantic information (phonological neighbours and word frequency). Individuals with lower phonological skills – independent of dyslexia diagnosis – showed weaker neural responses to phonological neighbourhood information in both hemispheres 200–500 ms after word onset and reduced sensitivity to written and spoken word frequency between 200 and 650 ms. Dyslexic readers showed weaker responses to written word frequency in particular compared to the control group, pointing towards an additional effect of print exposure on auditory word processing. Source space analysis localised phonological and lexico-semantic effect peaks to the left superior temporal gyrus, a key area that has been related to core deficits in dyslexia across a range of neuroimaging studies. The results provide comprehensive evidence that phonological deficits impact both sublexical and lexical stages of spoken word processing and that these deficits cannot be fully compensated through neural re-organization of lexical-distributional information at the single word level. Theoretical and practical implications for typical readers, dyslexic readers, and readers with developmental language disorder are discussed.

Using allophonic variation in L2 word recognition: French listeners’ processing of English vowel nasalization

During spoken word processing, native (L1) listeners use allophonic variation to predictively rule out word competitors and speed up word recognition. There is some evidence that second language (L2) learners develop an awareness of allophonic distributions in their L2, but whether they use their knowledge to facilitate word recognition online, like native listeners do, is largely unknown. In an offline gating experiment and an online eye-tracking experiment in the visual world paradigm, we compare advanced French learners of English and a control group of L1 English listeners on their processing of English vowel nasalization during spoken word recognition. In the gating task, the French listeners’ performance did not differ from that of the English ones. The eye-tracking results show that French listeners used the allophonic distribution in the same way as English listeners, although they were not as fast. Together, these results reveal that L2 learners can develop novel processing strategies using sounds in allophonic distribution to facilitate spoken word recognition.

Effects of spectral degradation on gated word recognition.

Although much is known about how normal-hearing listeners process spoken words under ideal listening conditions, little is known about how a degraded signal, such as speech transmitted via cochlear implants, affects the word recognition process. In this study, gated word recognition performance was measured with the goal of describing the time course of word identification by using a noise-band vocoder simulation. The results of this study demonstrate that spectral degradations can impact the temporal aspects of speech processing. These results also provide insights into the potential advantages of enhancing spectral resolution in the processing of spoken words.

Contextual effects on spoken word processing: An eye-tracking study of the time course of tone and vowel activation in Mandarin.

Lexical access is highly contextual. For example, vowel (rime) information is prioritized over tone in the lexical access of isolated words in Mandarin Chinese, but these roles are flipped in constraining contexts. The time course of these contextual effects remains unclear, and so here we tracked the real-time eye gaze of native Mandarin speakers in a visual-world paradigm. While listening to a noun classifier, before the target noun was even uttered, gaze to the target noun was already greater than looking to phonologically unrelated distractors. Critically, there was also more distraction from a cohort competitor (tone information) than a segmental competitor (vowel information) in more semantically constraining contexts. Results confirm that phonological activation in Mandarin lexical access is highly sensitive to context, with tone taking priority over vowel information even before a target word is heard. Results suggest that phonological activation in real-time lexical access may be highly context-specific across languages. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The role of phonology-to-orthography consistency in predicting the degree of pupil dilation induced in processing reduced and unreduced speech

AbstractThe relationship between the ways in which words are pronounced and spelled has been shown to affect spoken word processing, and a consistent relationship between pronunciation and spelling has been reported as a possible cause of unreduced pronunciations being easier to process than reduced counterparts although reduced pronunciations occur more frequently. In the present study, we investigate the effect of pronunciation-to-spelling consistency for reduced and unreduced pronunciations in L1 and L2 listeners of a logographic language. More precisely, we compare L1 and L2 Japanese listeners to probe whether they use orthographic information differently when processing reduced and unreduced speech. Using pupillometry, the current study provides evidence that extends the hypothesis about the role of orthography in the processing of reduced speech. Orthographic realization matters in processing for L1 and L2 advanced listeners. More specifically, how consistent the orthographic realization is with its phonological form (phonology-to-orthography consistency) modulates the extent to which reduced pronunciation induces additional processing costs. The results are further discussed in terms of their implications for how listeners process reduced speech and the role of the orthographic form in speech processing.

Semantic-to-autobiographical memory priming is ubiquitous.

It is now well established that the activation of semantic memories leads to the activation of autobiographical memories. Studies have shown that semantic processing of words or pictures primes autobiographical memories on voluntary and involuntary autobiographical memory tasks (the Crovitz cue-word task and the vigilance task). Known as semantic-to-autobiographical memory priming, our goal in the current study was to demonstrate the ubiquitous nature of this form of priming by showing that a wide variety of stimuli will prime involuntary autobiographical memories on the vigilance task. In Experiment 1, semantic-to-autobiographical priming was obtained on the vigilance task following the processing of sounds (e.g., the sound of bowling) and spoken words (e.g., the word bowling). In Experiment 2, semantic-to-autobiographical priming was observed on the vigilance task following tactile processing (e.g., the objects ball, glasses) and visual word processing (e.g., the words ball, glasses). In Experiment 3, semantic-to-autobiographical priming was observed on the vigilance task following the processing of videos (e.g., videos of a marching parade) and visual word processing (e.g., the word parade). The results of these experiments support the idea that semantic-to-autobiographical activations occur across a wide variety of stimuli (e.g., linguistic, perceptual). The results also further support the idea that semantic-to-autobiographical memory priming may play an important role in the production of involuntary memories in everyday life. Additional implications (for priming theory and autobiographical memory functions) are discussed.

Attention Modulates the Role of Speakers' Voice Identity and Linguistic Information in Spoken Word Processing: Evidence From Event-Related Potentials.

The human voice usually contains two types of information: linguistic and identity information. However, whether and how linguistic information interacts with identity information remains controversial. This study aimed to explore the processing of identity and linguistic information during spoken word processing by considering the modulation of attention. We conducted two event-related potentials (ERPs) experiments in the study. Different speakers (self, friend, and unfamiliar speakers) and emotional words (positive, negative, and neutral words) were used to manipulate the identity and linguistic information. With the manipulation, Experiment 1 explored the identity and linguistic information processing with a word decision task that requires participants' explicit attention to linguistic information. Experiment 2 further investigated the issue with a passive oddball paradigm that requires rare attention to either the identity or linguistic information. Experiment 1 revealed an interaction among speaker, word type, and hemisphere in N400 amplitudes but not in N100 and P200, which suggests that identity information interacted with linguistic information at the later stage of spoken word processing. The mismatch negativity results of Experiment 2 showed no significant interaction between speaker and word pair, which indicates that identity and linguistic information were processed independently. The identity information would interact with linguistic information during spoken word processing. However, the interaction was modulated by the task demands on attention involvement. We propose an attention-modulated explanation to explain the mechanism underlying identity and linguistic information processing. Implications of our findings are discussed in light of the integration and independence theories.

The activation of embedded (pseudo-)stems in auditory lexical processing: implications for models of spoken word recognition

ABSTRACT A large literature on visual word recognition has examined the role of (apparent) morphological structure by comparing suffixed (such as treatment), pseudo-suffixed (pigment), and non-suffixed (dogma) words with respect to their embeddings (treat, pig, dog). We examined the processing of these word types, as well as semantic controls, in an auditory primed lexical decision paradigm. The results show significant priming in all conditions relative to an unrelated baseline, with larger priming effects for truly suffixed words than for pseudo-suffixed and non-suffixed words. The results suggest that initial embeddings are activated in spoken word processing, and remain active in ways that do not depend on (apparent) morphological structure. We discuss the implications of these findings for models of lexical access that predict inhibition of disfavoured competitors and models that hold that attempted decomposition is driven by meaning relatedness between the carrier word and its possible embedded stem(s).

Abstract WMP26: Acute Left Superior Temporal Damage Results In Phonological Errors In Word Comprehension

Right hemisphere deactivation by right carotid injection of sodium amytal (Wada testing) in chronic epilepsy results in few phonological errors in word comprehension. Based on this finding, recent models of language processing indicate that speech sound and spoken word processing is bilateral, so that unilateral stroke should not affect distinguishing phonologically similar words (e.g. boat/note) for word comprehension. We tested the alternative hypothesis that acute left hemisphere stroke in superior temporal gyrus (STG) results in phonological errors in a word-picture verification task, which would support the proposal that the right hemisphere does not support speech sound processing and word comprehension before recovery through reorganization of structure/function relationships. Methods: A series of 218 participants were tested with a word-picture verification test with targets and phonologically similar words and had brain MRI within 4 days of stroke onset. We evaluated associations between any damage to left STG and phonological errors using chi square, and the correlation between degree of damage to STG and number of errors using Spearman Rho. Results: We found a very strong association between infarct in left STG and the production of phonological errors in word comprehension (chi squared= 31.2; p <0.00001). Furthermore, the number of phonological errors was strongly correlated with the degree of infarct in left STG (rho=0.49; p<0.00001). Results indicate that left STG, when acutely damaged, often results in phonological errors in word comprehension. These results indicate that the paucity of such errors in comprehension in studies of chronic left hemisphere stroke or Wada testing is a result of reorganization following chronic left temporal dysfunction. Patients with acute left STG stroke should be tested with sensitive tests for word comprehension deficits, including phonologically similar words, before giving verbal direction on exam or obtaining informed consent for procedures.

Listen up! ADHD slows spoken-word processing in adverse listening conditions: Evidence from eye movements

BackgroundCognitive skills such as sustained attention, inhibition and working memory are essential for speech processing, yet are often impaired in people with ADHD. Offline measures have indicated difficulties in speech recognition on multi-talker babble (MTB) background for young adults with ADHD (yaADHD). However, to-date no study has directly tested online speech processing in adverse conditions for yaADHD. AimsGauging the effects of ADHD on segregating the spoken target-word from its sound-sharing competitor, in MTB and working-memory (WM) load. Methods and proceduresTwenty-four yaADHD and 22 matched controls that differ in sustained attention (SA) but not in WM were asked to follow spoken instructions presented on MTB to touch a named object, while retaining one (low-load) or four (high-load) digit/s for later recall. Their eye fixations were tracked. Outcomes and resultsIn the high-load condition, speech processing was less accurate and slowed by 140ms for yaADHD. In the low-load condition, the processing advantage shifted from early perceptual to later cognitive stages. Fixation transitions (hesitations) were inflated for yaADHD. Conclusions and implicationsADHD slows speech processing in adverse listening conditions and increases hesitation, as speech unfolds in time. These effects, detected only by online eyetracking, relate to attentional difficulties. We suggest online speech processing as a novel purview on ADHD. What this paper adds?We suggest speech processing in adverse listening conditions as a novel vantage point on ADHD. Successful speech recognition in noise is essential for performance across daily settings: academic, employment and social interactions. It involves several executive functions, such as inhibition and sustained attention. Impaired performance in these functions is characteristic of ADHD. However, to date there is only scant research on speech processing in ADHD. The current study is the first to investigate online speech processing as the word unfolds in time using eyetracking for young adults with ADHD (yaADHD). This method uncovered slower speech processing in multi-talker babble noise for yaADHD compared to matched controls. The performance of yaADHD indicated increased hesitation between the spoken word and sound-sharing alternatives (e.g., CANdle-CANdy). These delays and hesitations, on the single word level, could accumulate in continuous speech to significantly impair communication in ADHD, with severe implications on their quality of life and academic success. Interestingly, whereas yaADHD and controls were matched on WM standardized tests, WM load appears to affect speech processing for yaADHD more than for controls. This suggests that ADHD may lead to inefficient deployment of WM resources that may not be detected when WM is tested alone. Note that these intricate differences could not be detected using traditional offline accuracy measures, further supporting the use of eyetracking in speech tasks. Finally, communication is vital for active living and wellbeing. We suggest paying attention to speech processing in ADHD in treatment and when considering accessibility and inclusion.

An event-related potential study of cross-modal translation recognition in Chinese–English bilinguals: the role of cross-linguistic orthography and phonology

AbstractExtensive evidence has demonstrated that bilinguals non-selectively activate lexicons of both languages when reading or hearing words in one language. Here, we further investigated the electrophysiological roles of cross-linguistic orthography and phonology in the processing of L2 spoken words in unbalanced Chinese (L1)–English (L2) bilinguals in a cross-modal situation. Relative to unrelated control, the recognition of auditory L2 words showed behavioral interference effects when paired with orthographic or phonological neighbors of the correct translations of L2 words. Moreover, the lexical effects were also exhibited in the electrophysiological data, as reflected by marginally less positive late positive component (500–800 ms) amplitudes in the frontal region. Importantly, the orthographic rather than phonological translation neighbor condition elicited less negative N400 (300–500 ms) amplitudes in the parietal–occipital regions, suggesting that this orthographic translation neighbor condition facilitated the co-activation of spoken L2 words. Taken together, these findings indicate that cross-linguistic orthographic and phonological activation have different temporal dynamics with both bottom-up parallel cross-linguistic activation and the top-down inhibitory control mechanism governing the two-language lexical organization in L2 spoken word recognition.

Typical and atypical neural mechanisms support spoken word processing in Angelman syndrome

Angelman syndrome (AS) is known to affect expressive and receptive communication abilities. This study examined individual differences in neural mechanisms underlying speech processing in children with AS (n = 24, M age = 10.01 years) and typical development (n = 30, M age = 10.82 years) using auditory event-related potentials during passive listening to common English words and novel pseudowords. A group of adults with AS (n = 7, M = 31.78 years) provided data about the upper developmental range. The typically developing group demonstrated the expected more negative amplitudes in response to words than pseudowords within 250–500 ms after stimulus onset at the left temporal scalp region. Children and adults with AS exhibited a similar left-lateralized pattern of word-pseudoword differentiation at temporal and parietal regions, but not the midline parietal memory response for known words observed in the typically developing group, suggesting typical-like word-pseudoword differentiation along with possible alterations in the automatic recall of word meaning. These results have important implications for understanding receptive and expressive communication processes in AS and support the use of auditory neural responses for characterizing individual differences in neurodevelopmental disorders with limited speech.

Orthographic influences on spoken word recognition in bilinguals are dependent on the orthographic depth of the target language not the native language

Reading acquisition leads to the restructuring of representational units in the brain, which influences spoken word processing. This makes spoken word recognition a bimodal process. However, the organization of phonological and orthographic units is dependent on the orthographic depth of the writing system and might play a role in the bimodal processing of spoken words. We investigated this question across two EEG experiments with German native speakers using an auditory priming paradigm and manipulating phonological (e.g., Reh – Tee) and orthographic (e.g., See – Tee) overlap between prime and target. Experiment 1 was conducted in German and revealed inhibitory effects for orthographic overlap, but facilitating effects for phonological overlap. Experiment 2 was conducted in English and revealed facilitating effects for orthographic and phonological overlap. We conclude that orthography influences spoken word processing in both languages, but the nature of the influence is dependent on the orthographic depth of the target language.

Decoding the temporal dynamics of spoken word and nonword processing from EEG

The efficiency of spoken word recognition is essential for real-time communication. There is consensus that this efficiency relies on an implicit process of activating multiple word candidates that compete for recognition as the acoustic signal unfolds in real-time. However, few methods capture the neural basis of this dynamic competition on a msec-by-msec basis. This is crucial for understanding the neuroscience of language, and for understanding hearing, language and cognitive disorders in people for whom current behavioral methods are not suitable. We applied machine-learning techniques to standard EEG signals to decode which word was heard on each trial and analyzed the patterns of confusion over time. Results mirrored psycholinguistic findings: Early on, the decoder was equally likely to report the target (e.g., baggage) or a similar sounding competitor (badger), but by around 500 msec, competitors were suppressed. Follow up analyses show that this is robust across EEG systems (gel and saline), with fewer channels, and with fewer trials. Results are robust within individuals and show high reliability. This suggests a powerful and simple paradigm that can assess the neural dynamics of speech decoding, with potential applications for understanding lexical development in a variety of clinical disorders.

Developmental differences of large-scale functional brain networks for spoken word processing

A dual-stream dissociation for separate phonological and semantic processing has been implicated in adults’ language processing, but it is unclear how this dissociation emerges with development. By employing a graph-theory based brain network analysis, we compared functional interaction architecture during a rhyming and meaning judgment task of children (aged 8–12) with adults (aged 19–26). We found adults had stronger functional connectivity strength than children between bilateral inferior frontal gyri and left inferior parietal lobule in the rhyming task, between middle frontal gyrus and angular gyrus, and within occipital areas in the meaning task. Meanwhile, adults but not children manifested between-task differences in these properties. In contrast, children had stronger functional connectivity strength or nodal degree in Heschl’s gyrus, superior temporal gyrus, and subcortical areas. Our findings indicated spoken word processing development is characterized by increased functional specialization, relying on the dorsal and ventral pathways for phonological and semantic processing respectively.

The contribution of consonants and vowels to auditory word recognition is shaped by language-specific properties: Evidence from Hebrew.

This study explored the role of consonants and vowels in auditory word perception in Hebrew, using an auditory-auditory priming procedure. A common finding is the greater importance for consonants than vowels in spoken word processing, henceforth the C-bias. What underlies the C-bias is a controversial issue between the "acquired functional hypothesis" and the "initial-bias hypothesis." The former predicts a different pattern of asymmetry among languages, while the latter claims that the C-bias exists in all languages. Hebrew is interesting because it allows the exploration of whether language-specific morphological properties can modulate consonant/vowel asymmetry. This opportunity stems from its unique complex Semitic morphological structure that was found to have a central role in lexical access. To evaluate the consonant/vowel asymmetry in Hebrew in relation to previously studied languages, recognition of morphologically complex Hebrew words was compared with recognition of foreign Hebrew words that do not have the typical Hebrew morphological complex structure, hereafter simple words. The results showed a significantly stronger C-bias for morphologically complex words than for simple words. We suggest that this within-variation supports the acquired functional hypothesis, so that even within one language different patterns of consonant/vowel asymmetry are revealed depending on the internal morphological structure of the word. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

영어 L2 학습자의 어휘부 활성화: 평행성을 중심으로

It is well established that multiple words with phonetic similarities are activated in the monolingual processing of spoken words. Yet relatively less is known about cross-language activation of phonetically similar words in the bilingual minds. The present study explored cross-language activation of mental lexicon in the spoken word processing of Korean learners of English (i.e., Korean L1-English L2 group). The data from Korean learners of English group were compared with those from native speakers of English (i.e.,English L1 only group). In the experimental task, they were asked to listen to spoken words in English while looking at a display with a target picture, a competitor picture whose Korean translation was phonetically overlapped with the target object, and two pictures of unrelated distractors. Their eye movements were analyzed. The Korean L1-English L2 group looked more often at the pictures of cross-language competitor than English L1 only group did. This finding strongly suggests the presence of non-selective access to both lexicons among the Korean learners of English during the spoken word processing in English. Namely, both L1 and L2 lexicons are spontaneously activated even when they were asked to process the spoken words in L2.(Kyung Hee University)