Phonemic Contrasts Research Articles

An Acoustic Study on the Citation Tones in Malaysian Mandarin

In the Global Chinese (GC) framework, Malaysia plays a crucial role in the spread and legacy of Mandarin. Although Malaysian Mandarin (MalM) has been extensively studied, its phonetic aspects have been neglected. Thus, this paper examines the four citation tones in MalM, in addition to the “checked quality”—termed the “fifth tone” (‘T5’) of MalM—by using Chinese dialectology supported by smartphone-based recordings. The findings suggest that, in MalM, the four tones contrast in tone height, tone value, and tone duration, with the main realizations being the high-level, low-level-rising, mid-falling, and high-falling contours, respectively. Other than the main tonal realizations, a number of variants are depicted. Furthermore, while MalM and Putonghua tones have evolved rather similarly, the checked quality—which is absent in Putonghua but was part of Middle Chinese, the shared ancestor of Putonghua and MalM—remains in MalM. However, there is a lack of distinctive phonemic contrast between Tone 4 and ‘T5,’ and there is insufficient evidence to consider ‘T5’ as a new tone category in this study. Unlike Putonghua, MalM is undergoing tonal reduction, like Singaporean and Taiwanese Mandarin. These findings indicate that, although Malaysian Mandarin (MalM) is undergoing substantial variations compared to Putonghua, it shares similarities with other Mandarin varieties, as there is some overlap in their tonal features. This study makes an empirical contribution to the body of research on tonal variations in the GC framework and echoes GC’s call for a pluricentric approach to Mandarin varieties.

Pre-r/l breaking in English and the diphthongal bias

AbstractWe analyse j/w+r sequences in the history Early Modern English (EMoE), the predecessor of Standard (Reference) British English (SSBE) and its most current version, Current British English (CUBE) to arrive at the nature of historical pre-r (and also pre-l) breaking, a process (together with r-deletion and smoothing) responsible for the phonemic contrast between schwa-final and any other diphthongs (and long vowels): bear ɛə vs bay ej (or eɪ), lore ɔə vs law ɔː vs low ow at the beginning of the twentieth century, found as bɛː vs bɛj, loː law/lore vs ləw low CUBE. The main thrust of the argument presented here is that (i) (historical) diphthongs and the long high monophthongs are uniformly represented as vowel+glide sequences, giving ‘bias’ to the title and (ii) that breaking is consonant prevocalisation (CP) of r/ɫ in j/w+r/ɫ sequences (lejr > lejər lair, fajɫ > fajəɫ file). This is followed by r-deletion and smoothing (leər > lɛə > lɛː lair), which are unrelated to breaking ‘proper’. The analysis of breaking as consonant prevocalisation builds on the framework developed by Operstein (2010), with earlier precursors in articulatory phonology, historical linguistics (e.g. Howell 1991a, 1991b), and frameworks using privative melodic features, such as government phonology (e.g. Kaye, Lowenstamm & Vergnaud 1985), dependency phonology (Anderson & Ewen 1987), particle phonology (Schane 1984), element theory (Backley 2011), etc. The article introduces the theoretical background in section 1, followed in section 2 by a discussion of breaking in the history of English. We then look at a classical interpretation of breaking and discuss its shortcomings in section 3. We then look at why the long high monophthongs are better analysed as diphthongs in section 4 before we look at how these vowels fit into the bigger canvas of the diphthongs in section 5. The next step in sections 6 and 7 takes us to the analysis of breaking as CP happening in jr, wr and jɫ sequences. In section 8 we look at CP undone in the later history of the language and some of the consequences for earlier English that follow from the modern distribution of j/w+r sequences.

The role of L1 phonology in the perception of L2 semivowels

Abstract The study compares how L1 Chinese and Japanese speakers perceive L2 English semivowels (/j/ and /w/) preceding high vowels (/i/ and /u/). In Chinese, [j] and [w] serve as phonetic variants of /i/ and /u/, respectively. However, /j/ and /w/ are distinct phonemes in Japanese, although Japanese /w/ lacks the roundness feature found in English /w/. Participants completed experiments with a discrimination task and an identification task. While the discrimination task revealed no differences in /j/ and /w/ perception between the groups, the identification task showed that the Japanese speakers outperformed the Chinese speakers in their perception of /j/, suggesting an L1 “phonemic over phonetic” advantage. However, the Japanese speakers did not outperform the Chinese speakers in their perception of /w/, suggesting that an L2 feature unexploited in the L1 (i.e., roundness) can impede perception. These findings underscore the importance of considering both phonemic status and features in L2 speech perception.

Neural processing of speech sounds at premature and term birth: ERPs and MMR between 32 and 42 weeks of gestation

Prenatal listening experience reportedly modulates how humans process speech at birth, but little is known about how speech perception develops throughout the perinatal period. The present experiment assessed the neural event-related potentials (ERP) and mismatch responses (MMR) to native vowels in 99 neonates born between 32 and 42 weeks of gestation. The vowels elicited reliable ERPs in newborns whose gestational age at time of experiment was at least 36 weeks and 1 day (36 + 1). The ERPs reflected spectral distinctions between vowel onsets from age 36 weeks + 6 days and durational distinctions at vowel offsets from age 37 weeks + 6 days. Starting at age 40 + 4, there was evidence of neural discrimination of vowel length, indexed by a negative MMR response. The present findings extend our understanding of the earliest stages of speech perception development in that they pinpoint the ages at which the cortex reliably responds to the phonetic characteristics of individual speech sounds and discriminates a native phoneme contrast. The age at which the brain reliably differentiates vowel onsets coincides with what is considered term age in many countries (37 weeks + 0 days of gestational age). Future studies should investigate to what extent the perinatal maturation of the cortical responses to speech sounds is modulated by the ambient language.

Impact of Dysphonic Schoolteachers' Voices on Children's Reaction Times according to Phonemic Contrasts.

This paper aimed at observing the impact of dysphonic voice on children's reception of a linguistic message by evaluating their reaction times (RTs) to instructions given by functional dysphonic and control female schoolteachers (STs). French minimal pairs such as /muʃ/ ("mouche" fly) versus /buʃ/ ("bouche" mouth) embedded in a carrier sentence "click on the drawing of…" were produced by two groups of 10 dysphonic and control female ST, matched in age and year of experience. The phonemical contrasts observed are voicing, nasality, consonantal place of articulation, vowel roundedness, and vowel place of articulation. The experimentation was presented in the form of a computer game to children from 7 to 10 years old. Two images illustrating the target words were presented, accompanied by the oral instructions recorded by ST. With a two-button box created for the experiment, children had to click as quickly as possible on the image corresponding to the instruction. Our results show that the RTs of all children are affected by the ST's dysphonia, regardless of their age and that they have significantly longer RT when discriminating minimal pairs contrasting in voicing when the instruction is given by a dysphonic speaker compared to the same instruction given by a control speaker. These observations could be explained by the fact that functional dysphonia is associated with improper use of the vocal folds and thus an alteration of voicing.

Temporal, spectral and amplitude characteristics of the Greek fricative /s/ in hearing-impaired and normal-hearing speech

ABSTRACT Fricatives, and especially sibilants, are very frequently misarticulated by speakers with hearing loss. Misarticulations can result in phonemic contrast weakening or loss, compromising intelligibility. The present study focuses on the examination of acoustic characteristics of the Greek alveolar fricative /s/, an articulatorily demanding sound, produced by young adult speakers with profound hearing impairment and with normal hearing. An array of variables was examined using mixed-effects and random forest models aiming to assess the effectiveness of various measures in differentiating hearing-impaired and normal-hearing /s/ production. Significant differences were found in spectral and amplitude measures, but not in temporal measures. In hearing-impaired speech, spectral slope and RMS amplitude had significantly lower values, indicating a more distributed spectrum, suggestive of decreased flow velocity through the fricative constriction. Also, a trend for concentration of energy at lower frequencies was observed suggesting more posterior fricative articulation than normal. Moreover, measures capturing the variation of frequency and amplitude over time revealed different patterns of sibilance development across time than normal, denoting the production of a less well-formed or less sibilant /s/ by speakers with hearing impairment. The investigation of contextual effects on /s/ in hearing-impaired speech showed increased spectral variance, negative skewness and lower kurtosis in the labial (rounded) context /u/ in relation to the nonlabial contexts /i/ and /a/, indicating a more diffuse, less compact spectrum with concentration at high frequencies. Findings are discussed in relation to previous literature on fricative production by speakers with hearing impairment and normal hearing in Greek and other languages.

Effect of Abstract Phonemic Complexity on Mismatch Negativity (MMN) Amplitude.

Mismatch negativity (MMN) reflects a pre-perceptual neurophysiological response that is generated subconsciously due to the interruption of a memory trace of ongoing sensory events in the environment. It has been widely used by researchers to understand complex perceptual mechanisms. Furthermore, it has been recommended as an objective tool to investigate disorders related to auditory cognition in hearing aid and cochlear implant users. Many researchers suggest that utilizing a larger acoustic difference between standard and deviant stimuli within the oddball paradigm will lead to a more robust MMN response. The purpose of the present study is to examine if increasing the abstract phonemic contrast between standard and deviant stimuli in the oddball paradigm leads to a more robust MMN response. Fourteen young female adults participated in the present study. To ensure that the MMN response was elicited by phonemic and not acoustic differences in the stimuli, a one-to-many ratio was created for the abstract phonemic features while controlling the acoustic features when designing the oddball paradigm as described by Phillips et al. (2000). MMN amplitude was measured at the Cz and Fz electrodes in 2 conditions, with 2 trials in each condition. In condition 1, the standards and deviants differed by one distinctive feature: voicing in trial 1 (/tӕ/ was standard and /dӕ/ was deviant), and place of articulation in trial 2 (/bӕ/ was standard and /dӕ/ was deviant). In condition 2, the standards and deviants differed across two distinctive features: voicing and place of articulation. In trial 1, /pӕ/ was standard and /dӕ/ was deviant; in trial 2, /dӕ/ was standard and /pӕ/ was deviant. MMN amplitudes elicited by two distinctive features were significantly larger than MMN amplitudes elicited by one distinctive feature (p<0.001). Trials 1 and 2 in each condition showed no statistical difference, and they were repeatable and highly correlated. Recordings from the Cz and Fz electrodes showed no statistical difference and were highly correlated and similar in morphology. It is known in the literature that increasing acoustic complexity elicits a more robust MMN. The present study showed that this assumption can be extended to abstract phonemic complexity. Increasing the phonemic complexity by utilizing more distinctive features in the oddball paradigm increased the amplitude and robustness of the MMN.

The combination of accent method and phonemic contrast: an innovative strategy to improve speech production on post-stroke dysarthria.

Speech production includes segmental and suprasegmental features, which interact and cooperate with each other. Impaired speech production is common in individuals with post-stroke dysarthria. The commonly used phonemic contrast therapy and Accent Method in clinical practice can improve the segmental and suprasegmental aspects, respectively. This study aimed to explore the feasibility and immediate effectiveness of the combination of specific rhythm patterns of the Accent Method and phonemic contrast on speech production. Fifteen poststroke dysarthria patients (12 males and three females) first received accentuation task of three rhythm patterns (Largo-slow, Andante-medium, Allegro-fast) and later received speech task in appropriate rhythm patterns combined with phonemic contrast materials and non-phonemic contrast materials. Speech parameters were analyzed by considering speech clarity and prosody. The results showed that the number of correct target syllables, sentence clarity, and standard deviation of intensity increased significantly, and the average length of pauses and abnormal pause times decreased significantly in Andante (medium) compared to other rhythms. The number of correct target syllables, sentence clarity, and standard deviation of intensity increased significantly compared with those in the non-phonemic contrast in Andante (medium). The combination of phonemic contrast and Accent Method was verified to have an immediate effect on speech production in Mandarin speakers with post-stroke dysarthria and could be further validated in other diseases with impaired speech production in the clinic in the future.

Effective Phoneme Decoding With Hyperbolic Neural Networks for High-Performance Speech BCIs.

Speech brain-computer interfaces (speech BCIs), which convert brain signals into spoken words or sentences, have demonstrated great potential for high-performance BCI communication. Phonemes are the basic pronunciation units. For monosyllabic languages such as Chinese Mandarin, where a word usually contains less than three phonemes, accurate decoding of phonemes plays a vital role. We found that in the neural representation space, phonemes with similar pronunciations are often inseparable, leading to confusion in phoneme classification. We mapped the neural signals of phoneme pronunciation into a hyperbolic space for a more distinct phoneme representation. Critically, we proposed a hyperbolic hierarchical clustering approach to specifically learn a phoneme-level structure to guide the representation. We found such representation facilitated greater distance between similar phonemes, effectively reducing confusion. In the phoneme decoding task, our approach demonstrated an average accuracy of 75.21% for 21 phonemes and outperformed existing methods across different experimental days. Our approach showed high accuracy in phoneme classification. By learning the phoneme-level neural structure, the representations of neural signals were more discriminative and interpretable. Our approach can potentially facilitate high-performance speech BCIs for Chinese and other monosyllabic languages.

Advancements of phonetics in the 21st century: Theoretical and empirical issues of spoken word recognition in phonetic research

How do listeners understand what they are hearing? Humans hearing speech perform spoken word recognition, recognizing what words they are hearing in a speech stream in order to understand the meaning. Phonetics refers to the properties of the speech at a detailed level, particularly below the level of segmental phonemic distinctions. In order to recognize spoken words, listeners have to extract information from the detailed acoustic signal in some way, but theories differ about whether listeners extract phonemes, whole words, or other units, by what mechanism, and they differ on what kinds of information are stored in the lexicon. The process of spoken word recognition can be affected by any number of situations such as the speaker or listener being a non-native of the language or dialect, being a child, having a speech/hearing disability, hearing speech in noise, the speech itself containing variability, or many other situations. Any of these situations can shed light on theoretical questions by giving a fuller picture of how listeners recognize words. This chapter examines what we have learned in these first ∼21 years of the 21st century about how phonetics interacts with spoken word recognition.

Perceptual Discrimination of Phonemic Contrasts in Quebec French: Exposure to Quebec French Does Not Improve Perception in Hexagonal French Native Speakers Living in Quebec

In Quebec French, /a ~ ɑ/ and /ε ~ aε/ are phonemic, whereas in Hexagonal French, these vowels are merged to /a/ and /ε/, respectively. We tested the effects of extended exposure to Quebec French (QF) as a second dialect (D2) on Hexagonal French (HF) speakers’ abilities to perceive these contrasts. Three groups of listeners were recruited: (1) non-mobile HF speakers born and living in France (HF group); (2) non-mobile QF speakers born and living in Quebec (QF group); and mobile HF speakers having moved from France to Quebec (HF&gt;QF group). To determine any fine-grained effects of second dialect (D2) exposure on the perception of vowel contrasts, participants completed a same–different discrimination task in which they listened to stimuli paired at different levels of acoustic similarity. As expected, QF listeners showed a significant advantage over the HF group in discriminating between /a ~ ɑ/ and /ε ~ aε/ pairs, thus suggesting an own-dialect advantage in perceptual discrimination. Interestingly, this own-dialect advantage appeared to be greater for the /ε ~ aε/ contrast. The QF listeners also showed an advantage over the HF&gt;QF group, and, surprisingly, this advantage was greater than over the HF group. In other words, the results suggested that the acquisition of a second dialect did not enhance the abilities of listeners to perceive differences between phonemic contrasts in that D2. If anything, the acquisition of the D2 disadvantaged the perceptual abilities of the HF&gt;QF group. This might be because these phonemes have, over time, become less acoustically marked for the HF&gt;QF participants and have, potentially, become integrated into their D1 phonemic categories.

A Phonological Study of Rongpa Choyul

This paper presents a detailed description of the phonology of the Rongpa variety of Choyul, an understudied Tibeto-Burman language spoken in Lithang (理塘) County, Dkarmdzes (甘孜) Tibetan Autonomous Prefecture of Sichuan Province, China. Based on firsthand fieldwork data, this paper lays out Rongpa phonology with details, examining its syllable canon, initial and rhyme systems, and word prosody. Peculiar characteristics of this phonological system are as follows: First, Rongpa has a substantial phonemic inventory, which comprises 43 consonants, 13 vowels, and 2 tones. 84 consonant clusters are observed to serve as the initial of a syllable. Secondly, the phonemic contrast between plain and uvularized vowels is attested. In addition, regressive vowel harmony on uvularization, height, and lip-roundedness can be clearly observed in various constructions including prefixed verb stems. Finally, regarding word prosody, two tones in monosyllabic words, /H/ and /L/, are observed to distinguish lexical meanings, and disyllabic words exhibit four surface pitch patterns. Pitch patterns in verb morphology are also examined. The findings and analyses as presented in this paper could form a foundation for future research on Rongpa Choyul.

Preliminary evaluation of computer-assisted home training for French cochlear implant recipients.

For French cochlear implant (CI) recipients, in-person clinical auditory rehabilitation is typically provided during the first few years post-implantation. However, this is often inconvenient, it requires substantial time resources and can be problematic when appointments are unavailable. In response, we developed a computer-based home training software ("French AngelSound™") for French CI recipients. We recently conducted a pilot study to evaluate the newly developed French AngelSound™ in 15 CI recipients (5 unilateral, 5 bilateral, 5 bimodal). Outcome measures included phoneme recognition in quiet and sentence recognition in noise. Unilateral CI users were tested with the CI alone. Bilateral CI users were tested with each CI ear alone to determine the poorer ear to be trained, as well as with both ears (binaural performance). Bimodal CI users were tested with the CI ear alone, and with the contralateral hearing aid (binaural performance). Participants trained at home over a one-month period (10 hours total). Phonemic contrast training was used; the level of difficulty ranged from phoneme discrimination in quiet to phoneme identification in multi-talker babble. Unilateral and bimodal CI users trained with the CI alone; bilateral CI users trained with the poorer ear alone. Outcomes were measured before training (pre-training), immediately after training was completed (post-training), and one month after training was stopped (follow-up). For all participants, post-training CI-only vowel and consonant recognition scores significantly improved after phoneme training with the CI ear alone. For bilateral and bimodal CI users, binaural vowel and consonant recognition scores also significantly improved after training with a single CI ear. Follow-up measures showed that training benefits were largely retained. These preliminary data suggest that the phonemic contrast training in French AngelSound™ may significantly benefit French CI recipients and may complement clinical auditory rehabilitation, especially when in-person visits are not possible.

“I can't see myself ever living any[w]ere else”: Variation in (HW) in Edinburgh English

AbstractSociolinguistic research across Scotland in recent decades has documented an erosion of the phonemic contrast between /ʍ/ (as in which) and /w/ (as in witch). Based on acoustic phonetic analysis of 1,400 &lt;wh&gt; realizations produced by eighteen Edinburgh women born between 1938 and 1993, I argue that in the context of Edinburgh this is best understood as a complex sociolinguistic variable (HW) encompassing (at least) six fricated and fricationless variants. Realizations vary in type and relative duration of frication, voicing, and glide quality. Bayesian statistical analysis suggests that choice and realization of variants is conditioned by speaker's social class, style, and phonetic context. Unlike some prior work, I do not find evidence of ongoing (apparent-time) change or an effect of contact with Southern British English. Fricated variants are most prevalent in formal speech styles and in the speech of middle-class women, while working-class speakers favor fricationless variants.

Audio-visual clear speech: Articulation, acoustics and perception of segments and tones

Research has established that clear speech with enhanced acoustic signal benefits segmental intelligibility. Less attention has been paid to visible articulatory correlates of clear-speech modifications, or to clear-speech effects at the suprasegmental level (e.g., lexical tone). Questions thus arise as to the extent to which clear-speech cues are beneficial in different input modalities and linguistic domains, and how different resources are incorporated. These questions address the fundamental argument in clear-speech research with respect to the trade-off between effects of signal-based phoneme-extrinsic modifications to strengthen overall acoustic salience versus code-based phoneme-specific modifications to maintain phonemic distinctions. In this talk, we report findings from our studies on audio-visual clear speech production and perception, including vowels and fricatives differing in auditory and visual saliency, and lexical tones believed to lack visual distinctiveness. In a 3-stream study, we use computer-vision techniques to extract visible facial cues associated with segmental and tonal productions in plain and clear speech, characterize distinctive acoustic features across speech styles, and compare audio-visual plain and clear speech perception. Findings are discussed in terms of how speakers and perceivers strike a balance between utilizing general saliency-enhancing and category-specific cues across audio-visual modalities and speech styles with the aim of improving intelligibility.

Does the Functional Load Principle Predict How Important Phonemic Contrasts Are to Intelligibility Among ELF Users? A Partial Replication of Munro and Derwing (2006) From an ELF Perspective

Abstract The Functional Load (FL) principle predicts that high FL phonemic contrasts, such as /i:/ and /ɪ/, contribute more to the mutual intelligibility of pronunciation than low FL phonemic contrasts, such as /u:/ and /ʊ/. In order to assess whether the FL principle accurately predicts intelligibility under English as a Lingua Franca (ELF) conditions, this study partially replicated the first study to empirically support the FL principle: Munro and Derwing (2006). Chinese speakers of English recorded 24 sentences containing target words with high and low FL phoneme substitutions, and 171 Japanese university students listened to the sentences and transcribed the target words into standard orthography. The hypothesis of this study is that the target words with high FL phoneme substitutions will be less intelligible than the target words with low FL phoneme substitutions. The results showed that the target words with high FL phoneme substitutions were indeed lower in intelligibility than the target words with low FL phoneme substitutions, and furthermore cumulative high FL phoneme substitutions lower intelligibility even more. The results are consistent with Munro and Derwing’s (2006) finding that high FL phoneme substitutions lower comprehensibility more than low FL phoneme substitutions, and thus this study claims to have replicated one aspect of their study even under ELF conditions.

Psychoacoustic features explain creakiness classifications made by naive and non-naive listeners

We compared the classifications of words between creaky and non-creaky made by two groups of listeners whose native languages differ on whether creakiness is used for phonemic contrast. Japanese (naive group) and Vietnamese (non-naive group) listeners classified words produced by a single speaker of Du’an Zhuang, an unintelligible language for both groups that shares some tonal similarities with Hanoi Vietnamese. We found little differences between the accuracy achieved by the two groups, and that the non-naive group was more likely to rate words as creaky relative to the naive group. In addition, there seems to be no benefit of background linguistic knowledge on the accuracy with which the non-naive group classified words. The sensitivity to creakiness observed in classifications made by experts (inspecting the waveforms and spectrograms in addition to listening to the words) and made by a machine learning algorithm based on these kind of classifications was unmatched by both cohorts. This result challenges the perceptual validity of such refined classifications commonly used in phonation studies. In addition, we found a positive association between psychoacoustic roughness and the probability of a word to be judged as creaky. We also found a positive association of loudness with creaky judgments, whereas pitch was negatively associated. We found no evidence of sharpness and creaky association. Finally, the accuracy to predict subjective creakiness via a recurrent neural network classifier was best when the traces of all the considered psychoacoustic features were included as predictors.

On the nature of apical vowel in Jixi-Hui Chinese: Acoustic and articulatory data

Chinese languages have a set of segments known as apical vowels, which have been analysed in previous studies as either genuine vowels, fricative vowels, fricative consonants, or approximants. This study is concerned with the apical vowel attested in Jixi-Hui Chinese. We examine this segment from acoustic and articulatory perspectives and argue that it is best defined as a fricative /z/. Phonologically, Jixi-Hui Chinese /z/ is a distinct phoneme that is exclusively attested in syllable nucleus position where it constitutes a tone-bearing unit and which can undergo tonal sandhi processes. It can appear not only after coronal sibilants /s ts tsʰ/, but also after bilabials /p pʰ/ and nasals /m n/. Acoustically, we show that this segment contains frication noise in its initial phase in the majority of cases, with a formant structure towards its end. The analysis of the zero-crossing rate confirms this significant presence of noise, clearly distinguishing this segment from genuine vowels. Furthermore, articulatory analyses of ultrasound data show that /z/ has a near-identical tongue shape to fricative /s/ on both mid-sagittal and coronal planes, in both sibilant and non-sibilant contexts. These findings are viewed in light of the variability in the way /z/ is phonetically implemented in Jixi-Hui Chinese.

Second-language phoneme learning positively relates to voice recognition abilities in the native language: Evidence from behavior and brain potentials.

Previous studies suggest a relationship between second-language learning and voice recognition processes, but the nature of such relation remains poorly understood. The present study investigates whether phoneme learning relates to voice recognition. A group of bilinguals that varied in their discrimination of a second-language phoneme contrast participated in this study. We assessed participants’ voice recognition skills in their native language at the behavioral and brain electrophysiological levels during a voice-avatar learning paradigm. Second-language phoneme discrimination positively correlated with behavioral and brain measures of voice recognition. At the electrophysiological level, correlations were present at two time windows and are interpreted within the dual-process model of recognition memory. The results are relevant to understanding the processes involved in language learning as they show a common variability for second-language phoneme and voice recognition processes.

The contribution of visual articulatory gestures and orthography to speech processing: Evidence from novel word learning.

Auditory speech appears to be linked to visual articulatory gestures and orthography through different mechanisms. Yet, both types of visual information have a strong influence on speech processing. The present study directly compared their contributions to speech processing using a novel word learning paradigm. Native speakers of French, who were familiar with English, learned minimal pairs of novel English words containing the English /θ/-/f/ phonemic contrast under one of three exposure conditions: (a) the auditory forms of novel words alone, (b) the auditory forms associated with articulatory gestures, or (c) the auditory forms associated with orthography. The benefits of the three methods were compared during training and at two posttraining time points where the visual cues were no longer available. We also assessed participants' auditory-only discrimination of the /θ/-/f/ contrast pretraining and posttraining. During training, the visual cues facilitated novel word learning beyond the benefit of the auditory input alone. However, these additional benefits did not persist when participants' discrimination and novel word learning performance were assessed immediately after training. Most interestingly, after a night's sleep, participants who were exposed to orthography during training showed significant improvement in both discrimination and novel word learning compared to the previous day. The findings are discussed in terms of online versus residual impacts of articulatory gestures and orthography on speech processing. While both visual cues are beneficial when they are simultaneously presented with speech, only orthography shows residual impacts leading to a sleep-dependent enhancement of lexical knowledge through memory consolidation and retuning of the second language /θ/-/f/ contrast. (PsycInfo Database Record (c) 2022 APA, all rights reserved).