Mandarin Tone Production Research Articles

Production of Mandarin and Fuzhou lexical tones in six- to seven-year-old Mandarin-Fuzhou bilingual children

AbstractThis study investigated the production of Mandarin and Fuzhou lexical tones by Mandarin-Fuzhou bilingual children. Forty children aged 6;11 to 7;6 and two groups of adults (Mandarin speakers and Fuzhou speakers) were asked to produce pre-selected familiar monosyllabic words. Adult judges' perceptual judgments and acoustic analysis showed that: (1) overall, these children's production performance of Mandarin tones was similar to adults', with very high accuracy; (2) children did not reach adult-like production competence in Fuzhou tones by age 7;6; and (3) there was an imbalance in children's development of the seven lexical tones in Fuzhou. Children's late and unbalanced development of Fuzhou tones could be ascribed to their unbalanced Mandarin-Fuzhou exposure, and it is argued that children might transfer the characteristics of the Mandarin tonal system to their production of Fuzhou tones.

High variability phonetic training facilitates perception-to-production transfer in Mandarin-speaking children with cochlear implants: An acoustic investigation.

This study primarily aimed to evaluate the effectiveness of high variability phonetic training (HVPT) for children with cochlear implants (CIs) via the cross-modal transfer of perceptual learning to lexical tone production, a scope that has been largely neglected by previous training research. Sixteen CI participants received a five-session HVPT within a period of three weeks, whereas another 16 CI children were recruited without receiving any formal training. Lexical tone production was assessed with a picture naming task before the provision (pretest) and immediately after (posttest) and ten weeks after (follow-up test) the completion of the training protocol. The production samples were coded and analyzed acoustically. Despite considerable distinctions from the typical baselines of normal-hearing peers, the trained CI children exhibited significant improvements in Mandarin tone production from pretest to posttest in pitch height of T1, pitch slope of T2, and pitch curvature of T3. Moreover, the training-induced acoustic changes in the concave characteristic of the T3 contour was retained ten weeks after training termination. This study represents an initial acoustic investigation on HVPT-induced benefits in lexical tone production for the pediatric CI population, which provides valuable insights into applying this perceptual training technique as a viable tool in clinical practices.

Crossmodal correspondence between lexical tones and visual motions: a forced-choice mapping task on Mandarin Chinese

Abstract Crossmodal correspondence refers to the phenomenon in which individuals match stimulus features (e.g., auditory pitch) with different sensory modalities (e.g., visual size). While studies on correspondences exhibited by suprasegmentals have mostly focused on pitch-size and pitch-shape associations, audiospatial binding observed in the production and perception of Mandarin tones, where pitch of the syllable distinguishes word meanings, sheds light on the symbolic potential of auditory pitch. In the present study, a forced-choice mapping task was conducted in the form of a word guessing game, where native Mandarin listeners select the meaning of an auditory “alien” word from two visual motions. The results showed that: (1) listeners reliably match auditory tones with visual motions in the way that pitch trajectories are congruent with spatial movements, (2) vowel category impacts tone-motion correspondence when syllables are articulated in non-contour tones, and (3) the capacities in driving the tone-motion correspondence are different across tonal categories. These findings further contribute to our understanding of the sound symbolic potential of lexical tones and expand the boundary of crossmodal correspondence that can be demonstrated by pitch.

Shadowing textbook and authentic materials in beginning L2 learners’ acquisition of Mandarin Chinese tones in spontaneous speech

Abstract Addressing the lack of research examining the use of discourse-level speech input in beginning L2 learners’ Mandarin tone production in spontaneous speech, this study compares the effects of authentic videos and textbook audios as shadowing materials on beginners’ multisyllabic tone production in spontaneous speech and learner attitudes. Fourteen college students, randomly divided into the “authentic” and “textbook” groups, shadowed for four weeks. From the pretest to the posttest, both groups significantly improved tone accuracy in sentence-level spontaneous speech with no significant differences between groups. Quantitative and qualitative analyses of learners’ responses show that (1) both groups had positive attitudes toward the materials, (2) authentic materials generated greater interest, and learners appreciated shadowing authentic conversations or conversations that mimic natural discourse, and (3) the learners primarily cared about whether the materials were comprehensible, interesting, and accessible. The findings shed light on using authentic materials to teach L2 pronunciation.

Investigating Perception to Production Transfer in Children With Cochlear Implants: A High Variability Phonetic Training Study.

This study builds upon an established effective training method to investigate the advantages of high variability phonetic identification training for enhancing lexical tone perception and production in Mandarin-speaking pediatric cochlear implant (CI) recipients, who typically face ongoing challenges in these areas. Thirty-two Mandarin-speaking children with CIs were quasirandomly assigned into the training group (TG) and the control group (CG). The 16 TG participants received five sessions of high variability phonetic training (HVPT) within a period of 3 weeks. The CG participants did not receive the training. Perception and production of Mandarin tones were administered before (pretest) and immediately after (posttest) the completion of HVPT via lexical tone recognition task and picture naming task. Both groups participated in the identical pretest and posttest with the same time frame between the two test sessions. TG showed significant improvement from pretest to posttest in identifying Mandarin tones for both trained and untrained speech stimuli. Moreover, perceptual learning of HVPT significantly facilitated trainees' production of T1 and T2 as rated by a cohort of 10 Mandarin-speaking adults with normal hearing, which was corroborated by acoustic analyses revealing improved fundamental frequency (F0) median for T1 and T2 production and enlarged F0 movement for T2 production. In contrast, TG children's production of T3 and T4 showed nonsignificant changes across two test sessions. Meanwhile, CG did not exhibit significant changes in either perception or production. The results suggest a limited and inconsistent transfer of perceptual learning to lexical tone production in children with CIs, which challenges the notion of a robust transfer and highlights the complexity of the interaction between perceptual training and production outcomes. Further research on individual differences with a longitudinal design is needed to optimize the training protocol or tailor interventions to better meet the diverse needs of learners.

Perceptual training facilitates Mandarin tone production for preschoolers with cochlear implants: Evidence from acoustic analysis

This study primarily aimed to investigate the benefits of an established perceptual training in the production of lexical tones for Mandarin-speaking preschoolers with cochlear implants (CIs). Thirty-two pediatric CI recipients were tested in this study. Half of the child participants received five sessions of high variability phonetic training (HVPT) within a period of three weeks, whereas the other half served as control who did not receive the formal training. Production of Mandarin tones was recorded before the provision (pretest) and after (posttest) the completion of the training protocol, which was coded and analyzed acoustically with automatic pitch tracking implemented in the software of Praat. Results showed significantly enhanced concave characteristic of dynamic pitch contours for the trained children’s Mandarin tones produced in posttest relative to pretest using growth curve analysis. Moreover, a tonal ellipse analysis indicated significantly improved tone differentiability and tone hit rate from pretest to posttest following training. By contrast, no significant changes were observed in the control children between the two test sessions. The findings represent initial acoustic evidence of HVPT-induced benefits in lexical tone production for CI users, which supports the application of this perceptual training protocol to aural rehabilitation practice.

Analysis of errors in Mandarin disyllabic tones produced by Vietnamese speakers

Abstract This study investigates the tone production of Mandarin disyllabic words by Vietnamese speakers. It aims to provide insights into the challenges Vietnamese speakers face when producing Mandarin tones in disyllabic words. In the study, there were 30 Vietnamese L2 learners of Mandarin, who were requested to produce 80 (4 tones × 4 tones × 5 words of each tonal combination) disyllabic words in Mandarin. The overall results showed that Tone 4 was the most difficult among the four lexical tones. In the first syllable, most errors were found for Tone 3 when followed by another Tone 3 (where the first Tone 3 should be pronounced as a rising tone, similar to Tone 2, but mispronounced as Tone 3), which indicated that Vietnamese speakers tend to underapply Mandarin third tone sandhi. In the second syllable, most errors were found for Tone 4 when preceded by Tone 4 (the second Tone 4 mispronounced as Tone 1). The findings can help explore how L2 production models can account for L2 production of Mandarin tones by considering effects of phonetic/phonological nature of Mandarin lexical tones as well as the interference arising from the L1 phonology of learners.

Quantitative Methods for Analyzing Second Language Lexical Tone Production

The production of L2 lexical tone has proven difficult for learners of tonal languages, leading to the testing of different tone training techniques. To test the validity of these techniques, it is first necessary to capture the differences between L1 and L2 tone datasets. The current study explores three analyses designed to compare L1 and L2 tone: (1) using a single deviation score, (2) using deviation score calculations for specific regions of tone productions, and (3) applying a complexity-invariant distance measure to the two time series datasets. These three analyses were tested using datasets sampled from a previous study testing the effects of a visual feedback paradigm on the production of L2 Mandarin tone. Results suggest the first two analyses, although useful for providing an overall evaluation of how L2 speakers’ pretest versus posttest productions compare to L1 speakers, lose critical information about tone, namely pitch height, contour, and the timing of the production. The third analysis, applying the complexity-invariant distance measure to the datasets, can provide the pertinent information lost from the first two analyses in a more robust manner.

Production of Mandarin Chinese Tones by Sri Lankan CFL Learners: An Acoustic Analysis

Tonal variation in Mandarin forms a relationship with the meanings of words at a lexical level. Tones and tone sandhi are considered distinctive features of Mandarin Chinese phonetics; thus, acquiring accurate Mandarin pronunciation is challenging for speakers of other languages. The present study examined the production of Mandarin tones by Sri Lankan learners through acoustic analysis of f0 using Praat. The study participants were seven (n=7) undergraduate students at intermediate-level Chinese. Each participant recorded a sample of 20 elements, totaling 140 at three tiers: isolation, disyllabic form, and synthesis. The recorded acoustic data were analyzed using Praat 5.4.04 and SPSS Statistics 21. The results indicated that the mean f0 values of the realization of the four tones by the informants are heterogenous at all three tiers. The realization of T3 demonstrated a low accuracy, while T2 was realized with the highest accuracy at all three tiers. As revealed by the tone sandhi analysis, participants have resorted to the underlying representation of the tone sandhi than the surface realization.

Longer Cochlear Implant Experience Leads to Better Production of Mandarin Tones for Early Implanted Children.

Children with cochlear implants (CIs) face challenges in acquiring tones, since CIs do not transmit pitch information effectively. It has been suggested that longer CI experience provides additional benefits for children implanted early, enabling them to achieve language abilities similar to that of normal-hearing (NH) children (Colletti 2009). Mandarin is a tonal language with four lexical tones and a neutral tone (T0), characterized by distinct pitch and durational patterns. It has been suggested that early implantation (i.e., before 2 years) greatly benefits the acquisition of Mandarin tones by children with CIs (Tang et al. 2019c). In this study, we extend those findings to investigate the effect of CI experience on the acquisition of Mandarin tones for children implanted early. We asked the extent to which they were able to produce distinct pitch and durational patterns of both lexical tones and T0 as a function of CI experience, and the extent to which their tonal productions were acoustically like that of NH children. Forty-four NH 3-year olds and 28 children implanted with CIs between 1 and 2 years, aged 3 to 7, were recruited. The children with CIs were grouped according to the length of CI experience: 3 to 6 years, 2 to 3 years, and 1 to 2 years. Lexical tone and T0 productions were elicited using a picture-naming task. Tonal productions from the children with CIs were acoustically analyzed and compared with those from the NH children. Children with 3 to 6 years of CI experience were able to produce distinct pitch and durational patterns for both lexical tones and T0, with NH-like acoustic realizations. Children with 2 to 3 years of CI experience were also able to produce the expected tonal patterns, although their productions were not yet NH-like. Those with only 1 to 2 years of CI experience, however, were not yet able to produce the distinct acoustic patterns for either lexical tones or T0. These results provide acoustic evidence demonstrating that, when Mandarin-speaking children are implanted before the age of 2, only those with 3 to 6 years of experience were able to produce NH-like tones, including both lexical tone and T0. Children with shorter CI experience (less than 3 years) were unable to produce distinct acoustic patterns for the different tones. This suggests that at least 3 years of CI experience is still needed for early implanted children to acquire tonal distinctions similar to those of NH 3-year olds.

Acoustic Assessment of Tone Production of Prelingually-Deafened Mandarin-Speaking Children With Cochlear Implants.

ObjectiveThe purpose of the present study was to investigate Mandarin tone production performance of prelingually deafened children with cochlear implants (CIs) using modified acoustic analyses and to evaluate the relationship between demographic factors of those CI children and their tone production ability.MethodsTwo hundred seventy-eight prelingually deafened children with CIs and 173 age-matched normal-hearing (NH) children participated in the study. Thirty-six monosyllabic Mandarin Chinese words were recorded from each subject. The fundamental frequencies (F0) were extracted from the tone tokens. Two acoustic measures (i.e., differentiability and hit rate) were computed based on the F0 onset and offset values (i.e., the tone ellipses of the two-dimensional [2D] method) or the F0 onset, midpoint, and offset values (i.e., the tone ellipsoids of the 3D method). The correlations between the acoustic measures as well as between the methods were performed. The relationship between demographic factors and acoustic measures were also explored.ResultsThe children with CIs showed significantly poorer performance in tone differentiability and hit rate than the NH children. For both CI and NH groups, performance on the two acoustic measures was highly correlated with each other (r values: 0.895–0.961). The performance between the two methods (i.e., 2D and 3D methods) was also highly correlated (r values: 0.774–0.914). Age at implantation and duration of CI use showed a weak correlation with the scores of acoustic measures under both methods. These two factors jointly accounted for 15.4–18.9% of the total variance of tone production performance.ConclusionThere were significant deficits in tone production ability in most prelingually deafened children with CIs, even after prolonged use of the devices. The strong correlation between the two methods suggested that the simpler, 2D method seemed to be efficient in acoustic assessment for lexical tones in hearing-impaired children. Age at implantation and especially the duration of CI use were significant, although weak, predictors for tone development in pediatric CI users. Although a large part of tone production ability could not be attributed to these two factors, the results still encourage early implantation and continual CI use for better lexical tone development in Mandarin-speaking pediatric CI users.

The effects of metaphonological awareness training on L3 Mandarin tone acquisition by Cantonese learners

ABSTRACT According to the speech learning model [Flege, J. E. (1995). Second language speech learning: Theory, findings, and problems. In W. Strange (Ed.), Speech perception and linguistic experience: Issues in cross-language research (pp. 233–277). York Press], learners whose first language (L1) is a tonal language (e.g. Cantonese) can be confused by similar yet different tones in their L1 and another tonal language (e.g. Mandarin). Encouraged by the biliteracy and trilingualism language policy in Hong Kong, L1 Cantonese learners of Mandarin have been committed to learning the third language (L3) Mandarin tones but are struggling with that task. The main purpose of this study is to examine Cantonese learners’ perceptions and production of Mandarin tones, and to investigate learners’ performance in production tasks before and after implementing metaphonological awareness protocols. Twenty-five Cantonese learners studying at a local university were recruited to complete the production, perception and verbal protocol tasks. Based on Wrembel’s [2015. Metaphonologcial awareness in multilinguals: A case of L3 Polish. Language Awareness, 24(1), 60–83. https://doi.org/10.1080/09658416.2014.890209] framework, this study categorised the participants’ statements of metaphonological awareness shown in their self-correction and self-reflection performances in the introspective and retrospective protocols. The error rates and patterns in the production and perception tasks were analysed. Metaphonological awareness training has a significant positive effect on improving learners’ Mandarin tone pronunciation.

Going beyond F0: The acquisition of Mandarin tones

Using a semi-spontaneous speech corpus, we present evidence from computational modelling of tonal productions from Mandarin-speaking children (4- to 11-years old) and adults, showing that children exceed the adult-level tonal distinction at the age of 7 to 8 years using F0 cues, but do not reach the high adult-level distinction using spectral cues even at the age of 10 to 11 years. The difference in the developmental curves of F0 and spectral cues suggests that, in Mandarin tone production, secondary cues continue to develop even after the mastery of primary cues.

Do Explicit Instruction and High Variability Phonetic Training Improve Nonnative Speakers’ Mandarin Tone Productions?

AbstractThis study examines the putative benefits of explicit phonetic instruction, high variability phonetic training, and their effects on adult nonnative speakers’ Mandarin tone productions. Monolingual first language (L1) English speakers (n= 80), intermediate second language (L2) Mandarin learners (n= 40), and L1 Mandarin speakers (n= 40) took part in a multiday Mandarin‐like artificial language learning task. Participants were asked to repeat a syllable–tone combination immediately after hearing it. Half of all participants were exposed to speech from 1 talker (low variability) while the other half heard speech from 4 talkers (high variability). Half of the L1 English participants were given daily explicit instruction on Mandarin tone contours, while the other half were not. Tone accuracy was measured by L1 Mandarin raters (n= 104) who classified productions according to their perceived tonal category. Explicit instruction of tone contours facilitated L1 English participants’ production of rising and falling tone contours. High variability input alone had no main effect on participants’ productions but interacted with explicit instruction to improve participants’ productions of high‐level tone contours. These results motivate an L2 tone production training approach that consists of explicit tone instruction followed by gradual exposure to more variable speech.

Computer-vision analysis reveals facial movements made during Mandarin tone production align with pitch trajectories

Using computer-vision and image processing techniques, we aim to identify specific visual cues as induced by facial movements made during Mandarin tone production and examine how they are associated with each of the four Mandarin tones. Audio-video recordings of 20 native Mandarin speakers producing Mandarin words involving the vowel /3/ with each of the four tones were analyzed. Four facial points of interest were detected automatically: medial point of left eyebrow, nose tip (proxy for head movement), and midpoints of the upper and lower lips. The detected points were then automatically tracked in the subsequent video frames. Critical features such as the distance, velocity, and acceleration describing local facial movements with respect to the resting face of each speaker were extracted from the positional profiles of each tracked point. Analysis of variance and feature importance analysis based on random forest were performed to examine the significance of each feature for representing each tone and how well these features can individually and collectively characterize each tone. Results suggest alignments between articulatory movements and pitch trajectories, with downward or upward head and eyebrow movements following the dipping and rising tone trajectories respectively, lip closing movement being associated with the falling tone, and minimal movements for the level tone.

EFFECTS OF IMPLICIT VERSUS EXPLICIT CORRECTIVE FEEDBACK ON MANDARIN TONE ACQUISITION IN A SCMC LEARNING ENVIRONMENT

AbstractThe current study investigates the effects of more explicit versus more implicit corrective feedback on beginner Mandarin learners’ perception and production of Mandarin tones. The effects of oral corrective feedback have been extensively investigated for various domains of second language acquisition (see Mackey & Goo, 2007). For phonological errors, implicit feedback has shown to be particularly salient to learners (Mackey, Gass, & McDonough, 2000) and therefore potentially more effective for tone learning. However, for lower proficiency beginners, explicit corrective feedback has been shown to be more effective (Li, 2009, 2014). Using a mixed methods design, the current study investigated the acquisition of Mandarin tones in beginner, adult learners (n = 41) enrolled in a 14-week, one-on-one, synchronous computer-mediated communication course. Learners were divided into two experimental groups: a more implicit feedback group and a more explicit feedback group. Pretests and posttests assessed changes in tone perception and production. Upon completion of the course, learners in the more implicit feedback group had greater improvement in tone production compared to the more explicit feedback group (d = .75). Both learners and the instructor indicated a preference toward recasts for tone feedback. No statistically significant differences were found for tone perception.

Exploring the Effects of Imitating Hand Gestures and Head Nods on L1 and L2 Mandarin Tone Production.

This study investigated the impact of metaphoric actions-head nods and hand gestures-in producing Mandarin tones for first language (L1) and second language (L2) speakers. In 2 experiments, participants imitated videos of Mandarin tones produced under 3 conditions: (a) speech alone, (b) speech + head nods, and (c) speech + hand gestures. Fundamental frequency was recorded for both L1 (Experiment 1) and L2 (Experiment 2a) speakers, and the output of the L2 speakers was rated for tonal accuracy by 7 native Mandarin judges (Experiment 2b). Experiment 1 showed that 12 L1 speakers' fundamental frequency spectral data did not differ among the 3 conditions. In Experiment 2a, the conditions did not affect the production of 24 English speakers for the most part, but there was some evidence that hand gestures helped Tone 4. In Experiment 2b, native Mandarin judges found limited conditional differences in L2 productions, with Tone 3 showing a slight head nods benefit in a subset of "correct" L2 tokens. Results suggest that metaphoric bodily actions do not influence the lowest levels of L1 speech production in a tonal language and may play a very modest role during preliminary L2 learning.

Computer-vision analysis shows different facial movements for the production of different Mandarin tones

We aim to identify visual cues resulting from facial movements made during Mandarin tone production and examine how they are associated with each of the four tones. We use signal processing and computer vision techniques to analyze audio-video recordings of 21 native Mandarin speakers uttering the vowel /ɜ/ with each tone. Four facial interest points were automatically detected and tracked in the video frames: medial point of left-eyebrow, nose tip (proxy for head movement), and midpoints of the upper and lower lips. Spatiotemporal features were extracted from the positional profiles of each tracked point. These features included distance, velocity, and acceleration of local facial movements with respect to the resting face of each speaker. Analysis of variance and feature importance analysis based on random decision forest were performed to examine the significance of each feature for representing each tone and how well these features can individually and collectively characterize each tone. Preliminary results suggest alignments between articulatory movements and pitch trajectories, with downward or upward head and eyebrow movements following the dipping and rising tone trajectories, faster lip-closing toward the end of falling tone production, and minimal movements for the level tone.

The relation between production and perception of Mandarin tone

This pilot study explores the potential production-perception relation of Mandarin tones by examining the association between the acoustic features of native Mandarin tone production and perception of such features, using Tone 2 (rising tone) as a testing case. The perception stimuli were resynthesized by varying F0 onset (spectral feature) and F0 turning-point location (temporal feature) orthogonally forming a grid of tone contours. The endpoints of these dimensions were determined by natural Tone 1 and 3 productions, presumably corresponding to perceptual boundaries for Tone 2. A parabola was fitted to the resynthesized tones to determine the overall shape of the tone contour. Native Mandarin participants were asked to identify the best exemplar of Tone 2. The acoustic analysis of Tone 2 productions by the same participants included measurements of the same features. Preliminary correlation analysis showed a positive production-perception correlation for the temporal feature of F0 turning-point location, but no significant correlation for the spectral features of F0 onset and F0 contour shape, indicating F0 turning-point location as a critical perceptual cue for Tone 2. Further research will include additional tones and additional acoustic features found to characterize these tones to identify the nature of production-perception relation of Mandarin tones.

Coordinated systems in Taiwan Mandarin tone production: An investigation of laryngeal and tongue movements

While electroglottography (EGG) is commonly used to examine different phonation types as well as laryngeal closure and opening of segments, only limited EGG studies focus on tonal quality [Brunelle et al., 2010, Phonetica, 67:147]. In particular, it is not yet clear how laryngeal movements in terms of its vibration magnitude and vertical displacement may be associated with pitch contour in tone production. The current study tackles this question by examining the amplitude of EGG pulses and laryngeal heights across four tones in Taiwan Mandarin. Ultrasound images are also obtained to assess the temporal relationship between tongue positioning and laryngeal movements during tone production. Preliminary results show that while the laryngeal area is more constricted by low, back vowels, a stronger correlation between EGG amplitude and pitch contour is found. On the other hand, when the tongue is positioned in the front of the cavity, larger degrees of freedom around the laryngeal area yield a lesser correlation between EGG amplitude and pitch contour but a stronger correlation between laryngeal height and pitch contour. The results suggest that tone production may be a result of a combination of laryngeal vibration and spatial coordination between the laryngeal and supralaryngeal movements. [Funding from MOST.]