Syllable Sequences Research Articles

Six-month-old infants' perception of structural regularities in speech

In order to acquire grammar, infants need to extract regularities from the linguistic input. From birth, infants can detect regularities in speech based on identity relations, and show strong neural activation to syllable sequences containing adjacent repetitions of identical syllables (e.g. ABB: mubaba). Meanwhile, newborns' neural responses to sequences of different syllables (e.g. ABC: mubage, i.e. diversity-based relations) do not differ from baseline. However, this latter ability needs to emerge during development, as most linguistic units, such as words, are composed of highly variable sequences. As infants begin to learn their first word forms at 6 months, we hypothesize that the ability to represent sequences of different syllables might become important for them at this age. Using near-infrared spectroscopy (NIRS), we measured 6-month-old infants' brain responses to repetition- and diversity-based sequences in the bilateral temporal, parietal and frontal areas. We found that 6-month-olds discriminated the repetition- and diversity-based structures in frontal and parietal regions, and exhibited equally strong activation to both grammars as compared to baseline. These results show that by 6 months of age, infants encode sequences with diversity-based structures. They thus provide the earliest evidence that prelexical infants represent difference in speech stimuli, which behavioral studies first attest at 11 months of age.

Unexpected sound omissions are signaled in human posterior superior temporal gyrus: an intracranial study.

Context modulates sensory neural activations enhancing perceptual and behavioral performance and reducing prediction errors. However, the mechanism of when and where these high-level expectations act on sensory processing is unclear. Here, we isolate the effect of expectation absent of any auditory evoked activity by assessing the response to omitted expected sounds. Electrocorticographic signals were recorded directly from subdural electrode grids placed over the superior temporal gyrus (STG). Subjects listened to a predictable sequence of syllables, with some infrequently omitted. We found high-frequency band activity (HFA, 70-170Hz) in response to omissions, which overlapped with a posterior subset of auditory-active electrodes in STG. Heard syllables could be distinguishable reliably from STG, but not the identity of the omitted stimulus. Both omission- and target-detection responses were also observed in the prefrontal cortex. We propose that the posterior STG is central for implementing predictions in the auditory environment. HFA omission responses in this region appear to index mismatch-signaling or salience detection processes.

Zebra finches (Taeniopygia guttata) demonstrate cognitive flexibility in using phonology and sequence of syllables in auditory discrimination

Zebra finches rely mainly on syllable phonology rather than on syllable sequence when they discriminate between two songs. However, they can also learn to discriminate two strings containing the same set of syllables by their sequence. How learning about the phonological characteristics of syllables and their sequence relate to each other and to the composition of the stimuli is still an open question. We compared whether and how the zebra finches’ relative sensitivity for syllable phonology and syllable sequence depends on the differences between syllable strings. Two groups of zebra finches were trained in a Go-Left/Go-Right task to discriminate either between two strings in which each string contained a unique set of song syllables (‘Different-syllables group’) or two strings in which both strings contained the same set of syllables, but in a different sequential order (‘Same-syllables group’). We assessed to what extent the birds in the two experimental groups attend to the spectral characteristics and the sequence of the syllables by measuring the responses to test strings consisting of spectral modifications or sequence changes. Our results showed no difference in the number of trials needed to discriminate strings consisting of either different or identical sets of syllables. Both experimental groups attended to changes in spectral features in a similar way, but the group for which both training strings consisted of the same set of syllables responded more strongly to changes in sequence than the group for which the training strings consisted of different sets of syllables. This outcome suggests the presence of an additional learning process to learn about syllable sequence when learning about syllable phonology is not sufficient to discriminate two strings. Our study thus demonstrates that the relative importance of syllable phonology and sequence depends on how these features vary among stimuli. This indicates cognitive flexibility in the acoustic features that songbirds might use in their song recognition.

Sound order discrimination in two species of birds-Taeniopygia guttata and Melopsittacus undulatus.

Recent psychophysical experiments have shown that zebra finches (Taeniopygia guttata-a songbird) are surprisingly insensitive to syllable sequence changes in their species-specific motifs while budgerigars (Melopsittacus undulatus-a psittacine) do much better when tested on exactly the same sounds. This is unexpected since zebra finch males learn the order of syllables in their songs when young and sing the same song throughout adulthood. Here we probe the limits of this species difference by testing birds on an order change involving just two syllables, hereafter called bi-syllable phrases. Results show budgerigars still perform better than zebra finches on an order change involving just two syllables. An analysis of response latencies shows that both species respond to an order change in a bi-syllable motif at the onset of the first syllable rather than listening to the entire sequence before responding. Additional tests with one syllable omitted or doubled, or with white noise bursts substituted for syllables, indicate that the first syllable in the sequence has a dominant effect on subsequent discrimination of changes in a bi-syllable pattern. These results are surprising in that zebra finch males sing their full motif syllable sequence with a high degree of stereotypy throughout life, suggesting that this consistency in production may not rely on perceptual mechanisms for processing syllable order in adulthood. Budgerigars, on the other hand, are quite sensitive to bi-syllable order changes, an ability that may be related to useful information being encoded in the sequence of syllables in their natural song. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Bayesian semiparametric Markov renewal mixed models for vocalization syntax.

Speech and language play an important role in human vocal communication. Studies have shown that vocal disorders can result from genetic factors. In the absence of high-quality data on humans, mouse vocalization experiments in laboratory settings have been proven useful in providing valuable insights into mammalian vocal development, including especially the impact of certain genetic mutations. Such data sets usually consist of categorical syllable sequences along with continuous intersyllable interval (ISI) times for mice of different genotypes vocalizing under different contexts. ISIs are of particular importance as increased ISIs can be an indication of possible vocal impairment. Statistical methods for properly analyzing ISIs along with the transition probabilities have however been lacking. In this article, we propose a class of novel Markov renewal mixed models that capture the stochastic dynamics of both state transitions and ISI lengths. Specifically, we model the transition dynamics and the ISIs using Dirichlet and gamma mixtures, respectively, allowing the mixture probabilities in both cases to vary flexibly with fixed covariate effects as well as random individual-specific effects. We apply our model to analyze the impact of a mutation in the Foxp2 gene on mouse vocal behavior. We find that genotypes and social contexts significantly affect the length of ISIs but, compared to previous analyses, the influences of genotype and social context on the syllable transition dynamics are weaker.

Decoding silent speech from high-density surface electromyographic data using transformer

Recent silent speech recognition (SSR) studies based on surface electromyography (sEMG) have been conducted by classifying a finite number of words or phrases without sufficient understanding of temporally semantic information compared to sequential decoding at a fine-grained syllable or phoneme level. This paper presents a syllable-level sequential decoding method using a transformer model for sEMG-based SSR. The proposed method consists of a transformer model and a language model. The input sEMG data was first translated into a sequence of syllable-level decisions by the transformer model. Then, these sequential syllable-level decisions were tuned as a final syllable sequence to approximate natural language through the language model. To verify the effectiveness of the proposed method, experiment data were recorded using two high-density electrode arrays with 64 channels from a total of eight subjects during subvocally reading a corpus of 33 Chinese phrases generated from a dictionary of 82 syllables. The proposed method achieved the lowest character error rate of 5.14 ± 3.28 % and the highest phrase recognition accuracy of 96.37 ± 2.06 %, and it significantly outperformed other common methods for sEMG-based SSR. These findings demonstrated the feasibility and usability of the proposed method for practical SSR applications.

Infants’ short-term memory for consonant–vowel syllables

This research examined whether the auditory short-term memory (STM) capacity for speech sounds differs from that for nonlinguistic sounds in 11-month-old infants. Infants were presented with streams composed of repeating sequences of either 2 or 4 syllables, akin to prior work by Ross-Sheehy and Newman (2015) using nonlinguistic musical instruments. These syllable sequences either stayed the same for every repetition (constant) or changed by one syllable each time it repeated (varying). Using the head-turn preference procedure, we measured infant listening time to each type of stream (constant vs varying and 2 vs 4 syllables). Longer listening to the varying stream was taken as evidence for STM because this required remembering all syllables in the sequence. We found that infants listened longer to the varying streams for 2-syllable sequences but not for 4-syllable sequences. This capacity limitation is comparable to that found previously for nonlinguistic instrument tones, suggesting that young infants have similar STM limitations for speech and nonspeech stimuli.

Irrelevant speech impairs serial recall of verbal but not spatial items in children and adults

Immediate serial recall of visually presented items is reliably impaired by task-irrelevant speech that the participants are instructed to ignore (“irrelevant speech effect,” ISE). The ISE is stronger with changing speech tokens (words or syllables) when compared to repetitions of single tokens (“changing-state effect,” CSE). These phenomena have been attributed to sound-induced diversions of attention away from the focal task (attention capture account), or to specific interference of obligatory, involuntary sound processing with either the integrity of phonological traces in a phonological short-term store (phonological loop account), or the efficiency of a domain-general rehearsal process employed for serial order retention (changing-state account). Aiming to further explore the role of attention, phonological coding, and serial order retention in the ISE, we analyzed the effects of steady-state and changing-state speech on serial order reconstruction of visually presented verbal and spatial items in children (n = 81) and adults (n = 80). In the verbal task, both age groups performed worse with changing-state speech (sequences of different syllables) when compared with steady-state speech (one syllable repeated) and silence. Children were more impaired than adults by both speech sounds. In the spatial task, no disruptive effect of irrelevant speech was found in either group. These results indicate that irrelevant speech evokes similarity-based interference, and thus pose difficulties for the attention-capture and the changing-state account of the ISE.

Constraints on infants’ ability to extract non-adjacent dependencies from vowels and consonants

Language acquisition requires infants’ ability to track dependencies between distant speech elements. Infants as young as 3 months have been shown to successfully identify such non-adjacent dependencies between syllables, and this ability has been related to the maturity of infants’ pitch processing. The present study tested whether 8- to 10-month-old infants (N = 68) can also learn dependencies at smaller segmental levels and whether the relation between dependency and pitch processing extends to other auditory features. Infants heard either syllable sequences encoding an item-specific dependency between non-adjacent vowels or between consonants. These frequent standard sequences were interspersed with infrequent intensity deviants and dependency deviants, which violated the non-adjacent relationship. Both vowel and consonant groups showed electrophysiological evidence for detection of the intensity manipulation. However, evidence for dependency learning was only found for infants hearing the dependencies across vowels, not consonants, and only in a subgroup of infants who had an above-average language score in a behavioral test. In a correlation analysis, we found no relation between intensity and dependency processing. We conclude that item-specific, segment-based non-adjacent dependencies are not easily learned by infants and if so, vowels are more accessible to the task, but only to infants who display advanced language skills.

Defining the prosodic word with segmental processes in Dagbani

Abstract Few studies have explored the relevance of metrical structures in segmental processes. This paper shows that Dagbani (Gur, Ghana), has a prosodic word dominating a trochaic foot which licenses segmental processes and phonotactics. The foot is the domain for marked vowels and unmarked consonants. The prosodic word regulates the sequencing of syllables of different degrees of sonority and weight within a word. The Optimality Theoretic analyses make use of classical metrical theory and prosodic principles used in defining the prosodic word in stress languages to highlight the typological relevance of these principles and the prosodic universality of these metrical structures.

Disrupted neural tracking of sound localization during non-rapid eye movement sleep

Spatial hearing in humans is a high-level auditory process that is crucial to rapid sound localization in the environment. Both neurophysiological models with animals and neuroimaging evidence from human subjects in the wakefulness stage suggest that the localization of auditory objects is mainly located in the posterior auditory cortex. However, whether this cognitive process is preserved during sleep remains unclear. To fill this research gap, we investigated the sleeping brain's capacity to identify sound locations by recording simultaneous electroencephalographic (EEG) and magnetoencephalographic (MEG) signals during wakefulness and non-rapid eye movement (NREM) sleep in human subjects. Using the frequency-tagging paradigm, the subjects were presented with a basic syllable sequence at 5 Hz and a location change that occurred every three syllables, resulting in a sound localization shift at 1.67 Hz. The EEG and MEG signals were used for sleep scoring and neural tracking analyses, respectively. Neural tracking responses at 5 Hz reflecting basic auditory processing were observed during both wakefulness and NREM sleep, although the responses during sleep were weaker than those during wakefulness. Cortical responses at 1.67 Hz, which correspond to the sound location change, were observed during wakefulness regardless of attention to the stimuli but vanished during NREM sleep. These results for the first time indicate that sleep preserves basic auditory processing but disrupts the higher-order brain function of sound localization.

Statistical learning in patients in the minimally conscious state.

When listening to speech, cortical activity can track mentally constructed linguistic units such as words, phrases, and sentences. Recent studies have also shown that the neural responses to mentally constructed linguistic units can predict the outcome of patients with disorders of consciousness (DoC). In healthy individuals, cortical tracking of linguistic units can be driven by both long-term linguistic knowledge and online learning of the transitional probability between syllables. Here, we investigated whether statistical learning could occur in patients in the minimally conscious state (MCS) and patients emerged from the MCS (EMCS) using electroencephalography (EEG). In Experiment 1, we presented to participants an isochronous sequence of syllables, which were composed of either 4 real disyllabic words or 4 reversed disyllabic words. An inter-trial phase coherence analysis revealed that the patient groups showed similar word tracking responses to real and reversed words. In Experiment 2, we presented trisyllabic artificial words that were defined by the transitional probability between words, and a significant word-rate EEG response was observed for MCS patients. These results suggested that statistical learning can occur with a minimal conscious level. The residual statistical learning ability in MCS patients could potentially be harnessed to induce neural plasticity.

Syntax Acquisition in Healthy Adults and Post-Stroke Individuals: The Intriguing Role of Grammatical Preference, Statistical Learning, and Education.

Previous work has provided contrasting evidence on syntax acquisition. Syntax-internal factors, i.e., instinctive knowledge of the universals of grammar (UG) for finite-state grammar (FSG) and phrase-structure grammar (PSG) but also syntax-external factors such as language competence, working memory (WM) and demographic factors may affect syntax acquisition. This study employed an artificial grammar paradigm to identify which factors predicted syntax acquisition. Thirty-seven healthy individuals and forty-nine left-hemispheric stroke patients (fourteen with aphasia) read syllable sequences adhering to or violating FSG and PSG. They performed preference classifications followed by grammatical classifications (after training). Results showed the best classification accuracy for sequences adhering to UG, with performance predicted by syntactic competence and spatial WM. Classification of ungrammatical sequences improved after training and was predicted by verbal WM. Although accuracy on FSG was better than on PSG, generalization was fully possible only for PSG. Education was the best predictor of syntax acquisition, while aphasia and lesion volume were not predictors. This study shows a clear preference for UG, which is influenced by spatial and linguistic knowledge, but not by the presence of aphasia. Verbal WM supported the identification of rule violations. Moreover, the acquisition of FSG and PSG was related to partially different mechanisms, but both depended on education.

Delayed Auditory Feedback Elicits Specific Patterns of Serial Order Errors in a Paced Syllable Sequence Production Task.

Delayed auditory feedback (DAF) interferes with speech output. DAF causes distorted and disfluent productions and errors in the serial order of produced sounds. Although DAF has been studied extensively, the specific patterns of elicited speech errors are somewhat obscured by relatively small speech samples, differences across studies, and uncontrolled variables. The goal of this study was to characterize the types of serial order errors that increase under DAF in a systematic syllable sequence production task, which used a closed set of sounds and controlled for speech rate. Sixteen adult speakers repeatedly produced CVCVCV (C = consonant, V = vowel) sequences, paced to a "visual metronome," while hearing self-generated feedback with delays of 0-250 ms. Listeners transcribed recordings, and speech errors were classified based on the literature surrounding naturally occurring slips of the tongue. A series of mixed-effects models were used to assess the effects of delay for different error types, for error arrival time, and for speaking rate. DAF had a significant effect on the overall error rate for delays of 100 ms or greater. Statistical models revealed significant effects (relative to zero delay) for vowel and syllable repetitions, vowel exchanges, vowel omissions, onset disfluencies, and distortions. Serial order errors were especially dominated by vowel and syllable repetitions. Errors occurred earlier on average within a trial for longer feedback delays. Although longer delays caused slower speech, this effect was mediated by the run number (time in the experiment) and small compared with those in previous studies. DAF drives a specific pattern of serial order errors. The dominant pattern of vowel and syllable repetition errors suggests possible mechanisms whereby DAF drives changes to the activity in speech planning representations, yielding errors. These mechanisms are outlined with reference to the GODIVA (Gradient Order Directions Into Velocities of Articulators) model of speech planning and production. https://doi.org/10.23641/asha.19601785.

Acoustic analysis of vowel production in children with childhood apraxia of speech

Childhood apraxia of speech (CAS) is a complex neurological subtype of speech sound disorder (SSD), involving impaired speech motor planning and programming. Speech characteristics of CAS include difficulty in sequencing speech movements in the absence of muscle weakness resulting in segmental (e.g., vowel/consonant distortions) and suprasegmental (e.g., inappropriate lexical stress) speech deficits. Acoustic analysis offers a robust objective diagnostic measurement of CAS for lexical stress and consonant accuracy/consistency. However, other reported CAS features, such as vowel errors and distortions, have yet to be extensively validated using acoustic analyses. This study will acoustically analyze vowel errors and inconsistencies for corner vowels (/i, u, æ, ɑ/) in children with CAS (aged 8;0 to 15;11) compared to peers with SSD and typical development (TD). Vowel space measures (e.g., vowel space area and formant centralization ratio) and consistency (e.g., vowel cluster distribution) will be assessed in 24 children (CAS = 4, SSD = 10, and TD = 10) across various phonetic contexts (e.g., syllable sequencing between anterior to posterior voiced/voiceless stops of increasing syllable length). It is predicted that children with CAS will demonstrate (1) greater vowel inconsistencies as context complexity increases and (2) a neutralized vowel space based on the corner vowels relative to children with SSD and TD.

Altered brain network topology during speech tracking in developmental dyslexia

Developmental dyslexia is often accompanied by altered phonological processing of speech. Underlying neural changes have typically been characterized in terms of stimulus- and/or task-related responses within individual brain regions or their functional connectivity. Less is known about potential changes in the more global functional organization of brain networks. Here we recorded electroencephalography (EEG) in typical and dyslexic readers while they listened to (a) a random sequence of syllables and (b) a series of tri-syllabic real words. The network topology of the phase synchronization of evoked cortical oscillations was investigated in four frequency bands (delta, theta, alpha and beta) using minimum spanning tree graphs. We found that, compared to syllable tracking, word tracking triggered a shift toward a more integrated network topology in the theta band in both groups. Importantly, this change was significantly stronger in the dyslexic readers, who also showed increased reliance on a right frontal cluster of electrodes for word tracking. The current findings point towards an altered effect of word-level processing on the functional brain network organization that may be associated with less efficient phonological and reading skills in dyslexia.

Psychometric Properties of Rapid Word-Based Rate Measures in the Assessment of Bulbar Amyotrophic Lateral Sclerosis: Comparisons With Syllable-Based Rate Tasks.

Purpose Rapid maximum performance repetition tasks have increasingly demonstrated their utility as clinimetric markers supporting diagnosis and monitoring of bulbar disease in amyotrophic lateral sclerosis (ALS). A recently developed protocol uses novel real-word repetitions instead of traditional nonword/syllable sequences in hopes of improving sensitivity to motor speech impairments by adding a phonological target constraint that would activate a greater expanse of the motor speech neuroanatomy. This study established the psychometric properties of this novel clinimetric protocol in its assessment of bulbar ALS and compared performance to traditional syllable sequence dysdiadochokinetic (DDK) tasks. Specific objectives were to (a) compare rates between controls and speakers with symptomatic versus presymptomatic bulbar disease, (b) characterize their discriminatory ability in detecting presymptomatic bulbar disease compared to healthy speech, (c) determine their articulatory movement underpinnings, and (d) establish within-individual longitudinal changes. Method DDK and novel tongue ("ticker"-TAR) and labial ("pepper"-LAR) articulatory rates were compared between n = 18 speakers with presymptomatic bulbar disease, n = 10 speakers with symptomatic bulbar disease, and n = 13 healthy controls. Bulbar disease groups were determined by a previously validated speaking rate cutoff. Discriminatory ability was determined using receiver operating characteristic analysis. Within-individual change over time was characterized in a subset of 16 participants with available longitudinal data using linear mixed-effects models. Real-time articulatory movements of the tongue front, tongue dorsum, jaw, and lips were captured using 3-D electromagnetic articulography; effects of movement displacement and speed on clinimetric rates were determined using stepwise linear regressions. Results All clinimetric rates (traditional DDK tasks and novel tasks) were reduced in speakers with symptomatic bulbar disease; only TAR was reduced in speakers with presymptomatic bulbar disease and was able to detect this group with an excellent discrimination ability (area under the curve = 0.83). Kinematic analyses revealed associations with expected articulators, greater motor complexity, and differential articulatory patterns for the novel real-word repetitions than their DDK counterparts. Only LAR significantly declined longitudinally over the disease course. Conclusion Novel real-word clinimetric rate tasks evaluating tongue and labial articulatory dysfunction are valid and effective markers for early detection and tracking of bulbar disease in ALS.

On the Primary Influences of Age on Articulation and Phonation in Maximum Performance Tasks

Maximum performance tasks have been identified as possible domains where incipient signs of neurological disease may be detected in simple speech and voice samples. However, it is likely that these will simultaneously be influenced by the age and sex of the speaker. In this study, a comprehensive set of acoustic quantifications were collected from the literature and applied to productions of sustained [a] productions and Alternating Motion Rate diadochokinetic (DDK) syllable sequences made by 130 (62 women, 68 men) healthy speakers, aged 20–90 years. The participants were asked to produce as stable (sustained [a] and DDK) and fast (DDK) productions as possible. The full set of features were reduced to a functional subset that most efficiently modeled sex-specific differences between younger and older speakers using a cross-validation procedure. Twelve measures of [a] and 16 measures of DDK sequences were identified across men and women and investigated in terms of how they were altered with increasing age of speakers. Increased production instability is observed in both tasks, primarily above the age of 60 years. DDK sequences were slower in older speakers, but also altered in their syllable and segment level acoustic properties. Increasing age does not appear to affect phonation or articulation uniformly, and men and women are affected differently in most quantifications investigated.

What Is the Role of Thalamostriatal Circuits in Learning Vocal Sequences?

Basal ganglia (BG) circuits integrate sensory and motor-related information from the cortex, thalamus, and midbrain to guide learning and production of motor sequences. Birdsong, like speech, is comprised of precisely sequenced vocal elements. Learning song sequences during development relies on Area X, a vocalization related region in the medial striatum of the songbird BG. Area X receives inputs from cortical-like pallial song circuits and midbrain dopaminergic circuits and sends projections to the thalamus. It has recently been shown that thalamic circuits also send substantial projections back to Area X. Here, we outline a gated-reinforcement learning model for how Area X may use signals conveyed by thalamostriatal inputs to direct song learning. Integrating conceptual advances from recent mammalian and songbird literature, we hypothesize that thalamostriatal pathways convey signals linked to song syllable onsets and offsets and influence striatal circuit plasticity via regulation of cholinergic interneurons (ChIs). We suggest that syllable sequence associated vocal-motor information from the thalamus drive precisely timed pauses in ChIs activity in Area X. When integrated with concurrent corticostriatal and dopaminergic input, this circuit helps regulate plasticity on medium spiny neurons (MSNs) and the learning of syllable sequences. We discuss new approaches that can be applied to test core ideas of this model and how associated insights may provide a framework for understanding the function of BG circuits in learning motor sequences.

Which Utterance Types Are Most Suitable to Detect Hypernasality Automatically?

Automatic tools to detect hypernasality have been traditionally designed to analyze sustained vowels exclusively. This is in sharp contrast with clinical recommendations, which consider it necessary to use a variety of utterance types (e.g., repeated syllables, sustained sounds, sentences, etc.) This study explores the feasibility of detecting hypernasality automatically based on speech samples other than sustained vowels. The participants were 39 patients and 39 healthy controls. Six types of utterances were used: counting 1-to-10 and repetition of syllable sequences, sustained consonants, sustained vowel, words and sentences. The recordings were obtained, with the help of a mobile app, from Spain, Chile and Ecuador. Multiple acoustic features were computed from each utterance (e.g., MFCC, formant frequency) After a selection process, the best 20 features served to train different classification algorithms. Accuracy was the highest with syllable sequences and also with some words and sentences. Accuracy increased slightly by training the classifiers with between two and three utterances. However, the best results were obtained by combining the results of multiple classifiers. We conclude that protocols for automatic evaluation of hypernasality should include a variety of utterance types. It seems feasible to detect hypernasality automatically with mobile devices.