Speech Research Articles

Parents' Distress and Demands for Children With Cancer-Related Cognitive Impairment in Western China: A Qualitative Study.

Cancer-related cognitive impairment is one of the common complications in children with cancer, but our understanding of their experience with cognitive deficits remains limited. From the perspective of parents, this study aimed to explore the distress and demands faced by children with cancer-related cognitive impairment, to provide references for developing targeted intervention strategies for cancer children. We used a purposeful sampling method to conduct semi-structured interviews with the parents of 18 children with cancer-related cognitive impairment. The transcripts were analyzed using Colaizzi's method. Three categories and 11 subcategories were obtained from the data analysis, including diverse levels of cognitive impairment in children (speech communication difficulties, impaired executive function, attention deficit, and intellectual disability), persistent negative emotions (anxiety and worry, complaints and resentment, negative avoidance and positive experiences after psychological adjustment), multiple needs (need for disease information, need for professional management, and an urgent need for more external support). Parents of children with cancer-related cognitive impairment face a significant psychological burden, coupled with confusion and numerous inquiries regarding the symptoms and management of their children's cognitive impairment. It is imperative for medical professionals to strengthen the dissemination of information related to cancer-associated cognitive impairments, while promptly recognizing and intervening in related symptoms. Rational allocation of resources, establishment of targeted support systems, and enhancement of social acceptance may be the key points that policymakers could consider. These efforts hold immense significance, as they play a pivotal role in elevating cognitive capabilities and enhancing the overall quality of life for children with cancer.

Vocal functional flexibility in a nonprimate vocal learning species

Abstract Can nonhuman animals use the same acoustic signal to transmit different illocutions on different occasions? This communicative capacity is known as vocal functional flexibility and occurs, for example, in speech, when a sentence serves different illocutionary forces or functions on different occasions based on changes to visual and intonational cues. Although common in human speech, there is a lack of clear evidence for this ability in other species. Here, we examined a likely candidate, the Brown-headed Cowbird (Molothrus ater), which is a vocal-learning songbird species that develops a repertoire of structurally distinct song types. Most of this species’ songs are directed towards conspecific males and females less than a meter away, making it unusually easy to determine the apparent target of songs, unlike the broadcast songs done by most songbirds. Songs directed to other males have clear aggressive/threatening intent, while those to females involve courtship/sexual intent. Extensive prior work shows that male cowbirds perform the visual display that accompanies singing differently in these two social settings and also modulate the intonation of song types differently. Because of these display and tonal modulations, constancy of song type usage across male- vs female-directed singing would provide evidence of vocal functional flexibility. Herein, we examined 4,828 songs in three captive flocks containing twenty-four males and thirty females during the breeding season. Males did not use their song types randomly and had strongly favored songs and less commonly used ones. Importantly, favored song types and less commonly used ones were the same whether directing courtship song to a female, aggressive song to another male or singing nonsocially with no receiver nearby. Results were consistent within and across the three flocks, providing strong evidence of vocal functional flexibility. These findings indicate that some species may evolve the ability to modulate and exaggerate visual display components and prosody more than vocal presentation per se because a learned phonological system in this and possibly other species is constrained by its vital role as an indicator trait.

Pupillometry reveals effects of pitch manipulation within and across words on listening effort and short-term memory.

For individuals with hearing loss, even successful speech communication comes at a cost. Cochlear implants transmit degraded information, specifically for voice pitch, which demands extra and sustained listening effort. The current study hypothesized that abnormal pitch patterns contribute to the additional listening effort, even in non-tonal language native speaking normally hearing listeners. We manipulated the fundamental frequency (F0)within and across words, while participants listen and repeat (simple intelligibility task), or listen, repeat, and later recall (concurrent encoding task) the words. In both experiments, the F0 manipulations resulted in small changes in intelligibility but no difference in free recall or subjective effort ratings. Pupillary metrics were yet sensitive to these manipulations: pupil dilations were larger when words were monotonized (flat contour) or inverted (the natural contour flipped upside-down), and larger when successive words were organized into a melodic pattern. The most likely interpretation is that the natural or expected F0 contour of a word contributes to its identity and facilitate its matching and retrieval from the phonological representation stored in long-term memory. Consequently, degrading words' F0 contour can result in extra listening effort. Our results call for solutions to improve pitch saliency and naturalness in future development of cochlear implants' signal processing strategies, even for non-tonal languages.

Subthalamic nucleus neurons encode syllable sequence and phonetic characteristics during speech.

Speech is a complex behavior that can be used to study unique contributions of the basal ganglia to motor control in the human brain. Computational models suggest that the basal ganglia encode either the phonetic content or the sequence of speech elements. To explore this question, we investigated the relationship between phoneme and sequence features of a spoken syllable triplet and the firing rate of subthalamic nucleus (STN) neurons recorded during the implantation of deep brain stimulation (DBS) electrodes in individuals with Parkinson's disease. Patients repeated aloud a random sequence of three consonant-vowel (CV) syllables in response to audio cues. Single-unit extracellular potentials were sampled from the sensorimotor STN; a total of 227 unit recordings were obtained from the left STN of 25 subjects (4 females). Of these, 113 (50%) units showed significant task-related increased firing and 53 (23%) showed decreased firing (t test relative to inter-trial period baseline, P < 0.05). Linear regression analysis revealed that both populations of STN neurons encode phoneme and sequence features of produced speech. Maximal phoneme encoding occurred at the time of phoneme production, suggesting efference copy- or sensory-related processing, rather than speech motor planning (-50 ms and +175 ms relative to CV transition for consonant and vowel encoding, respectively). These findings demonstrate that involvement of the basal ganglia in speaking includes separate single unit representations of speech sequencing and phoneme selection in the STN.NEW & NOTEWORTHY Speech is a unique human behavior that requires dynamic execution of precisely timed and coordinated movements, resulting in intelligible vocalizations. Here, we demonstrate that activity of individual neurons in the subthalamic nucleus (STN) of the basal ganglia encode syllable sequence order and phoneme identity during a speech production task. These findings advance our understanding of neural substrates of human speech and shed light on potential involvement of the STN in complex human behaviors.

Consonant lengthening marks the beginning of words across a diverse sample of languages.

Speech consists of a continuous stream of acoustic signals, yet humans can segment words and other constituents from each other with astonishing precision. The acoustic properties that support this process are not well understood and remain understudied for the vast majority of the world's languages, in particular regarding their potential variation. Here we report cross-linguistic evidence for the lengthening of word-initial consonants across a typologically diverse sample of 51 languages. Using Bayesian multilevel regression, we find that on average, word-initial consonants are about 13 ms longer than word-medial consonants. The cross-linguistic distribution of the effect indicates that despite individual differences in the phonology of the sampled languages, the lengthening of word-initial consonants is a widespread strategy to mark the onset of words in the continuous acoustic signal of human speech. These findings may be crucial for a better understanding of the incremental processing of speech and speech segmentation.

Objective validation of alternative speech test sources for person-to-person speech intelligibility assessments

A sound source that mimics the acoustics characteristics of a human talker is required in objective assessments of speech intelligibility in person-to-person speech communications (PP) scenarios. The few special speech test sources available that meet the strict specifications of the relevant standards are costly and can be inaccessible to practitioners. This can prevent investigations or can lead to non-special and more affordable loudspeakers to be used as alternative sources without knowledge of their suitability. This study evaluates the validity of non-special loudspeakers in PP assessments and supplements a previous preliminary examination by consolidating and expanding early findings. Speech Transmission Index Public Address (STIPA) assessments were conducted employing three representative non-special loudspeakers and one standardized reference speech test source under laboratory conditions. Absolute errors of STIPA measurements were analysed and evaluated against two just perceivable difference (JND) threshold levels. The mean absolute errors obtained for all non-special loudspeakers for almost all scenarios were within one JND of any of the two JND levels. The striking and consistent low level of error found validated the proposition that non-special and affordable loudspeakers may be used as suitable speech sources in pilot or survey-grade speech intelligibility assessments in place of a special standardized speech source when that source is not available, or in full investigations when the relevant standard to adhere to allows the use of those alternative speech sources.

IMPRS 2024: Interdisciplinary Approaches to the Foundations of Human Speech

The International Max Planck Research School (IMPRS) biennial conference on psycholinguistics focused on the psychological, social, and biological foundations of human speech. The conference took an interdisciplinary approach, drawing on data from cognitive research, neuroscience, computer science, medicine, genetics, anthropology, and evolutionary theory. This article provides an overview of the keynote speeches and the most significant posters, presenting the findings of scholars from around the world.

An instantaneous voice synthesis neuroprosthesis.

Brain computer interfaces (BCIs) have the potential to restore communication to people who have lost the ability to speak due to neurological disease or injury. BCIs have been used to translate the neural correlates of attempted speech into text1-3. However, text communication fails to capture the nuances of human speech such as prosody, intonation and immediately hearing one's own voice. Here, we demonstrate a "brain-to-voice" neuroprosthesis that instantaneously synthesizes voice with closed-loop audio feedback by decoding neural activity from 256 microelectrodes implanted into the ventral precentral gyrus of a man with amyotrophic lateral sclerosis and severe dysarthria. We overcame the challenge of lacking ground-truth speech for training the neural decoder and were able to accurately synthesize his voice. Along with phonemic content, we were also able to decode paralinguistic features from intracortical activity, enabling the participant to modulate his BCI-synthesized voice in real-time to change intonation, emphasize words, and sing short melodies. These results demonstrate the feasibility of enabling people with paralysis to speak intelligibly and expressively through a BCI.

Development and validation of MyCommunication—Adults, a self‐report communicative participation measure

AbstractBackgroundPeople with communication problems experience challenges in participation. Optimizing communicative participation for this population is an important outcome of speech and language therapy. Participation experiences are best assessed from the patient's perspective, using a patient‐reported outcome measure (PROM). The Communicative Participation Item Bank (CPIB) has been developed to identify perceived problems in communicative participation. However, previous research has shown that the item bank does not cover all domains and concepts of communicative participation, contains general communication items, and is not suitable for all people with communication problems.AimsTo develop a comprehensive PROM aimed at measuring communicative participation for all adults with communication problems and test its content validity.Methods &amp; ProceduresAn initial pool of 242 items was based on three sources: relevant content from an earlier literature review and concept elicitation study, and the translation of the items of the CPIB. This item pool was pilot‐tested for comprehensibility and comprehensiveness using cognitive debriefing interviews in adults with different communication problems (speech, language, voice, hearing and cognitive communication disorders). This resulted in a second version of the item bank. The content validity of this version was tested in a group of professionals. The last (third) version of 133 items was tested for content validity in a second, new group of adults with various communication problems.Outcomes &amp; ResultsThe initial pool of 242 items was developed and pilot‐tested in 27 adults with different communication problems. After modifications, 161 items remained, which were tested in a content validity study with 25 people with different communication problems and five professionals (in the field of speech and language therapy and speech and language research). The professionals considered 91.9% of the item bank relevant and comprehensible, and comprehensive by adding two items. The item bank was then considered relevant, comprehensible and comprehensive by the group of adults with communication problems. A total of 133 items remained in the item bank, related to the International Classification of Functioning, Disability and Health (ICF) Activities and Participation domains ‘mobility’, ‘self‐care’, ‘domestic life’, ‘interpersonal interactions and relationships’, ‘major life areas’ and ‘community, social and civic life’.Conclusions &amp; ImplicationsMyCommunication—Adults is an item bank for measuring communicative participation in adults with communication difficulties. The next step is to test the psychometric properties of the item bank, in order to establish a final item bank. The refined description of the construct of communicative participation can already be used for participation‐focused goal‐setting between individuals with communication problems and speech and language therapists.WHAT THIS PAPER ADDSWhat is already known on the subject The CPIB was developed to measure communicative participation in community‐dwelling adults with communication problems. The item bank does not cover all domains and concepts of communicative participation, contains general communication items and not all questions seem to be relevant for specific target groups (e.g., hearing population).What this paper adds to the existing knowledge This study presents a refined description of the construct of communicative participation and the development of a new comprehensive PROM aimed at measuring this construct for all adults with communication difficulties. The development of the PROM is based on a previously conducted literature review and concept elicitation study. This study describes the development process of this new PROM, called MyCommunication‐Adults, and the assessment of its content validity.What are the potential or actual clinical implications of this work? The refined description of the construct of communicative participation can be used for participation‐focused goal‐setting between individuals with communication problems and speech and language therapists.

A Nanoparticle-Based Artificial Ear for Personalized Classification of Emotions in the Human Voice Using Deep Learning.

Artificial intelligence and human-computer interaction advances demand bioinspired sensing modalities capable of comprehending human affective states and speech. However, endowing skin-like interfaces with such intricate perception abilities remains challenging. Here, we have developed a flexible piezoresistive artificial ear (AE) sensor based on gold nanoparticles, which can convert sound signals into electrical signals through changes in resistance. By testing the sensor's performance at both frequency and sound pressure level (SPL), the AE has a frequency response range of 20 Hz to 12 kHz and can sense sound signals from up to 5 m away at a frequency of 1 kHz and an SPL of 126 dB. Furthermore, through deep learning, the device achieves up to 96.9% and 95.0% accuracy in classification and recognition applications for seven emotional and eight urban environmental noises, respectively. Hence, on one hand, our device can monitor the patient's emotional state by their speech, such as sudden yelling and screaming, which can help healthcare workers understand patients' condition in time. On the other hand, the device could also be used for real-time monitoring of noise levels in aircraft, ships, factories, and other high-decibel equipment and environments.

Why can’t artificial language contain the truth? A focus on Foucault’s and Heidegger’s discussions

This article seeks to argue that although AI language has developed to the level where it can answer human questions, AI language cannot yet contain the truth. In the AI era, humans who speak their minds will no longer express their thoughts directly in words and will depend more on AI’s artificial language. However, it is only a question for now whether AI will be able to substitute for human speech and whether such a fact will contribute to the expansion of human thinking and the state of being. Accordingly, in this paper, we try to identify the limitations of artificial intelligence language by precisely clarifying the meaning of human language and discourse. Foucault and Heidegger’s discussion of discourse deals with issues of language, subject, existence, and authentic discourse. We use their discussions as a tool to illuminate our own perspectives. Therefore, we will re-analyze the language produced in the AI environment in relation to the issue of truth.

CHARACTERISTICS OF OFFICIAL COMMUNICATION CULTURE

The article reveals the specific features of Uzbek formal communication etiquette and describes the concept of formal speech etiquette. The Uzbek people’s culture has subjected the most important procedures and established rules of oral formal speech communication to scientific analysis. In Uzbek linguistics, various scientific sources have analyzed and commented on speech etiquette units, usage characteristics of typical examples that have become stereotyped in the Uzbek language, and the issue of their place in official communication. The Uzbek people’s culture proposes these rules as the most crucial procedures and established guidelines for oral formal communication.

Prelingual Deafness and the Manualist/Oralist Controversy in the Dutch Republic

This essay discusses the life and career of the prelingually deaf painter Jan Jansz. de Stomme (1615-1658) in the context of early modern debates on deafness, oral speech, and gestural communication. A son of a Franeker burgomaster, Jan moved to Groningen in 1643, where he became known for his portraits of Frisian aristocracy, got married twice, and lived in wealth in a prestigious neighbourhood. The theologian Samuel Maresius and scholar Anton Deusing described Jan’s devout attendance of services in the Reformed Church, which defended his right to participate in Holy Communion. A similar account was given in a family chronicle written by Jan’s grandnephew, who further specified that Jan joined the church as a communicant member expressing his understanding of the doctrine through gestures. By examining these various sources, I argue that church membership played an important role in bolstering Jan’s social status and undermining the alleged intellectual and mental inferiority of prelingually deaf people. I further show that despite the belief that oral speech was a sign of intelligence necessary to perform functions deemed normative, Jan established a successful career communicating only through gestures.

Dome structure nonwoven-based dual-mode pressure-humidity sensor: Enhancing sensitivity and breathability for human health monitoring

In the field of health monitoring and electronic skin, flexible wearable sensors have attracted considerable research interest. However, preparing a flexible multifunctional sensor that simultaneously possesses a rapid response time, stability, reliability, high breathability, as well as high sensitivity remains a significant challenge. Herein, a flexible pressure-humidity dual-mode sensor based on nonwoven fabrics is developed in this study, using hydroentangled nonwoven fabric with graphene oxide/carbon nanotube composite as the sensing layer and polyester plain nonwoven fabric with carbon nanotube printed interdigitated electrodes as the electrode layer. The sensor exhibits high permeability (649.2 mm/s), high sensitivity (2.72 kPa−1), wide sensing range (0–220 kPa), fast response/recovery time (24.4 /73.3 ms), and low detection limit (2.79 Pa). In addition, the sensor exhibits excellent cyclic stability (15,000 cycles) and can detect both weak body movements (pulses, swallowing) as well as large deformational movements (joint movements). Furthermore, the sensing layer of the sensor responds quickly to different humidity levels, which can be used to monitor humidity in real time, and human breathing and speech can be monitored by placing it inside a mask. This high-performance flexible pressure-humidity dual-mode sensor shows promising potential for applications in health monitoring and respiratory monitoring.

An Integrated All-Natural Conductive Supramolecular Hydrogel Wearable Biosensor with Enhanced Biocompatibility and Antibacterial Properties.

Conductive hydrogels exhibit tremendous potential for wearable bioelectronics, biosensing, and health monitoring applications, yet concurrently enhancing their biocompatibility and antimicrobial properties remains a long-standing challenge. Herein, we report an all-natural conductive supramolecular hydrogel (GT5-DACD2-B) prepared via the Schiff base reaction between the biofriendly dialdehyde cyclodextrin and gelatin. The potent antibacterial agent fusidic acid (FA) is incorporated through host-guest inclusion, enabling 100% inhibition of Staphylococcus aureus proliferation. The biocompatibility of our hydrogel is bolstered with tannic acid (TA) facilitating antibacterial effects through interactions with gelatin, while borax augments conductivity. This supramolecular hydrogel not only exhibits stable conductivity and rapid response characteristics but also functions as a flexible sensor for monitoring human movement, facial expressions, and speech recognition. Innovatively integrating biocompatibility, antimicrobial activity, and conductivity into a single system, our work pioneers a paradigm for developing multifunctional biosensors with integrated antibacterial functionalities, paving the way for advanced wearable bioelectronics with enhanced safety and multifunctionality.

Speech-induced suppression and vocal feedback sensitivity in human cortex

Across the animal kingdom, neural responses in the auditory cortex are suppressed during vocalization, and humans are no exception. A common hypothesis is that suppression increases sensitivity to auditory feedback, enabling the detection of vocalization errors. This hypothesis has been previously confirmed in non-human primates, however a direct link between auditory suppression and sensitivity in human speech monitoring remains elusive. To address this issue, we obtained intracranial electroencephalography (iEEG) recordings from 35 neurosurgical participants during speech production. We first characterized the detailed topography of auditory suppression, which varied across superior temporal gyrus (STG). Next, we performed a delayed auditory feedback (DAF) task to determine whether the suppressed sites were also sensitive to auditory feedback alterations. Indeed, overlapping sites showed enhanced responses to feedback, indicating sensitivity. Importantly, there was a strong correlation between the degree of auditory suppression and feedback sensitivity, suggesting suppression might be a key mechanism that underlies speech monitoring. Further, we found that when participants produced speech with simultaneous auditory feedback, posterior STG was selectively activated if participants were engaged in a DAF paradigm, suggesting that increased attentional load can modulate auditory feedback sensitivity.

Speech-induced suppression and vocal feedback sensitivity in human cortex.

Across the animal kingdom, neural responses in the auditory cortex are suppressed during vocalization, and humans are no exception. A common hypothesis is that suppression increases sensitivity to auditory feedback, enabling the detection of vocalization errors. This hypothesis has been previously confirmed in non-human primates, however a direct link between auditory suppression and sensitivity in human speech monitoring remains elusive. To address this issue, we obtained intracranial electroencephalography (iEEG) recordings from 35 neurosurgical participants during speech production. We first characterized the detailed topography of auditory suppression, which varied across superior temporal gyrus (STG). Next, we performed a delayed auditory feedback (DAF) task to determine whether the suppressed sites were also sensitive to auditory feedback alterations. Indeed, overlapping sites showed enhanced responses to feedback, indicating sensitivity. Importantly, there was a strong correlation between the degree of auditory suppression and feedback sensitivity, suggesting suppression might be a key mechanism that underlies speech monitoring. Further, we found that when participants produced speech with simultaneous auditory feedback, posterior STG was selectively activated if participants were engaged in a DAF paradigm, suggesting that increased attentional load can modulate auditory feedback sensitivity.

Speaker-Attributed Training for Multi-Speaker Speech Recognition Using Multi-Stage Encoders and Attention-Weighted Speaker Embedding

Automatic speech recognition (ASR) aims at understanding naturally spoken human speech to be used as text inputs to machines. In multi-speaker environments, where multiple speakers are talking simultaneously with a large amount of overlap, a significant performance degradation may occur with conventional ASR systems if they are trained by recordings of single talkers. This paper proposes a multi-speaker ASR method that incorporates speaker embedding information as an additional input. The embedding information for each of the speakers in the training set was extracted as numeric vectors, and all of the embedding vectors were stacked to construct a total speaker profile matrix. The speaker profile matrix from the training dataset enables finding embedding vectors that are close to the speakers of the input recordings in the test conditions, and it helps to recognize the individual speakers’ voices mixed in the input. Furthermore, the proposed method efficiently reuses the decoder from the existing speaker-independent ASR model, eliminating the need for retraining the entire system. Various speaker embedding methods such as i-vector, d-vector, and x-vector were adopted, and the experimental results show 0.33% and 0.95% absolute (3.9% and 11.5% relative) improvements without and with the speaker profile in the word error rate (WER).

Фонетические особенности северокорейского диалекта Пхёнандо

The dialect is an important aspect of the linguistic and cultural diversity of Korea. Despite the presence of two countries on the Korean peninsula, the Korean language has many dialects – varieties of the language used as a means of speech communication, limited to a certain territory. While Seoul dialect is one of the most popular dialects in South Korea, the Pyongyang dialect prevails in North Korea. Studying the dialects of the Korean language provides an opportunity to learn the history, cultural and linguistic features of the Korean peninsula countries. The Pyongyang dialect, as other dialects, has its own lexical, phonetic and grammatical features. In this regard, this study aims to determine the characteristics of the North Korean Pyongyang dialect in comparison with the Seoul dialect.

Fusion of PCA and ICA in Statistical Subset Analysis for Speech Emotion Recognition.

Speech emotion recognition is key to many fields, including human-computer interaction, healthcare, and intelligent assistance. While acoustic features extracted from human speech are essential for this task, not all of them contribute to emotion recognition effectively. Thus, reduced numbers of features are required within successful emotion recognition models. This work aimed to investigate whether splitting the features into two subsets based on their distribution and then applying commonly used feature reduction methods would impact accuracy. Filter reduction was employed using the Kruskal-Wallis test, followed by principal component analysis (PCA) and independent component analysis (ICA). A set of features was investigated to determine whether the indiscriminate use of parametric feature reduction techniques affects the accuracy of emotion recognition. For this investigation, data from three databases-Berlin EmoDB, SAVEE, and RAVDES-were organized into subsets according to their distribution in applying both PCA and ICA. The results showed a reduction from 6373 features to 170 for the Berlin EmoDB database with an accuracy of 84.3%; a final size of 130 features for SAVEE, with a corresponding accuracy of 75.4%; and 150 features for RAVDESS, with an accuracy of 59.9%.