Vocal Pitch Research Articles

Acoustic features of vocalizations in typically developing and autistic infants in the first year

We describe acoustic patterns across the five most prominent vocal types in typically developing infants (TD) and compare them with patterns in infants who develop autism (ASD) or a developmental disability (DD) not related to autism. Infant-directed speech (IDS) is a potentially important influence on such vocal acoustic patterns. Both acoustic patterns and effects of IDS are important for understanding the earliest origins of communication disorders. To compare duration, pitch and loudness of infant vocalizations for three groups of infants (TD, ASD, DD) in circumstances with high or low amounts of IDS. Two five-minute segments from each of 1259 all-day recordings across the first year were coded and acoustically analyzed for three groups of infants (130 TD, 44 ASD, 21 DD). Duration, mean fundamental frequency, and root mean square amplitude were determined for >162,000 infant utterances. Cries were longest and loudest, and vowel-like sounds were shortest of the five vocal types in all groups. TD infants showed significant alterations in vocal acoustics during periods of high IDS. Strong similarities in acoustic patterns occurred across the three groups, but only the TD group showed significant acoustic effects of IDS.

Effects of pitch range on singing accuracy training

Recent theory and data suggest that inaccurate ( poor-pitch or poor) singing may be based on impoverished sensorimotor mapping between auditory perceptual representations and motor plans. One of the symptoms of poor singing is a restriction of vocal pitch range during pitch matching tasks that is not reducible to physical vocal limitations. We here test the hypothesis that remediation of poor singing may be best achieved by incorporating a wide pitch range during training. Two treatment groups underwent singing training using a procedure found to be effective in recent research. One group matched pitches from a wider range of one octave, whereas the other matched pitches from a narrower range of seven semitones (a perfect fifth). A third group completed visual imagery tasks for the same period of time and served as a control group. All three groups completed the Seattle Singing Accuracy Protocol (SSAP) before and after training, with all phases completed in a single session. The only significant improvement was found in the wide-range training group, for matching of single pitches from the SSAP, rather than four-note melodies. Results thus offer partial support for the hypothesis and suggest that successful remediation of singing accuracy may benefit from adopting a wide range of pitches.

Unraveling the Associations Between Voice Pitch and Major Depressive Disorder: A Multisite Genetic Study.

Major depressive disorder (MDD) often goes undiagnosed due to the absence of clear biomarkers. We sought to identify voice biomarkers for MDD and separate biomarkers indicative of MDD predisposition from biomarkers reflecting current depressive symptoms. Using a two-stage meta-analytic design to remove confounds, we tested the association between features representing vocal pitch and MDD in a multisite case-control cohort study of Chinese women with recurrent depression. Sixteen features were replicated in an independent cohort, with absolute association coefficients (beta values) from the combined analysis ranging from 0.24 to 1.07, indicating moderate to large effects. The statistical significance of these associations remained robust, with P-values ranging from 7.2 × 10-6 to 6.8 × 10-58. Eleven features were significantly associated with current depressive symptoms. Using genotype data, we found that this association was driven in part by a genetic correlation with MDD. Significant voice features, reflecting a slower pitch change and a lower pitch, achieved an AUC-ROC of 0.90 (sensitivity of 0.85 and specificity of 0.81) in MDD classification. Our results return vocal features to a more central position in clinical and research work on MDD.

The oleaginous voice: Auto-Tune, linear predictive coding, and the security-petroleum complex

ABSTRACT In the twentieth century, exploration geophysics and digital vocal processing each underwent key technical transformations based on formally similar signal processing techniques derived from prior work in statistics and information theory. Engineers at Texas Instruments (TI) and the Massachusetts Institute of Technology (MIT) developed deconvolution filtering as a way to model geological strata from seismograph recordings in order to facilitate oil exploration. Meanwhile, engineers at Bell Laboratories and Nippon Telegraph and Telephone (NTT) used similar techniques to digitally encode and transmit speech signals more efficiently – a method known as linear predictive coding (LPC). These cognate approaches to modeling geophysical and vocal signals provided a practical basis for subsequent forays by oil industry figures into the world of digital audio. Tracing the histories of four technologies – LPC secure voice transmission terminals, the TI Speak & Spell educational toy, automatic speech recognition, and the vocal pitch correction software Auto-Tune – I analyze the role of security interests in facilitating spillovers between technologies of oil and the voice. I argue that, by approaching both geophysical and vocal signals as matters of national security, the United States’ defense and intelligence services furnished the bulk of socio-economic connective tissue between petroleum geophysics and vocal processing research.

How does the pelvic floor respond to modulations in trunk pressure induced by a variety of voicing tasks? A cross-sectional, observational study.

The pelvic floor responds to changes in trunk pressure, elevating during low-pressure exhale and descending during high-pressure exhale. Voicing occurs during exhalation, spanning low-to-high trunk-pressure, yet it is unknown how voicing affects the pelvic floor. The aim of this study was to quantify pelvic floor response to voicing and identify if there are differences for women with stress urinary incontinence. We hypothesized that shouting would cause pelvic floor descent, with greater magnitude for incontinent women. Sixty women (38 incontinent, 22 continent) performed four voicing tasks (counting to "4" in speaking/shouting/low-pitch/high-pitch voice) while transperineal ultrasound measured changes in pelvic floor morphology. ANOVA compared variance of responses to voicing and t-tests compared groups. Bladder neck height shortened, levator plate length increased and levator plate angle decreased more during shouting compared to speaking; consistent with pelvic floor straining. There were no differences for high versus low pitch-voicing and small group differences based on continence status. Voicing causes pelvic floor muscles to strain, with greater strain during shouting. Changing vocal pitch does not affect pelvic floor morphology and incontinent women had slight differences from continent women. Voicing may be a safe way to lengthen the pelvic floor without provoking incontinence.

How fund manager speaks values: evidence from China

ABSTRACT Confidence, especially in the form of overconfidence, is a crucial psychological factor that influences fund managers’ investment behaviours. However, how to reliably quantify it remains an open question. The self-marketing endeavours via video-sharing platforms of mutual fund companies in China have unexpectedly provided persuasive avenue to gauge confidence through video appearances. This paper proposes a novel data integration framework, combining with multimodal content understanding techniques, and offers calculations of nonverbal personal traits from videos circulated in social media. In particular, we focus on managers’ vocal cues and construct a confidence measure from vocal pitch. Our findings reveal a substantial relation between vocal confidence and fund managers’ investment decisions. Our work also underscores the potential of multimodal data from social media in disclosing nuanced findings in the interdisciplinary studies of finance and psychology.

Factors Associated With Improvement Following In-office Steroid Injections for Vocal Fold Scar.

This study aims to evaluate the clinical outcomes of patients receiving in-office vocal fold steroid injections (VFSI), highlighting relatively new measures around vocal pitch. Patients with a diagnosis of vocal fold scar who received in-office VFSI from 2013 to 2024 were evaluated. Pre- and post-steroid Voice Handicap Index (VHI-10) scores, stroboscopic vibratory parameters, acoustic measures of cepstral peak prominence (CPP), and fundamental frequency coefficient of variation (F0CoV) during sustained phonation were analyzed using Wilcoxon signed-rank tests and McNemar's tests. Twenty-two patients had follow-up data 1-3 months after steroid injection. The median decrease in VHI-10 after one injection was 4 points (p = 0.02). We found no difference in CPP and F0CoV measures at follow-up. Forty-five percent of patients improved in mucosal wave and amplitude of at least one vocal fold. Earlier presentation from vocal injury was associated with improvement in mucosal wave and amplitude of the left vocal fold (p = 0.03). We found no difference in sex, tobacco smoking history, singing status, secondary diagnosis, and baseline VHI-10 score between patients who improved in vibratory parameters and those who did not. This single-center study is one of the largest exploring patient outcomes following in-office VFSI. Though patients reported modest improvement in voice use after VFSI, this may not be as impactful as previously believed. Improvement in videostroboscopy is expected in about half of the patients, with recency from vocal injury a likely predictor of success. These partially negative results provide insight into counseling patients regarding benefits from in-office VFSI. 4 Laryngoscope, 2024.

Mutual eye gaze and vocal pitch in relation to social anxiety and depression: A virtual interaction task

BackgroundIndividuals with high social interaction anxiety (SIA) and depression often behave submissively in social settings. Few studies have simultaneously examined the associations between objectively assessed submissive behaviors and SIA or depression, despite their high comorbidity and unknown mechanisms regarding submissiveness. MethodsA sample of 45 young adults self-reported trait SIA and depression, state positive/negative affect (PA/NA) before and after a virtual social interaction. Participants engaged in a four-minute conversation with a confederate who was trained to behave neutrally. Mutual eye gaze, via eye-tracking, and vocal pitch were assessed throughout the interaction. ResultsDepression and SIA were positively correlated with NA, poorer self-rated performance, and vocal pitch. Highly socially anxious women engaged in less mutual eye gaze than highly socially anxious men. Also, vocal pitch was inversely associated with mutual eye gaze and positively related to NA and (nonsignificantly) to self-ratings of poor performance. Finally, our data partially replicated past research on the use of vocal pitch during social stress to detect social anxiety disorder. LimitationsThe current sample is relatively homogenous in educational attainment, age, and race. All research confederates were women. Future research should examine whether these archival data replicate with the latest telecommunication technologies. ConclusionOur findings highlight nuanced relationships among SIA, depression, emotions, self-perceptions, and biobehavioral indicators of submissive behavior—in response to an ambiguously negative/positive social interaction. Sex/gender may interact with these effects, emphasizing considerations for research method designs.

"Alexa, Cycle The Blood Pressure": A Voice Control Interface Method for Anesthesia Monitoring.

Anesthesia monitors and devices are usually controlled with some combination of dials, keypads, a keyboard, or a touch screen. Thus, anesthesiologists can operate their monitors only when they are physically close to them, and not otherwise task-loaded with sterile procedures such as line or block placement. Voice recognition technology has become commonplace and may offer advantages in anesthesia practice such as reducing surface contamination rates and allowing anesthesiologists to effect changes in monitoring and therapy when they would otherwise presently be unable to do so. We hypothesized that this technology is practicable and that anesthesiologists would consider it useful. A novel voice-driven prototype controller was designed for the GE Solar 8000M anesthesia patient monitor. The apparatus was implemented using a Raspberry Pi 4 single-board computer, an external conference audio device, a Google Cloud Speech-to-Text platform, and a modified Solar controller to effect commands. Fifty anesthesia providers tested the prototype. Evaluations and surveys were completed in a nonclinical environment to avoid any ethical or safety concerns regarding the use of the device in direct patient care. All anesthesiologists sampled were fluent English speakers; many with inflections from their first language or national origin, reflecting diversity in the population of practicing anesthesiologists. The prototype was uniformly well-received by anesthesiologists. Ease-of-use, usefulness, and effectiveness were assessed on a Likert scale with means of 9.96, 7.22, and 8.48 of 10, respectively. No population cofactors were associated with these results. Advancing level of training (eg, nonattending versus attending) was not correlated with any preference. Accent of country or region was not correlated with any preference. Vocal pitch register did not correlate with any preference. Statistical analyses were performed with analysis of variance and the unpaired t -test. The use of voice recognition to control operating room monitors was well-received anesthesia providers. Additional commands are easily implemented on the prototype controller. No adverse relationship was found between acceptability and level of anesthesia experience, pitch of voice, or presence of accent. Voice recognition is a promising method of controlling anesthesia monitors and devices that could potentially increase usability and situational awareness in circumstances where the anesthesiologist is otherwise out-of-position or task-loaded.

The breath shape controls intonation of mouse vocalizations.

Intonation in speech is the control of vocal pitch to layer expressive meaning to communication, like increasing pitch to indicate a question. Also, stereotyped patterns of pitch are used to create distinct sounds with different denotations, like in tonal languages and, perhaps, the 10 sounds in the murine lexicon. A basic tone is created by exhalation through a constricted laryngeal voice box, and it is thought that more complex utterances are produced solely by dynamic changes in laryngeal tension. But perhaps, the shifting pitch also results from altering the swiftness of exhalation. Consistent with the latter model, we describe that intonation in most vocalization types follows deviations in exhalation that appear to be generated by the re-activation of the cardinal breathing muscle for inspiration. We also show that the brainstem vocalization central pattern generator, the iRO, can create this breath pattern. Consequently, ectopic activation of the iRO not only induces phonation, but also the pitch patterns that compose most of the vocalizations in the murine lexicon. These results reveal a novel brainstem mechanism for intonation.

Genetic association analysis of human median voice pitch identifies a common locus for tonal and non-tonal languages

The genetic influence on human vocal pitch in tonal and non-tonal languages remains largely unknown. In tonal languages, such as Mandarin Chinese, pitch changes differentiate word meanings, whereas in non-tonal languages, such as Icelandic, pitch is used to convey intonation. We addressed this question by searching for genetic associations with interindividual variation in median pitch in a Chinese major depression case-control cohort and compared our results with a genome-wide association study from Iceland. The same genetic variant, rs11046212-T in an intron of the ABCC9 gene, was one of the most strongly associated loci with median pitch in both samples. Our meta-analysis revealed four genome-wide significant hits, including two novel associations. The discovery of genetic variants influencing vocal pitch across both tonal and non-tonal languages suggests the possibility of a common genetic contribution to the human vocal system shared in two distinct populations with languages that differ in tonality (Icelandic and Mandarin).

Effectiveness of a Voice Training Program for Religious Officials in Turkey.

This study examines the effectiveness of a voice training program designed for Islamic religious officials, who are occupational voice users with a significant vocal load. The participants included 34 healthy religious officials whose acoustic measures were within normal voice ranges for healthy adults (jitter < 1%; shimmer < 3%) and reported no voice complaints. Participants were randomly divided into two groups (experimental, n = 17; control, n = 17). The two-stage voice training program consisted of 32 sessions over 8 weeks with informative and voice exercise stages. Objective and subjective voice measurements were performed at the beginning and end of the research. Objective measurements included fundamental frequency, percentage of vocal pitch perturbation (jitter), percentage of vocal intensity perturbation (shimmer), and harmonics-to-noise ratio. Subjective voice measurements included the Singing Voice Handicap Index, Vocal Fatigue Index (VFI), and Voice-Related Quality of Life (V-RQoL) scores. All initial measurements other than VFI scores were within acceptable limits for both groups. There were no significant differences between the groups initially (p > 0.05) and no significant changes in the control group in the second evaluation (p > 0.05). However, there was significant improvement in the experimental group after the training program in all measures, including VFI scores (p < 0.05). This study shows the positive results of a voice training program. Voice training should be integrated into the formal education of occupational voice users or in-service training programs of relevant institutions.

In-depth analysis of pre- and postoperative functional outcome parameters in patients receiving laryngotracheal surgery.

Surgical treatment for airway stenosis necessitates personalized techniques based on the stenosis location and length, leading to favourable surgical outcomes. However, there is limited literature on functional outcomes following laryngotracheal surgery with an adequate number of patients. We conducted a retrospective analysis of patients who underwent laryngotracheal surgery at the Department of Thoracic Surgery, Medical University of Vienna, from January 2017 to June 2021. The study included standardized functional assessments before and after surgery, encompassing spirometry, voice measurements, swallowing evaluation and subjective patient perception. The study comprised 45 patients with an average age of 51.9 ± 15.9 years, of whom 89% were female, with idiopathic being the most common aetiology (67%). Procedures included standard cricotracheal resection in 11%, cricotracheal resection with dorsal mucosal flap in 49%, cricotracheal resection with dorsal mucosal flap and lateral cricoplasty in 24% and single-stage laryngotracheal reconstruction in 16%. There were no in-hospital mortalities or restenosis cases during the mean follow-up period of 20.8 ± 13.2 months. Swallowing function remained intact in all patients. Voice evaluations showed a decrease in fundamental vocal pitch [203 (81-290) Hz vs 150 (73-364) Hz, P < 0.001] and dynamic voice range (23.5 ± 5.8 semitones vs 17.8 ± 6.7 semitones, P < 0.001). However, no differences in voice volume were observed (60.0 ± 4.1 dB vs 60.2 ± 4.8 dB, P = 0.788). The overall predicted voice profile changed from R0B0H0 to R1B0H1. Laryngotracheal surgery proves effective in fully restoring breathing capacity while preserving vocal function. Even in cases of high-grade and complex airway stenosis necessitating laryngotracheal reconstruction, favourable functional outcomes can be achieved.

The Multimodal Trust Effects of Face, Voice, and Sentence Content.

Trust is an aspect critical to human social interaction and research has identified many cues that help in the assimilation of this social trait. Two of these cues are the pitch of the voice and the width-to-height ratio of the face (fWHR). Additionally, research has indicated that the content of a spoken sentence itself has an effect on trustworthiness; a finding that has not yet been brought into multisensory research. The current research aims to investigate previously developed theories on trust in relation to vocal pitch, fWHR, and sentence content in a multimodal setting. Twenty-six female participants were asked to judge the trustworthiness of a voice speaking a neutral or romantic sentence while seeing a face. The average pitch of the voice and the fWHR were varied systematically. Results indicate that the content of the spoken message was an important predictor of trustworthiness extending into multimodality. Further, the mean pitch of the voice and fWHR of the face appeared to be useful indicators in a multimodal setting. These effects interacted with one another across modalities. The data demonstrate that trust in the voice is shaped by task-irrelevant visual stimuli. Future research is encouraged to clarify whether these findings remain consistent across genders, age groups, and languages.

Speech comprehension in the context of speaker changes: The importance of voice-feature continuity at the cocktail party

In this talk, I will show how different groups of listeners use voice acoustics to enhance speech comprehension under adverse listening conditions, specifically when the auditory scene comprises a multitude of sounds heard at once. These “cocktail-party”-like situations pose a difficult conceptual problem: To comprehend target speech, listeners need to attend to the target voice while at the same time ignoring other irrelevant sounds. The cocktail-party problem is made considerably easier when all target sounds are spoken by the same talker. Previous work suggests that such benefits from voice continuity can be—in large part—attributed to two prominent voice features: Glottal-pulse rate (GPR) and vocal-tract length (VTL). GPR determines the fundamental frequency of a speech sound and is perceived as vocal pitch; VTL determines the spectral envelope of a speech sound and is perceived as an aspect of vocal timbre. Apart from being important voice identity cues, GPR and VTL have been shown to play a crucial role in cocktail-party listening. Here, I will present data from a series of experiments highlighting the importance of voice-feature continuity for speech comprehension at the cocktail party.

Age Estimation and Gender Attribution in Typically Developing Children and Children With Dysarthria.

The purposes of this study were (a) to investigate adult listeners' perceptions of age and gender in typically developing children and children with dysarthria and (b) to identify predictors of their estimates among auditory-perceptual parameters and an acoustic measure of vocal pitch (F0). We aimed to evaluate the influence of dysarthria on the listeners' impressions of age and gender against the background of typical developmental processes. In a listening experiment, adult listeners completed age and gender estimates of 144 typically developing children (3-9 years of age) and 25 children with dysarthria (5-9 years of age). The Bogenhausen Dysarthria Scales for Childhood Dysarthria (BoDyS-KiD) were applied to record speech samples and to complete auditory-perceptual judgments covering all speech subsystems. Furthermore, each child's mean F0 was determined from samples of four BoDyS-KiD sentences. Age estimates for the typically developing children showed a regression to the mean, whereas children with dysarthria were systematically underestimated in their age. The estimates of all children were predicted by developmental speech features; for the children with dysarthria, specific dysarthria symptoms had an additional effect. We found a significantly higher accuracy of gender attribution in the typically developing children than in the children with dysarthria. The prediction accuracy of the listeners' gender attribution in the preadolescent children by the included speech characteristics was limited. Children with dysarthria are more difficult to estimate for their age and gender than their typically developing peers. Dysarthria thus alters the auditory-perceptual impression of indexical speech features in children, which must be considered another facet of the communication disorder associated with childhood dysarthria.

Striking a (vocal) chord: musical instruments as mnemonic devices when teaching the functional anatomy of the larynx.

Mnemonic devices are memory aids that make it easier to recall information and are widely used by students studying anatomy and physiology. Simple musical instruments and toys can serve as mnemonic devices for students learning the functional anatomy of the larynx: balloons can help learners understand and recall how sound is produced; tuning pegs can help learners understand how tension affects vocal pitch; fingers on a fretboard can help learners understand how pitch is further modulated; and a common coach's whistle can demonstrate how vocal volume is controlled. Using instruments and toys engages adult learners and helps them connect complex laryngeal anatomy with previous experiences.NEW & NOTEWORTHY Musical instruments and toys can be used as mnemonic devices to help students recall and understand the functional anatomy of voice production. The mnemonics can be implemented in a variety of classrooms and are flexible and engaging.

Is Hey Jude in the right key? Cognitive components of absolute pitch memory.

Most individuals, regardless of formal musical training, have long-term absolute pitch memory (APM) for familiar musical recordings, though with varying levels of accuracy. The present study followed up on recent evidence suggesting an association between singing accuracy and APM (Halpern & Pfordresher, 2022, Attention, Perception, & Psychophysics, 84(1), 260-269), as well as tonal short-term memory (STM) and APM (Van Hedger et al., 2018,Quarterly Journal of Experimental Psychology, 71(4), 879-891). Participants from three research sites (n = 108) completed a battery of tasks including APM, tonal STM, singing accuracy, and self-reported auditory imagery. Both tonal STM and singing accuracy predicted APM, replicating prior results. Tonal STM also predicted singing accuracy, music training, and auditory imagery. Further tests suggested that the association between APM and singing accuracy was fully mediated by tonal STM. This pattern comports well with models of vocal pitch matching that include STM for pitch as a mechanism for sensorimotor translation.

The secret of voice: How acoustic characteristics affect video creators' performance on Bilibili

The importance of voice has been well acknowledged in sensory decision-making. Yet, past literature on video creators' performance did not shed much light on the impact of video creators' acoustic characteristics. Building on signaling theory of portfolios, we examine how the acoustic characteristics of a video creator and the signals of video quantity affect the number of likes a video creator receives and the change in the number of the creator's followers. Using a longitudinal dataset obtained from Bilibili through automated speech recognition analytics and text analysis approach, econometrics models are employed to test the research model. Findings indicate that loudness variability of a video creator significantly increases the number of likes the creator receives, and exerts a positive effect on the change in the number of the creator's followers. In contrast, vocal pitch has a significant positive impact on the number of likes but a significant negative impact on the change in the number of followers. Results further suggest that a video creator's performance varies according to the signals of video quantity, i.e., the number of weekly published videos and the average length of videos. Our results could offer theoretical contributions and practical insights for video creators to enhance their performance by adjusting the acoustic characteristics and the signals of video quantity wisely.

An interpretable model based on graph learning for diagnosis of Parkinson’s disease with voice-related EEG

Parkinson’s disease (PD) exhibits significant clinical heterogeneity, presenting challenges in the identification of reliable electroencephalogram (EEG) biomarkers. Machine learning techniques have been integrated with resting-state EEG for PD diagnosis, but their practicality is constrained by the interpretable features and the stochastic nature of resting-state EEG. The present study proposes a novel and interpretable deep learning model, graph signal processing-graph convolutional networks (GSP-GCNs), using event-related EEG data obtained from a specific task involving vocal pitch regulation for PD diagnosis. By incorporating both local and global information from single-hop and multi-hop networks, our proposed GSP-GCNs models achieved an averaged classification accuracy of 90.2%, exhibiting a significant improvement of 9.5% over other deep learning models. Moreover, the interpretability analysis revealed discriminative distributions of large-scale EEG networks and topographic map of microstate MS5 learned by our models, primarily located in the left ventral premotor cortex, superior temporal gyrus, and Broca’s area that are implicated in PD-related speech disorders, reflecting our GSP-GCN models’ ability to provide interpretable insights identifying distinctive EEG biomarkers from large-scale networks. These findings demonstrate the potential of interpretable deep learning models coupled with voice-related EEG signals for distinguishing PD patients from healthy controls with accuracy and elucidating the underlying neurobiological mechanisms.