F0 Standard Deviation Research Articles

Interpretability analysis of deep models for COVID-19 detection

During the coronavirus disease 2019 (COVID-19) pandemic, various research disciplines collaborated to address the impacts of severe acute respiratory syndrome coronavirus-2 infections. This paper presents an interpretability analysis of a convolutional neural network-based model designed for COVID-19 detection using audio data. We explore the input features that play a crucial role in the model’s decision-making process, including spectrograms, fundamental frequency (F0), F0 standard deviation, sex, and age. Subsequently, we examine the model’s decision patterns by generating heat maps to visualize its focus during the decision-making process. Emphasizing an explainable artificial intelligence approach, our findings demonstrate that the examined models can make unbiased decisions even in the presence of noise in training set audios, provided appropriate preprocessing steps are undertaken. Our top-performing model achieves a detection accuracy of 94.44%. Our analysis indicates that the analyzed models prioritize high-energy areas in spectrograms during the decision process, particularly focusing on high-energy regions associated with prosodic domains, while also effectively utilizing F0 for COVID-19 detection.

Voice signals database of ALS patients with different dysarthria severity and healthy controls

This paper describes a new publicly-available database of VOiCe signals acquired in Amyotrophic Lateral Sclerosis (ALS) patients (VOC-ALS) and healthy controls performing different speech tasks. This dataset consists of 1224 voice signals recorded from 153 participants: 51 healthy controls (32 males and 19 females) and 102 ALS patients (65 males and 37 females) with different severity of dysarthria. Each subject’s voice was recorded using a smartphone application (Vox4Health) while performing several vocal tasks, including a sustained phonation of the vowels /a/, /e/, /i/, /o/, /u/ and /pa/, /ta/, /ka/ syllable repetition. Basic derived speech metrics such as harmonics-to-noise ratio, mean and standard deviation of fundamental frequency (F0), jitter and shimmer were calculated. The F0 standard deviation of vowels and syllables showed an excellent ability to identify people with ALS and to discriminate the different severity of dysarthria. These data represent the most comprehensive database of voice signals in ALS and form a solid basis for research on the recognition of voice impairment in ALS patients for use in clinical applications.

A Study on Voice Measures in Patients with Parkinson’s Disease

This research aims to identify acoustic features which can distinguish patients with Parkinson's disease (PD patients) and healthy speakers. Thirty PD patients and 30 healthy speakers were recruited in the experiment, and their speech was collected, including three vowels (/i/, /a/, and /u/) and nine consonants (/p/, /pʰ/, /t/, /tʰ/, /k/, /kʰ/, /l/, /m/, and /n/). Acoustic features like fundamental frequency (F0), Jitter, Shimmer, harmonics-to-noise ratio (HNR), first formant (F1), second formant (F2), third formant (F3), first bandwidth (B1), second bandwidth (B2), third bandwidth (B3), voice onset, voice onset time were analyzed in our experiment. Two-sample independent t test and the nonparametric Mann-Whitney U (MWU) test were carried out alternatively to compare the acoustic measures between the PD patients and healthy speakers. In addition, after figuring out the effective acoustic features for distinguishing PD patients and healthy speakers, we adopted two methods to detect PD patients: (1) Built classifiers based on the effective acoustic featuresand (2) Trained support vector machine classifiers via the effective acoustic features. Significant differences were found between the male PD group and the male health control in vowel /i/ (Jitter and Shimmer) and /a/ (Shimmer and HNR). Among female subjects, significant differences were observed in F0 standard deviation (F0 SD) of /u/ between the two groups. Additionally, significant differences between PD group and health control were also found in the F3 of /i/ and /n/, whereas other acoustic features showed no significant differences between the two groups. The HNR of vowel /a/ performed the best classification accuracy compared with the other six acoustic features above found to distinguish PD patients and healthy speakers. PD can cause changes in the articulation and phonation of PD patients, wherein increases or decreases occur in some acoustic features. Therefore, the use of acoustic features to detect PD is expected to be a low-cost and large-scale diagnostic method.

Markers of schizophrenia at the prosody/pragmatics interface. Evidence from corpora of spontaneous speech interactions.

The speech of individuals with schizophrenia exhibits atypical prosody and pragmatic dysfunctions, producing monotony. The paper presents the outcomes of corpus-based research on the prosodic features of the pathology as they manifest in real-life spontaneous interactions. The research relies on a corpus of schizophrenic speech recorded during psychiatric interviews (CIPPS) compared to a sampling of non-pathological speech derived from the LABLITA corpus of spoken Italian, which has been selected according to comparability requirements. Corpora has been intensively analyzed in the Language into Act Theory (L-AcT) frame, which links prosodic cues and pragmatic values. A cluster of linguistic parameters marked by prosody has been considered: utterance boundaries, information structure, speech disfluency, and prosodic prominence. The speech flow of patients turns out to be organized into small chunks of information that are shorter and scarcely structured, with an atypical proportion of post-nuclear information units (Appendix). It is pervasively scattered with silences, especially with long pauses between utterances and long silences at turn-taking. Fluency is hindered by retracing phenomena that characterize complex information structures. The acoustic parameters that give rise to prosodic prominence (f0 mean, f0 standard deviation, spectral emphasis, and intensity variation) have been measured considering the pragmatic roles of the prosodic units, distinguishing prominences within the illocutionary units (Comment) from those characterizing Topic units. Patients show a flattening of the Comment-prominence, reflecting impairments in performing the illocutionary activity. Reduced values of spectral emphasis and intensity variation also suggest a lack of engagement in communication. Conversely, Topic-prominence shows higher values for f0 standard deviation and spectral emphasis, suggesting effort when defining the domain of relevance of the illocutionary force. When comparing Topic and Comment-prominences of patients, the former consistently exhibit higher values across all parameters. In contrast, the non-pathological group displays the opposite pattern.

Acoustic Characteristics of Mandarin Speech in Male Drug Users

Drug use/addiction has a profound impact on the physical and mental health of individuals. Previous studies have indicated that drug users may experience speech perception disorders, including speech illusion and challenges in recognizing emotional speech. However, the influence of drugs on speech production, as another crucial aspect of speech communication, has not been thoroughly examined. Therefore, the current study aimed to investigate how drugs affect the acoustic characteristics of speech in Chinese male drug users. Speech recordings were collected from a total of 160 male drug users (including 106 heroin users, 23 ketamine users, and 31 methamphetamine users) and 55 male healthy controls with no history of drug use. Acoustic analysis was conducted on the collected speech data from these groups, and classification analysis was performed using five supervised learning algorithms. The results demonstrated that drug users exhibited smaller F0 standard deviation, reduced loudness, cepstral peak prominence, and formant relative energies, as well as higher H1-A3, longer unvoiced segments, and fewer voiced segments per second compared to the control group. The classification analyses yielded good performance in classifying drug users and non-drug users, with an accuracy above 86%. Moreover, the identification of the three groups of drug users achieved an accuracy of approximately 70%. Additionally, the study revealed different effects on speech production among the three types of drugs. The above findings indicate the presence of speech disorders, such as vocal hoarseness, in drug users, thus confirming the assumption that the acoustic characteristics of speech in drug users deviates from the norm. This study not only fills the knowledge gap regarding the effects of drugs on the speech production of Chinese male drug users but also provides a more comprehensive understanding of how drugs impact human behaviors. Furthermore, this research provides theoretical foundations of detoxification and speech rehabilitation for drug users.

Perceptual and acoustic assessment of a child’s speech before and after laryngeal web surgery

The aim of this paper was to point to the importance of early diagnostics and surgery in patients with laryngeal web in order to achieve normal breathing, as well as to stress the need for an interdisciplinary approach to observing the quality of voice and prosodic features at an early age. The subject under consideration was a 6.5-year-old girl who had previously been diagnosed with irregular breathing (R06). An endoscopic exam revealed a laryngeal web between the vocal folds and the fact that the posterior intercartilaginous section of the glottis of the child’s larynx was in order (normal). The child’s speech had been recorded in the acoustic studio, both before and after the vocal-fold surgery (six and twelve months later). Due to severe dysphonia, difficulties with breathing, and frequent noisy breathing (stridor), we recorded only the phonation of the vowel [a], as well as spontaneous speech before the surgery. In addition, there was intense glottic and supraglottic strain before the surgery, which in phonetics corresponds to the term laryngeal and supralaryngeal strain and pathologically creaky whispery phonation (according to VPA protocol). This strain was visible in the area of the chest, neck, and head, as well as audible in the voice quality. Acoustic analysis showed that the average F0 for the vowel [a] was remarkably high (442 Hz), and the pathological values were established using the following measures: local jitter (1.68%), local shimmer (0.7 dB), and the harmonic to noise ratio (17.6 dB). In contrast, six months after the surgery, the pitch for [a] was half the value of the preoperative one (220.5 Hz, p < 0.001), and the local jitter for all vowels (0.30-0.47%) and the harmonic to noise ratio (22.46 dB, p = 0.05) was within the normal range. There was also significant improvement in the F0 values, standard deviation of F0, and minimum and maximum F0 values. The average and median F0 values in spontaneous speech were also lower postoperatively. The voice quality showed a more balanced timbre (LTASS), particularly after one year. Some other prosodic features also showed improvement.

Atypical vocal quality in women with the FMR1 premutation: an indicator of impaired sensorimotor control.

Women with the FMR1 premutation are susceptible to motor involvement related to atypical cerebellar function, including risk for developing fragile X tremor ataxia syndrome. Vocal quality analyses are sensitive to subtle differences in motor skills but have not yet been applied to the FMR1 premutation. This study examined whether women with the FMR1 premutation demonstrate differences in vocal quality, and whether such differences relate to FMR1 genetic, executive, motor, or health features of the FMR1 premutation. Participants included 35 women with the FMR1 premutation and 45 age-matched women without the FMR1 premutation who served as a comparison group. Three sustained/a/vowels were analyzed for pitch (mean F0), variability of pitch (standard deviation of F0), and overall vocal quality (jitter, shimmer, and harmonics-to-noise ratio). Executive, motor, and health indices were obtained from direct and self-report measures and genetic samples were analyzed for FMR1 CGG repeat length and activation ratio. Women with the FMR1 premutation had a lower pitch, larger pitch variability, and poorer vocal quality than the comparison group. Working memory was related to harmonics-to-noise ratio and shimmer in women with the FMR1 premutation. Vocal quality abnormalities differentiated women with the FMR1 premutation from the comparison group and were evident even in the absence of other clinically evident motor deficits. This study supports vocal quality analyses as a tool that may prove useful in the detection of early signs of motor involvement in this population.

Associations of acoustic parameters and gender dysphoria in transmasculine individuals

Gender dysphoria refers to a feeling of discomfort due to a mismatch between a person’s biological sex and gender identity. Voice is a secondary sex marker, and it may contribute to feelings of unease or dissatisfaction if the voice does not match a person’s gender identity. The Utrecht Gender Dysphoria Scale—Gender Spectrum (UGDS-GS) was designed to measure a person's degree of gender dysphoria. Transmasculine individuals were assigned female at birth and identify as male or masculine non-binary, and acoustic studies focusing on transmasculine voices are notably sparse. In a study including 20 transmasculine individuals, we compared UGDS-GS results to the following acoustic parameters: vocal tract length (VTL) estimates, fundamental frequency (f0), standard deviation of f0, and cepstral peak prominence smoothed (CPPS). We found a significant positive correlation between each acoustic measure and gender dysphoria. We also found robust associations between each of these measures and a voice-related quality of life measure. These findings indicate that the sound of one’s voice may be a strong predictor of gender dysphoria.

Acoustic characterization and machine prediction of perceived masculinity and femininity in adults

Previous research has found that human voice can provide reliable information to be used for gender identification with a high level of accuracy. In social psychology, perceived masculinity and femininity (masculinity and femininity rated by humans) has often been considered an important feature when investigating the influence of vocal features on social behaviours. While previous studies have characterized the acoustic features that contributed to perceivers’ judgements of speakers’ masculinity or femininity, there is limited research on developing a machine masculinity/femininity scoring model and characterizing the independent acoustic factors that contribute to perceivers’ masculinity and femininity judgements. In this work, we first propose a machine scoring model of perceived masculinity/femininity based on the Extreme Random Forest and then characterize the independent and meaningful acoustic factors that contribute to perceivers’ judgements by using a correlation matrix based hierarchical clustering method. Our results show that the machine ratings of masculinity and femininity strongly correlated with the human ratings of masculinity and femininity when we used an optimal speech duration of 7 s, with a correlation coefficient of up to .63 for females and .77 for males. Nine independent clusters of acoustic measures were generated from our modelling of femininity judgements for female voices and eight clusters were found for masculinity judgements for male voices. The results revealed that, for both genders, the F0 mean is the most important acoustic measure affecting the judgement of acoustic-related masculinity and femininity. The F3 mean, F4 mean and VTL estimators were found to be highly inter-correlated and appeared in the same cluster, forming the second most significant factor in influencing the assessment of acoustic-related masculinity and femininity. Next, F1 mean, F2 mean and F0 standard deviation are independent factors that share similar importance. The voice perturbation measures, including HNR, jitter and shimmer, are of lesser importance in influencing masculinity/femininity judgements.

Perceived emotional states mediate willingness to buy from advertising speech.

Previous studies have shown that stimulus-organism-response (SOR) theory can well explain the willingness to buy from stores, products, and advertising-related stimuli. However, few studies have investigated advertising speech stimulus that is not influenced by visual design. We examined whether SOR theory using emotional states can explain the willingness to buy from advertising speech stimulus. Participants listened to speech with modified speech features (mean F0, speech rate, and standard deviation of F0) and rated their willingness to buy the advertised products and their perceived emotional states (pleasure, arousal, dominance). We found that emotional states partially mediate the influence of speech features on the willingness to buy. We further analyzed the moderating effects of listeners' attributes and found that listeners' gender and age group moderated the relationship between speech features, emotional states, and willingness to buy. These results indicate that perceived emotional states mediate the willingness to buy from advertising speech.

Influence of age on voice quality after transoral CO2 laser microsurgery

ObjectiveTo study the post-operative evolution of voice quality of patients treated by transoral CO2 laser microsurgery (TLM) according to the age.MethodsPatients treated by type I to VI TLM and post-operative speech therapy were prospectively recruited from our hospital. The voice quality was assessed pre-, 1-, 3- 6- and 12-month posttreatment with voice handicap index (VHI), dysphonia, roughness, breathiness, asthenia, strain (GRBAS), maximal phonation time (MPT), F0, F0 standard deviation (STD), percent jitter, percent shimmer, noise-to-harmonic ratio (NHR), vocal fold vibration assessment and speech fluency. Evolution of voice outcomes was analyzed considering age of patients (< 60 vs. ≥ 60 years).ResultsSeventy-five patients completed the evaluations. Thirty-four and forty-one patients were < 60 or ≥ 60 yo, respectively. Subjective and objective voice parameters (VHI, G, R, B), jitter and fluency significantly improved from 1- to 6-month post-TLM in < 60 yo individuals. The voice parameters improved 12-month post-TLM in the ≥ 60 yo group at the exception of VHI that improved 3-month post-TLM. There were positive associations between age and 12-month NHR, G and A parameters.ConclusionThe post-operative evolution of voice quality parameters may vary between patients according to the age. Preoperative VHI is predictive of 12-month subjective and objective voice outcomes.Graphical abstract

Correlations Between Positive or Negative Utterances and Basic Acoustic Features of Voice: a Preliminary Analysis

The major aim of this paper is to establish possible correlations between continuous sentiment scores and four basic acoustic characteristics of voice. In order to achieve this objective, the text of “A Christmas Carol” by Charles Dickens was tokenized at the sentence level. Next, each of the resulting text units was assessed in terms of sentiment polarity and aligned with the corresponding fragment in an audiobook. The results indicate weak but statistically significant correlations between sentiment scores and three acoustic features: the mean F0, the standard deviation of F0 and the mean intensity. These findings may be useful in selecting optimal acoustic features for model training in multimodal sentiment analysis. Also, they are essential from a linguistic point of view and could be applied in studies on such language phenomena as irony.

Voice Quality Outcomes After Transoral CO2 Laser Cordectomy: A Longitudinal Prospective Study.

To evaluate the evolution of voice quality in patients after type I-VI transoral CO2 laser cordectomy (TLC) by using validated voice outcome measures over a 12-month period. Prospective uncontrolled study. Monocenter study. Patients with laryngeal carcinoma who were eligible for type I-IV TLC were prospectively recruited from a tertiary medical center. The following outcomes were assessed throughout the 12-month posttreatment period: Voice Handicap Index (VHI), GRBAS (grade of dysphonia, roughness, breathiness, asthenia, strain), maximal phonation time, fundamental frequency (F0), F0 standard deviation, percentage jitter, percentage shimmer, noise-to-harmonic ratio, and speech fluency. Analyses were performed considering 2 groups of cordectomies: type I-III vs IV-VI. A total of 131 patients completed the evaluations, totaling 76 type I-III and 55 type IV-VI cordectomies. In type IV-VI, breathiness and maximal phonation time significantly worsened from pretreatment to 1 month posttreatment (P < .05). In the type I-III cordectomy group, VHI, shimmer, roughness, breathiness, and strain significantly improved from pretreatment to 3 months posttreatment, while VHI, F0 standard deviation, shimmer, jitter, grade of dysphonia, roughness, breathiness, and strain improved from baseline to 6 months. Assessments at 12 months posttreatment revealed significant improvements for VHI, shimmer, jitter, noise-to-harmonic ratio, grade of dysphonia, roughness, breathiness, and strain. In the type IV-VI group, VHI significantly improved from baseline to 3, 6, and 12 months posttreatment. Strain improved at 6 and 12 months while roughness improved from baseline to 12 months. Maximal phonation time significantly worsened over the 12-month evaluation period. The effect of TLC on voice quality depends on its type. VHI was identified as the most indicative tool of voice changes irrespective of TLC type.

Validity of intraoperative voice monitoring undergoing type 2 thyroplasty with titanium bridges for adductor spasmodic dysphonia.

ObjectivesThe success of type 2 thyroplasty (TP2) for adductor spasmodic dysphonia (AdSD) depends on the selection of optimally sized titanium bridges, which requires accurate assessment of intraoperative vocal changes. While this procedure has traditionally been performed according to the laryngologist's experience, the most appropriate method for voice monitoring and selection of titanium bridge size remains to be determined. This study aimed to investigate evaluation parameters useful for voice monitoring, as these may allow less experienced surgeons to perform TP2 properly.MethodsIn this prospective study, voice monitoring was performed in 18 patients with AdSD patients undergoing TP2. Evaluations were performed preoperatively, intraoperatively, 13 weeks postoperatively, and 52 weeks postoperatively using GRBAS (grade, roughness, breathiness, asthenia, and strain), as well as perceptual judgment and acoustic analyses.ResultsPreoperative and intraoperative assessments of the G, R, B, and S parameters, perceptual judgment, and harmonic‐to‐noise ratio (HNR) were in moderate or better agreement. Intraoperative and 13‐ or 52‐week postoperative measurements of the R, B, and G parameters and strangulation, tremor, and HNR were also in high agreement. When two different sizes of titanium bridges were compared (unselected vs. selected), ratings for G, R, S, strangulation, tremor, jitter, shimmer, HNR, standard deviation of F0, and degree of voice breaks were better for the selected width than the unselected width.ConclusionThe candidate items for intraoperative voice monitoring during TP2 for AdSD are G, R, strangulation, tremor, and HNR. The use of these items may help to ensure successful TP2 and contribute to the advancement of laryngeal framework surgery.Level of evidenceLevel 4.

Rabbit model with vocal fold hyperadduction

ObjectiveAdductor spasmodic dysphonia (AdSD) is caused by hyperadduction of the vocal folds during phonation, resulting in a strained voice. Animal models are not yet used to elucidate this intractable disease because AdSD has a difficult pathology without a definitive origin. For the first step, we established an animal model with vocal fold hyperadduction and evaluated its validity by assessing laryngeal function. MethodsIn this experimental animal study, three adult Japanese 20-week-old rabbits were used. The models were created using a combination of cricothyroid approximation, forced airflow, and electrical stimulation of the recurrent laryngeal nerves (RLNs). Cricothyroid approximation was added to produce a glottal slit. Thereafter, both RLNs were electrically stimulated to induce vocal fold hyperadduction. Finally, the left RLN was transected to relieve hyperadduction. The sound, endoscopic images, and subglottal pressure were recorded, and acoustic analysis was performed. ResultsSubglottal pressure increased significantly, and the strained sound was produced after the electrical stimulation of the RLNs. After transecting the left RLN, the subglottal pressure decreased significantly, and the strained sound decreased. Acoustic analysis revealed an elevation of the standard deviation of F0 (SDF0) and degree of voice breaks (DVB) through stimulation of the RLNs, and degradation of SDF0 and DVB through RLN transection. Formant bands in the sound spectrogram were interrupted by the stimulation and appeared again after the RLN section. ConclusionThis study developed a rabbit model with vocal fold hyperadduction . The subglottal pressure and acoustic analysis of this model resembled the characteristics of patients with AdSD. This model could be helpful to elucidate the pathology of the larynx caused by hyperadduction, and evaluate and compare the treatments for strained phonation.

Medidas perceptivo-auditivas e acústicas de mulheres com e sem nódulos vocais

ABSTRACT Purpose To compare the acoustic and auditory-perceptual measures of the voice of women with and without vocal nodules. Methods Twelve women with vocal nodules (MNV group) and 12 without vocal nodules (MSNV group) participated in the study. They were submitted to the recording of their sustained /a/ vowel, in order to extract the mean of the fundamental frequency (f0), standard deviation of f0 (SD f0), jitter, shimmer, GNE, cepstral measure of CPPS, and spectral measures of differences of the first and second harmonics (H1-H2); and recording of the carrier phrases: “I say papa baixinho”, “I say pipa baixinho” and “I say pupa baixinho”, to extract the first (F1) and second formant (F2) of the vowel segments /a, i, u/. For auditory-perceptual assessment, the visual-analog scale (VAS) was used. Results The comparative analysis between the groups shows higher values for the MNV in the parameters general degree, roughness and breathiness, and for the shimmer acoustic measure. The F1 values for the vowels /a/ and /u/, and the F2 values for the vowel /a/ were higher in the same group. Conclusion According to the data observed in the investigated sample, women with nodules have more deviated voices, with the presence of roughness and breathiness, and changes in vocal tract adjustments, with a possible reduction in the amplitude of the articulators, when compared to women without vocal nodules.

Investigating the cepstral acoustic characteristics of voice in healthy children

ObjectivesThis study aimed to determine the cepstral acoustic parameters that vary depending on age and gender in vocally healthy children, and to establish normative data for cepstral analysis. BackgroundCepstral measurements are among the strongest predictors of auditory-perceptual evaluation of voice and differentiate between healthy and dysphonic voices. More spesificially, ceptral peak prominence is accepted to be as a strong acoustic predictor of breathiness and overall severity of dysphonia. Cepstral measures determine voice quality reliably not only in sustained vowel samples but also in running speech samples. Determining the parameters related to the acoustic profile of children with normal voices can lead us to a better understanding of the effect of changes in the larynx and vocal fold structure during growth and development. There is a limited number of norm studies examining the cepstral acoustic properties of pediatric voice. Determining norm-specific values and clinical guidelines of cepstral acoustics according to the age and gender in vocally healthy children are utmost important. MethodsA total of 160 vocally healthy children were divided into the following four age groups: Group-I included children within the age range of 4–7 years, Group-II included 7–11 years, Group-III 11–14 years, and Group-IV included children within the age range of 14–18 years. An equal number of male and female participants were assigned to each group. PENTAX Medical CSL Model 4500 was used for recording all tasks. For acoustic analysis, Multi-Dimensional Voice Program and Analysis of Dysphonia in Speech and Voice were used. ResultsCepstral Peak Prominence (CPP), Cepstral Peak Prominence Standard Deviation (CPP SD), and Low-To-High Spectral Ratio (L/H Ratio) increased with age. It is found that the CPP parameter of all-voiced sentences and nasal-weighted sentences increased with age in boys, while no significant pattern was observed in any sample for girls. For L/H ratio, it can be said that there is a general increase with age in all speech samples, except for the vowel-weighted and voiceless plosive sentence samples, evident especially in the group above the age of 15 years. This study concluded that the CPP SD parameter in the vowel-weighted sentences increased with age in boys. It was also noticed in this study that CPP F0 standard deviation (SD) intervals were narrower in vowel-weighted, easy onset, and voiceless plosive sentence samples than in all-voiced, hard glottal attack and nasal-weighted sentence samples. ConclusionThis study established cepstral acoustic normative values for a wide age range of the pediatric population. It is thought that age and gender specific cepstral acoustic findings presented in this study contributed to the related literature. In addition, to our knowledge, this is the first study that provides a normative cepstral acoustic database of the CAPE-V/Turkish sentences in the pediatric population.

Use of automated speech analysis and facial emotion measurements on videos to assess the effects of relaxation devices: a pilot study

Rapid relaxation installations in order to reduce stress appear more and more in public or work places. However, the effects of such devices on physiological and psychological parameters have not been scientifically tested yet. This pilot study (N=40) evaluates the variations of vocal speech and facial emotions parameters in 3-minute videos of participant recorded just before and after relaxation, on four different groups, three of them using a different rapid (15 minutes) sensorial immersion relaxation devices and a control group using no device. Vocal speech parameters included sound duration, pause mean duration, sound duration ratio, mean vocal frequency (F0), standard deviation of F0, minimum and maximum of F0, jitter and shimmer. Facial emotion analysis included neutral, happy, sad, surprised, angry, disgusted, scared, contempt, valence and arousal. The objective of this study is to evaluate different parameters of the automated vocal and facial emotions analysis that could be of use to evaluate the relaxation effect of different devices and to measure their variations in the different experimental groups. We identified significant parameters that can be of use for evaluating rapid relaxation devices, particularly voice prosody and minimum vocal frequency, and some facial emotion such as happy, sad, the valence and arousal. Those parameters allowed us to discriminate distinct effects of the different devices used: in G1 (control) and G2 (spatialized sounds), we observed a slowdown in voice prosody; in G3 (Be-Breathe) a decrease in minimum vocal frequency and an increase of arousal; while in G4 (3D-video) we found an increase in facial emotion valence (happy increasing and sad decreasing). Other parameters tested were not affected by relaxation.

Variability of Electrolaryngeal Speech Intelligibility in Multitalker Babble.

Purpose The purpose of this study was to report the variability of electrolarynx (EL) users' speech intelligibility in quiet and in multitalker babble. Method Ten EL users (five Servox® Digital, five TruTone™) who were at least 2 years postlaryngectomy provided recordings of five sentences from the 1965 Revised List of Phonetically Balanced Sentences. Recordings were judged by two groups of naïve listeners in quiet and in the presence of multitalker babble. Fifteen listeners orthographically transcribed a total of 750 sentences containing 3,750 key words in quiet, and another 15 listeners orthographically transcribed the same sentences mixed with multitalker babble. Results Significant differences in speech intelligibility were observed between listening conditions; 17.9% more key words were correctly identified in quiet compared to multitalker babble. Significant differences in fundamental frequency (F0) standard deviation and range but not speech intelligibility were observed between EL device types. A positive correlation of moderate significance was observed between F0 standard deviation and intelligibility for TruTone users in multitalker babble. Conclusions Findings suggest that listeners are able to identify a significantly higher percentage of EL users' speech in quiet compared to multitalker babble, but a large variability in EL users' speech intelligibility exists. Continued investigation involving a larger number of EL users is necessary to confirm this study's findings. Future research should explore the relationships among F0 measures, speaker characteristics (e.g., rate of speech, articulatory precision), and speech intelligibility, in addition to improving alaryngeal rehabilitation training protocols for EL users.

Validation of freely-available pitch detection algorithms across various noise levels in assessing speech captured by smartphone in Parkinson’s disease

Measuring the fundamental frequency of the vocal folds F0 is recognized as an important parameter in the assessment of speech impairments in Parkinson`s disease (PD). Although a number of F0 trackers currently exist, their performance in smartphone-based evaluation and robustness against background noise have never been tested. Monologues from 30 newly-diagnosed, untreated PD patients and 30 matched healthy control participants were collected. Additive non-stationary urban and household noise at different SNR levels was added to the recordings, which were subsequently assessed by 10 freely-available and widely-used pitch-tracking algorithms. According to the comparison of all investigated pitch detectors, sawtooth inspired pitch estimator (SWIPE) was the most robust and accurate method in estimating mean F0 and its standard deviation. However, at a low 6 dB SNR level, a combination of more algorithms may be needed to achieve the desired precision. Monopitch, calculated as F0 standard deviation and estimated by SWIPE, proved to be robust in distinguishing between the PD and healthy control groups (p < 0.001). We anticipate that monopitch may serve as a quick and inexpensive biomarker of disease progression based on longitudinal data collected via smartphone, without any logistical or time constraints for patients and physicians.