Extended Speech Intelligibility Index Research Articles

The effect of hearing protection worn by talker and/or target listener on speech production in quiet and noise.

Speech production while wearing hearing protectors poses significant challenges due to their occlusion effect and disruption of the Lombard effect. An experiment was conducted with 24 individuals as they read a list of 12 sentences in open ears and while wearing an earmuff in quiet and in four different noises [pink, International Female Fluctuating Masker (IFFM), speech-spectrum noise (SSnoise), and helicopter] at two levels (70 and 85 dBA). An acoustic manikin, fitted or not with an identical protector, served as the target listener. In noise, speech levels decreased when the talkers wore the earmuff but increased when the target listener was fitted with the earmuff. When the earmuff was used by both the talkers and target listener, speech levels were lower by 3-6 dB at the higher noise level compared to when they were both open ears. Speech levels were typically lower, but extended speech intelligibility index estimates were consistently higher, in fluctuating (IFFM, helicopter) than in continuous noises (pink, SSnoise). Talkers' pitch frequency and voice spectrum measurements followed very closely the changes in speech levels, showing no evidence of compensatory voice modifications. Implications of the lower talker speech levels when wearing hearing protectors are discussed in terms of protector selection, training, and individuals with hearing loss.

Contributions of Age-Related and Audibility-Related Deficits to Aided Consonant Identification in Presbycusis: A Causal-Inference Analysis.

The decline of speech intelligibility in presbycusis can be regarded as resulting from the combined contribution of two main groups of factors: (1) audibility-related factors and (2) age-related factors. In particular, there is now an abundant scientific literature on the crucial role of suprathreshold auditory abilities and cognitive functions, which have been found to decline with age even in the absence of audiometric hearing loss. However, researchers investigating the direct effect of aging in presbycusis have to deal with the methodological issue that age and peripheral hearing loss covary to a large extent. In the present study, we analyzed a dataset of consonant-identification scores measured in quiet and in noise for a large cohort (n = 459, age = 42–92) of hearing-impaired (HI) and normal-hearing (NH) listeners. HI listeners were provided with a frequency-dependent amplification adjusted to their audiometric profile. Their scores in the two conditions were predicted from their pure-tone average (PTA) and age, as well as from their Extended Speech Intelligibility Index (ESII), a measure of the impact of audibility loss on speech intelligibility. We relied on a causal-inference approach combined with Bayesian modeling to disentangle the direct causal effects of age and audibility on intelligibility from the indirect effect of age on hearing loss. The analysis revealed that the direct effect of PTA on HI intelligibility scores was 5 times higher than the effect of age. This overwhelming effect of PTA was not due to a residual audibility loss despite amplification, as confirmed by a ESII-based model. More plausibly, the marginal role of age could be a consequence of the relatively little cognitively-demanding task used in this study. Furthermore, the amount of variance in intelligibility scores was smaller for NH than HI listeners, even after accounting for age and audibility, reflecting the presence of additional suprathreshold deficits in the latter group. Although the non-sense-syllable materials and the particular amplification settings used in this study potentially restrict the generalization of the findings, we think that these promising results call for a wider use of causal-inference analysis in audiology, e.g., as a way to disentangle the influence of the various cognitive factors and suprathreshold deficits associated to presbycusis.

Evidence-Based Occupational Hearing Screening I: Modeling the Effects of Real-World Noise Environments on the Likelihood of Effective Speech Communication.

The objectives of this study were to (1) identify essential hearing-critical job tasks for public safety and law enforcement personnel; (2) determine the locations and real-world noise environments where these tasks are performed; (3) characterize each noise environment in terms of its impact on the likelihood of effective speech communication, considering the effects of different levels of vocal effort, communication distances, and repetition; and (4) use this characterization to define an objective normative reference for evaluating the ability of individuals to perform essential hearing-critical job tasks in noisy real-world environments. Data from five occupational hearing studies performed over a 17-year period for various public safety agencies were analyzed. In each study, job task analyses by job content experts identified essential hearing-critical tasks and the real-world noise environments where these tasks are performed. These environments were visited, and calibrated recordings of each noise environment were made. The extended speech intelligibility index (ESII) was calculated for each 4-sec interval in each recording. These data, together with the estimated ESII value required for effective speech communication by individuals with normal hearing, allowed the likelihood of effective speech communication in each noise environment for different levels of vocal effort and communication distances to be determined. These likelihoods provide an objective norm-referenced and standardized means of characterizing the predicted impact of real-world noise on the ability to perform essential hearing-critical tasks. A total of 16 noise environments for law enforcement personnel and eight noise environments for corrections personnel were analyzed. Effective speech communication was essential to hearing-critical tasks performed in these environments. Average noise levels, ranged from approximately 70 to 87 dBA in law enforcement environments and 64 to 80 dBA in corrections environments. The likelihood of effective speech communication at communication distances of 0.5 and 1 m was often less than 0.50 for normal vocal effort. Likelihood values often increased to 0.80 or more when raised or loud vocal effort was used. Effective speech communication at and beyond 5 m was often unlikely, regardless of vocal effort. ESII modeling of nonstationary real-world noise environments may prove an objective means of characterizing their impact on the likelihood of effective speech communication. The normative reference provided by these measures predicts the extent to which hearing impairments that increase the ESII value required for effective speech communication also decrease the likelihood of effective speech communication. These predictions may provide an objective evidence-based link between the essential hearing-critical job task requirements of public safety and law enforcement personnel and ESII-based hearing assessment of individuals who seek to perform these jobs.

Evidence-based occupational hearing screening II: validation of a screening methodology using measures of functional hearing ability

Objective: Validate use of the Extended Speech Intelligibility Index (ESII) for prediction of speech intelligibility in non-stationary real-world noise environments. Define a means of using these predictions for objective occupational hearing screening for hearing-critical public safety and law enforcement jobs. Design: Analyses of predicted and measured speech intelligibility in recordings of real-world noise environments were performed in two studies using speech recognition thresholds (SRTs) and intelligibility measures. ESII analyses of the recordings were used to predict intelligibility. Noise recordings were made in prison environments and at US Army facilities for training ground and airborne forces. Speech materials included full bandwidth sentences and bandpass filtered sentences that simulated radio transmissions. Study sample: A total of 22 adults with normal hearing (NH) and 15 with mild–moderate hearing impairment (HI) participated in the two studies. Results: Average intelligibility predictions for individual NH and HI subjects were accurate in both studies (r2 ≥ 0.94). Pooled predictions were slightly less accurate (0.78 ≤ r2 ≤ 0.92). Conclusions: An individual’s SRT and audiogram can accurately predict the likelihood of effective speech communication in noise environments with known ESII characteristics, where essential hearing-critical tasks are performed. These predictions provide an objective means of occupational hearing screening.

Predicting speech intelligibility with deep neural networks

An accurate objective prediction of human speech intelligibility is of interest for many applications such as the evaluation of signal processing algorithms. To predict the speech recognition threshold (SRT) of normal-hearing listeners, an automatic speech recognition (ASR) system is employed that uses a deep neural network (DNN) to convert the acoustic input into phoneme predictions, which are subsequently decoded into word transcripts. ASR results are obtained with and compared to data presented in Schubotz et al. (2016), which comprises eight different additive maskers that range from speech-shaped stationary noise to a single-talker interferer and responses from eight normal-hearing subjects. The task for listeners and ASR is to identify noisy words from a German matrix sentence test in monaural conditions. Two ASR training schemes typically used in applications are considered: (A) matched training, which uses the same noise type for training and testing and (B) multi-condition training, which covers all eight maskers. For both training schemes, ASR-based predictions outperform established measures such as the extended speech intelligibility index (ESII), the multi-resolution speech envelope power spectrum model (mr-sEPSM) and others. This result is obtained with a speaker-independent model that compares the word labels of the utterance with the ASR transcript, which does not require separate noise and speech signals. The best predictions are obtained for multi-condition training with amplitude modulation features, which implies that the noise type has been seen during training. Predictions and measurements are analyzed by comparing speech recognition thresholds and individual psychometric functions to the DNN-based results.

Monaural speech intelligibility and detection in maskers with varying amounts of spectro-temporal speech features.

Speech intelligibility is strongly affected by the presence of maskers. Depending on the spectro-temporal structure of the masker and its similarity to the target speech, different masking aspects can occur which are typically referred to as energetic, amplitude modulation, and informational masking. In this study speech intelligibility and speech detection was measured in maskers that vary systematically in the time-frequency domain from steady-state noise to a single interfering talker. Male and female target speech was used in combination with maskers based on speech for the same or different gender. Observed data were compared to predictions of the speech intelligibility index, extended speech intelligibility index, multi-resolution speech-based envelope-power-spectrum model, and the short-time objective intelligibility measure. The different models served as analysis tool to help distinguish between the different masking aspects. Comparison shows that overall masking can to a large extent be explained by short-term energetic masking. However, the other masking aspects (amplitude modulation an informational masking) influence speech intelligibility as well. Additionally, it was obvious that all models showed considerable deviations from the data. Therefore, the current study provides a benchmark for further evaluation of speech prediction models.

Phoneme recognition in vocoded maskers by normal-hearing and aided hearing-impaired listeners.

This study compared modulation benefit for phoneme recognition obtained by normal-hearing (NH) and aided hearing-impaired (HI) listeners. Consonant and vowel recognition scores were measured using nonsense syllables in the presence of a steady-state noise and four vocoded speech maskers. Vocoded maskers were generated by modulating the steady-state noise, in either one or six frequency channels, with the speech envelope extracted from the speech of either a single talker or a four-talker babble. Aided HI listeners obtained lower consonant recognition scores than NH listeners in all masker conditions. Vowel recognition scores for aided HI listeners were comparable to NH scores, except in the six-channel vocoded masker conditions where they were relatively lower. Analysis using the extended speech intelligibility index developed by Rhebergen, Versfeld, and Dreschler [(2006). J. Acoust. Soc. Am. 120(6), 3988-3997] suggested that the signal-to-noise ratio deficit observed in aided HI listeners was largely due to uncompensated audibility loss. There was no significant difference between modulation masking release obtained by NH and aided HI listeners for both consonant and vowel recognition.

Characterizing the Speech Reception Threshold in hearing-impaired listeners in relation to masker type and masker level

The Speech Reception Threshold [SRT, (dB SNR)] is often used as an outcome measure to quantify the acuity for speech perception in noise. The majority of studies observe speech intelligibility in noise at a fixed noise level. However, the observed SNR might be an ambiguous outcome measure because it is dependent on the sensation level (SL) of the noise in the case of a non-stationary noise. Due to their higher thresholds, hearing-impaired listeners are usually tested at a different SL compared to normal-hearing listeners. Therefore, the observed SNR "itself" might not be a robust outcome measure to characterize the differences in performance between normal-hearing and hearing-impaired listeners, within and between different studies. In this paper, the SRTs are measured at a fixed absolute noise level (80 dBA) and at a fixed SL (25 dB). The results are discussed and described with an extension to the SRT model of Plomp [(1986). "A signal-to-noise ratio model for the speech-receptionthreshold of the hearing-impaired," J. Speech Hear. Res. 29, 146-154] and the Extended Speech Intelligibility Index. In addition, two alternative outcome measures are proposed which are, in contrast to the SNR, independent of the noise level. These outcome measures are able to characterize the SRT performance in fluctuating noise in a more uniform and unambiguous way.

Relationship between speech recognition in noise and sparseness

Objective: Established methods for predicting speech recognition in noise require knowledge of clean speech signals, placing limitations on their application. The study evaluates an alternative approach based on characteristics of noisy speech, specifically its sparseness as represented by the statistic kurtosis. Design: Experiments 1 and 2 involved acoustic analysis of vowel-consonant-vowel (VCV) syllables in babble noise, comparing kurtosis, glimpsing areas, and extended speech intelligibility index (ESII) of noisy speech signals with one another and with pre-existing speech recognition scores. Experiment 3 manipulated kurtosis of VCV syllables and investigated effects on speech recognition scores in normal-hearing listeners. Study sample: Pre-existing speech recognition data for Experiments 1 and 2; seven normal-hearing participants for Experiment 3. Results: Experiments 1 and 2 demonstrated that kurtosis calculated in the time-domain from noisy speech is highly correlated (r > 0.98) with established prediction models: glimpsing and ESII. All three measures predicted speech recognition scores well. The final experiment showed a clear monotonic relationship between speech recognition scores and kurtosis. Conclusions: Speech recognition performance in noise is closely related to the sparseness (kurtosis) of the noisy speech signal, at least for the types of speech and noise used here and for listeners with normal hearing.

Modelling the speech reception threshold in non-stationary noise in hearing-impaired listeners as a function of level

The extended speech intelligibility index (ESII) model () forms an upgrade to the conventional speech intelligibility index model. For normal-hearing listeners the ESII model is able to predict the speech reception threshold (SRT) in both stationary and non-stationary noise maskers. In this paper, a first attempt is made to evaluate the ESII with SRT data obtained by , and of hearing-impaired listeners in stationary, 10-Hz interrupted, and non-stationary speech-shaped noise measured at different noise levels. The results show that the ESII model is able to describe the SRT in different non-stationary noises for normal-hearing listeners at different noise levels reasonably well. However, the ESII model is less successful in the case of predicting the SRT in non-stationary noise for hearing-impaired subjects. As long as the present audibility models cannot describe the auditory processing in a listener with cochlear hearing loss accurately, it is difficult to distinguish between raised SRTs due to supra-threshold deficits or factors such as cognition, age, and language skills.SumarioEl modelo del Índice extendido de inteligibilidad del lenguaje (ESII) () constituye una actualización del modelo de índice convencional de inteligibilidad del lenguaje. Para oyentes con audición normal, el modelo del ESII es capaz de predecir el umbral de recepción del lenguaje (SRT) tanto ante enmascaradores de ruido estacionario y como no estacionario. En este trabajo, se realiza un primer intento para evaluar el ESII con datos del SRT obtenidos por Laat y Plomp (1983) y a partir de sujetos con hipoacusia, en ruido estacionario, con interrupciones de 10-Hz, y en ruido no estacionario con conformación de lenguaje, medido a diferentes niveles de intensidad. Los resultados muestran que el modelo ESII es capaz de describir el SRT razonablemente bien, para diferentes ruidos no estacionarios en sujetos normo-oyentes, a diferentes niveles de intensidad. Sin embargo, el modelo ESII es menos exitoso para predecir el SRT en ruido no estacionario con sujetos hipoacúsicos. En tanto que los modelos presentes de audibilidad no puedan describir el procesamiento auditivo en un sujeto con pérdida auditiva coclear en forma exacta, es difícil distinguir entre un SRT elevado debido a una deficiencia supra-umbral o a factores tales como cognición, edad o habilidad para el lenguaje.

Speech reception by listeners with real and simulated hearing impairment: Effects of continuous and interrupted noise

The effects of audibility and age on masking for sentences in continuous and interrupted noise were examined in listeners with real and simulated hearing loss. The absolute thresholds of each of ten listeners with sensorineural hearing loss were simulated in normal-hearing listeners through a combination of spectrally-shaped threshold noise and multi-band expansion for octave bands with center frequencies from 0.25-8 kHz. Each individual hearing loss was simulated in two groups of three normal-hearing listeners (an age-matched and a non-age-matched group). The speech-to-noise ratio (S/N) for 50%-correct identification of hearing in noise test (HINT) sentences was measured in backgrounds of continuous and temporally-modulated (10 Hz square-wave) noise at two overall levels for unprocessed speech and for speech that was amplified with the NAL-RP prescription. The S/N in both continuous and interrupted noise of the hearing-impaired listeners was relatively well-simulated in both groups of normal-hearing listeners. Thus, release from masking (the difference in S/N obtained in continuous versus interrupted noise) appears to be determined primarily by audibility. Minimal age effects were observed in this small sample. Observed values of masking release were compared to predictions derived from intelligibility curves generated using the extended speech intelligibility index (ESII) [Rhebergen et al. (2006). J. Acoust. Soc. Am. 120, 3988-3997].

Auditory and auditory-visual intelligibility of speech in fluctuating maskers for normal-hearing and hearing-impaired listeners

Speech intelligibility for audio-alone and audiovisual (AV) sentences was estimated as a function of signal-to-noise ratio (SNR) for a female target talker presented in a stationary noise, an interfering male talker, or a speech-modulated noise background, for eight hearing-impaired (HI) and five normal-hearing (NH) listeners. At the 50% keywords-correct performance level, HI listeners showed 7-12 dB less fluctuating-masker benefit (FMB) than NH listeners, consistent with previous results. Both groups showed significantly more FMB under AV than audio-alone conditions. When compared at the same stationary-noise SNR, FMB differences between listener groups and modalities were substantially smaller, suggesting that most of the FMB differences at the 50% performance level may reflect a SNR dependence of the FMB. Still, 1-5 dB of the FMB difference between listener groups remained, indicating a possible role for reduced audibility, limited spectral or temporal resolution, or an inability to use auditory source-segregation cues, in directly limiting the ability to listen in the dips of a fluctuating masker. A modified version of the extended speech-intelligibility index that predicts a larger FMB at less favorable SNRs accounted for most of the FMB differences between listener groups and modalities. Overall, these data suggest that HI listeners retain more of an ability to listen in the dips of a fluctuating masker than previously thought. Instead, the fluctuating-masker difficulties exhibited by HI listeners may derive from the reduced FMB associated with the more favorable SNRs they require to identify a reasonable proportion of the target speech.

The combined effects of reverberation and nonstationary noise on sentence intelligibility

Listening conditions in everyday life typically include a combination of reverberation and nonstationary background noise. It is well known that sentence intelligibility is adversely affected by these factors. To assess their combined effects, an approach is introduced which combines two methods of predicting speech intelligibility, the extended speech intelligibility index (ESII) and the speech transmission index. First, the effects of reverberation on nonstationary noise (i.e., reduction of masker modulations) and on speech modulations are evaluated separately. Subsequently, the ESII is applied to predict the speech reception threshold (SRT) in the masker with reduced modulations. To validate this approach, SRTs were measured for ten normal-hearing listeners, in various combinations of nonstationary noise and artificially created reverberation. After taking the characteristics of the speech corpus into account, results show that the approach accurately predicts SRTs in nonstationary noise and reverberation for normal-hearing listeners. Furthermore, it is shown that, when reverberation is present, the benefit from masker fluctuations may be substantially reduced.

Prediction of the Intelligibility for Speech in Real-Life Background Noises for Subjects With Normal Hearing

The speech reception threshold (SRT) traditionally is measured in stationary noise that has the long-term average speech spectrum of the target speech. However, in real life the instantaneous spectrum of the background noise is likely to be different from the stationary long-term average speech spectrum noise. To gain more insight into the effect of real-life background noises on speech intelligibility, the SRT of listeners with normal hearing was measured in a set of noises that varied in both the spectral and the temporal domain. This article investigates the ability of the extended speech intelligibility index (ESII), proposed by Rhebergen et al. to account for SRTs in these real-life background noises. SRTs in noise were measured in 12 subjects with normal hearing. Interfering noises consisted of a variety of real-life noises, selected from a database, and chosen on the basis of their spectrotemporal differences. Measured SRTs were converted to ESII values and compared. Ideally, at threshold, ESII values should be the same, because the ESII represents the amount of speech information available to the listener. SRTs ranged from -6 dB SNR (in stationary noise) to -21 dB SNR (in machine gun noise). Conversion to ESII values resulted in an average value of 0.34, with a standard deviation of 0.06. SRT predictions with the ESII model were better than those obtained with the conventional SII (ANSI 53.5-1997) model. In case of interfering speech, the ESII model predictions were poorer, because additional, nonenergetic (informational) masking is thought to occur. For the present set of masking noises, being representative for a variety of real-life noises, the ESII model of Rhebergen et al. is able to predict the SRTs of subjects with normal hearing with reasonable accuracy. It may be concluded that the ESII model can provide valuable predictions for the speech intelligibility in some everyday situations.

The combined effects of reverberation and fluctuating noise on sentence intelligibility

Listening conditions in everyday life typically include a combination of reverberation and nonstationary background noise. It is well known that sentence intelligibility is adversely affected by these factors. To assess their combined effects, a model is introduced that combines two models of speech perception, the Extended Speech Intelligibility Index (E-SII), and the Speech Transmission Index (STI). First, the effect of reverberation on nonstationary noise—reduction of modulations—is determined. The E-SII is then used to evaluate the effect of this modified nonstationary noise, while the STI is applied to quantify the effects of reverberation and noise on speech quality. To validate this model, speech reception thresholds (SRTs) were measured for ten normal-hearing listeners, under various combinations of nonstationary noise and artificially created reverberation. After taking the characteristics of the speech corpus into account, results show that the model accurately predicts SRTs in fluctuating noise and reverberation for normal-hearing listeners.

Extended speech intelligibility index for the prediction of the speech reception threshold in fluctuating noise

The extension to the speech intelligibility index (SII; ANSI S3.5-1997 (1997)) proposed by Rhebergen and Versfeld [Rhebergen, K.S., and Versfeld, N.J. (2005). J. Acoust. Soc. Am. 117(4), 2181-2192] is able to predict for normal-hearing listeners the speech intelligibility in both stationary and fluctuating noise maskers with reasonable accuracy. The extended SII model was validated with speech reception threshold (SRT) data from the literature. However, further validation is required and the present paper describes SRT experiments with nonstationary noise conditions that are critical to the extended model. From these data, it can be concluded that the extended SII model is able to predict the SRTs for the majority of conditions, but that predictions are better when the extended SII model includes a function to account for forward masking.