Temporal Fine Structure Speech Research Articles

Effects of rehabilitation training on an elderly population with mild to moderate hearing loss: study protocol for a randomised clinical trial

Background: Age-related hearing loss (presbycusis) is a form of hearing loss in over 60-years-olds and has a negative impact on quality of life. Presbycusis is multifactorial and is predominately characterised with a loss of speech perception in noise. In the cochlea, auditory filters decompose broadband sound into a series of narrowband output signals, which contains two kinds of temporal information: slow changes in overall amplitude envelope (ENV) and faster variations in temporal fine structure (TFS). TFS is important for recognition of target speech in noise. The main aim of the study is to evaluate the effect of TFS rehabilitation training in participants over the age of 60 years with mild to moderate hearing loss. Methods: A randomised clinical trial conducted on 30 participants with mild (loss of 20-39dB HL) to moderate (40-69dB HL) hearing loss, aged between 60 and 75 years old. Participants with conductive hearing loss, abnormal middle ear pathology and central nervous system disease were excluded. Participants were selected randomly to an intervention and control group with a 1:1 ratio. Rehabilitation for the intervention Group are 30-minute sessions three times a week for a total five weeks of vowel consonant vowel words that are used to eliminate ENV and keep only TFS. Word in noise test, binaural TFS test, and Speech, Spatial and Qualities of Hearing Scale scores are performed at the beginning and end of study to evaluate the effect of rehabilitation training. Conclusion: Life expectancy in the elderly has improved, leading to an increased prevalence of age-related diseases including presbycusis. A literature review highlighted that TFS damage is permanent; however, in this study we will attempt to prove that TFS training may lead to speech in noise perception improvement. Trial registration: Registry of Clinical Trials, IRCT2019625044006N1 (7 th August 2019).

Effects of Phase-Locking Deficits on Speech Recognition in Older Adults With Presbycusis.

Objective: People with presbycusis (PC) often report difficulties in speech recognition, especially under noisy listening conditions. Investigating the PC-related changes in central representations of envelope signals and temporal fine structure (TFS) signals of speech sounds is critical for understanding the mechanism underlying the PC-related deficit in speech recognition. Frequency-following responses (FFRs) to speech stimulation can be used to examine the subcortical encoding of both envelope and TFS speech signals. This study compared FFRs to speech signals between listeners with PC and those with clinically normal hearing (NH) under either quiet or noise-masking conditions.Methods: FFRs to a 170-ms speech syllable /da/ were recorded under either a quiet or noise-masking (with a signal-to-noise ratio (SNR) of 8 dB) condition in 14 older adults with PC and 13 age-matched adults with NH. The envelope (FFRENV) and TFS (FFRTFS) components of FFRs were analyzed separately by adding and subtracting the alternative polarity responses, respectively. Speech recognition in noise was evaluated in each participant.Results: In the quiet condition, compared with the NH group, the PC group exhibited smaller F0 and H3 amplitudes and decreased stimulus-response (S-R) correlation for FFRENV but not for FFRTFS. Both the H2 and H3 amplitudes and the S-R correlation of FFRENV significantly decreased in the noise condition compared with the quiet condition in the NH group but not in the PC group. Moreover, the degree of hearing loss was correlated with noise-induced changes in FFRTFS morphology. Furthermore, the speech-in-noise (SIN) threshold was negatively correlated with the noise-induced change in H2 (for FFRENV) and the S-R correlation for FFRENV in the quiet condition.Conclusion: Audibility affects the subcortical encoding of both envelope and TFS in PC patients. The impaired ability to adjust the balance between the envelope and TFS in the noise condition may be part of the mechanism underlying PC-related deficits in speech recognition in noise. FFRs can predict SIN perception performance.

Predictions of Speech Chimaera Intelligibility Using Auditory Nerve Mean-Rate and Spike-Timing Neural Cues.

Perceptual studies of speech intelligibility have shown that slow variations of acoustic envelope (ENV) in a small set of frequency bands provides adequate information for good perceptual performance in quiet, whereas acoustic temporal fine-structure (TFS) cues play a supporting role in background noise. However, the implications for neural coding are prone to misinterpretation because the mean-rate neural representation can contain recovered ENV cues from cochlear filtering of TFS. We investigated ENV recovery and spike-time TFS coding using objective measures of simulated mean-rate and spike-timing neural representations of chimaeric speech, in which either the ENV or the TFS is replaced by another signal. We (a) evaluated the levels of mean-rate and spike-timing neural information for two categories of chimaeric speech, one retaining ENV cues and the other TFS; (b) examined the level of recovered ENV from cochlear filtering of TFS speech; (c) examined and quantified the contribution to recovered ENV from spike-timing cues using a lateral inhibition network (LIN); and (d) constructed linear regression models with objective measures of mean-rate and spike-timing neural cues and subjective phoneme perception scores from normal-hearing listeners. The mean-rate neural cues from the original ENV and recovered ENV partially accounted for perceptual score variability, with additional variability explained by the recovered ENV from the LIN-processed TFS speech. The best model predictions of chimaeric speech intelligibility were found when both the mean-rate and spike-timing neural cues were included, providing further evidence that spike-time coding of TFS cues is important for intelligibility when the speech envelope is degraded.

Relation between measures of psychoacoustic abilities and masking release for unprocessed, envelope, and temporal fine-structure speech in listeners with normal and impaired hearing

Léger et al. [J. Acoust. Soc. Am. 135, 2160, 2014] studied masking release in normal-hearing and hearing-impaired listeners using unprocessed speech and speech processed to convey envelope (ENV) or temporal fine-structure (TFS) cues. Consonant identification scores in speech-shaped background noise (continuous and square-wave interrupted at a rate of 10 Hz) indicated a substantial masking release (MR, better performance in the interrupted noise) for all speech types for normal-hearing listeners but only for the TFS speech in most hearing-impaired listeners. The current study was concerned with relating consonant identification scores and masking release to SRTs for sentences in both types of noise as well as to measurements of basic psychoacoustic abilities. These measures included absolute pure-tone detection thresholds, estimates of auditory bandwidth using a notched-noise procedure, and estimates of cochlear compression obtained using a forward-masking paradigm. For both unprocessed and ENV speech, intelligibility scores and MR were correlated with absolute thresholds and auditory bandwidths in the mid-frequency region (but not at a lower frequency). These correlations were less strong for TFS speech intelligibility and did not predict MR. Cochlear compression was not related to speech intelligibility when controlling for the effect of absolute thresholds. [Work supported by NIH R01 DC000117.]

Consonant identification using temporal fine structure and recovered envelope cues.

The contribution of recovered envelopes (RENVs) to the utilization of temporal-fine structure (TFS) speech cues was examined in normal-hearing listeners. Consonant identification experiments used speech stimuli processed to present TFS or RENV cues. Experiment 1 examined the effects of exposure and presentation order using 16-band TFS speech and 40-band RENV speech recovered from 16-band TFS speech. Prior exposure to TFS speech aided in the reception of RENV speech. Performance on the two conditions was similar (∼50%-correct) for experienced listeners as was the pattern of consonant confusions. Experiment 2 examined the effect of varying the number of RENV bands recovered from 16-band TFS speech. Mean identification scores decreased as the number of RENV bands decreased from 40 to 8 and were only slightly above chance levels for 16 and 8 bands. Experiment 3 examined the effect of varying the number of bands in the TFS speech from which 40-band RENV speech was constructed. Performance fell from 85%- to 31%-correct as the number of TFS bands increased from 1 to 32. Overall, these results suggest that the interpretation of previous studies that have used TFS speech may have been confounded with the presence of RENVs.

The effects of the addition of low-level, low-noise noise on the intelligibility of sentences processed to remove temporal envelope information

The intelligibility of sentences processed to remove temporal envelope information, as far as possible, was assessed. Sentences were filtered into N analysis channels, and each channel signal was divided by its Hilbert envelope to remove envelope information but leave temporal fine structure (TFS) intact. Channel signals were combined to give TFS speech. The effect of adding low-level low-noise noise (LNN) to each channel signal before processing was assessed. The addition of LNN reduced the amplification of low-level signal portions that contained large excursions in instantaneous frequency, and improved the intelligibility of simple TFS speech sentences, but not more complex sentences. It also reduced the time needed to reach a stable level of performance. The recovery of envelope cues by peripheral auditory filtering was investigated by measuring the intelligibility of 'recovered-envelope speech', formed by filtering TFS speech with an array of simulated auditory filters, and using the envelopes at the output of these filters to modulate sinusoids with frequencies equal to the filter center frequencies (i.e., tone vocoding). The intelligibility of TFS speech and recovered-envelope speech fell as N increased, although TFS speech was still highly intelligible for values of N for which the intelligibility of recovered-envelope speech was low.

Relative importance of E and TFS speech cues in low and high‐frequency channels

Previous studies have shown that perfect speech identification in quiet could be obtained for broadband speech processed using the Hilbert transform to preserve either temporal envelope (E) or temporal fine structure (TFS) cues only in narrow frequency bands. However, little is known regarding the respective contribution of each cue to speech intelligibility in low and high frequency bands. The goal of the present study was to assess the contribution of E and TFS cues of the low‐ and high‐frequency channels to consonant identification. Vowel‐consonant‐vowel stimuli were split into an array of 16 analysis bands spanning the range 80‐8,020 Hz and processed using the Hilbert transform to keep either E or TFS cues only within each band. Identification scores were measured for low‐pass and high‐pass filtering of the processed stimuli for a group of normal‐hearing listeners. Results will be discussed in light of phase‐locking properties to E and TFS. In most mammals, phase‐locking of auditory‐nerve fibers begins to decline above 1 kHz and disappears above 4‐5 kHz. TFS‐coded speech intelligibility should therefore drop when stimuli are high‐pass filtered above 1 kHz and be at chance level for high‐pass filtering above 5 kHz. No such drop should be expected for E‐coded speech.