Time Difference Cues Research Articles

Magnified interaural level differences enhance spatial release from masking in bilateral cochlear implant users.

Bilateral cochlear implant (BiCI) usage makes binaural benefits a possibility for implant users. Yet, limited access to interaural time difference (ITD) cues and reduced saliency of interaural level difference (ILD) cues restricts perceptual benefits of spatially separating a target from masker sounds for BiCI users. Here, we explore whether magnifying ILD cues improves intelligibility of masked speech for BiCI listeners in a "symmetrical-masker" configuration, which controls for long-term positive target-to-masker ratio (TMR) at the ear nearer the target from naturally occurring ILD cues. We magnified ILDs by estimating moment-to-moment ITDs in 1-octave-wide frequency bands, and applying corresponding ILDs to the target-masker mixtures reaching the two ears at each time in each frequency band. We conducted two experiments, one with NH listeners using vocoded stimuli and one with BiCI users. ILD magnification significantly improved intelligibility in both experiments. BiCI listeners showed no benefit of spatial separation between target and maskers with natural ILDs, even for the largest target-masker separation. Because ILD magnification is applied to the mixed signals at each ear, the strategy does not alter the TMR in either ear at any time; improvements to masked speech intelligibility are thus likely from improved perceptual separation of the competing sources.

A Mixed-Rate Strategy on a Bilaterally-Synchronized Cochlear Implant Processor Offering the Opportunity to Provide Both Speech Understanding and Interaural Time Difference Cues.

Background/Objective: Bilaterally implanted cochlear implant (CI) users do not consistently have access to interaural time differences (ITDs). ITDs are crucial for restoring the ability to localize sounds and understand speech in noisy environments. Lack of access to ITDs is partly due to lack of communication between clinical processors across the ears and partly because processors must use relatively high rates of stimulation to encode envelope information. Speech understanding is best at higher stimulation rates, but sensitivity to ITDs in the timing of pulses is best at low stimulation rates. Methods: We implemented a practical "mixed rate" strategy that encodes ITD information using a low stimulation rate on some channels and speech information using high rates on the remaining channels. The strategy was tested using a bilaterally synchronized research processor, the CCi-MOBILE. Nine bilaterally implanted CI users were tested on speech understanding and were asked to judge the location of a sound based on ITDs encoded using this strategy. Results: Performance was similar in both tasks between the control strategy and the new strategy. Conclusions: We discuss the benefits and drawbacks of the sound coding strategy and provide guidelines for utilizing synchronized processors for developing strategies.

Auditory Spatial Illusion – A Psychoacoustic Study in Young Adults

The Franssen illusion, or Franssen effect (FE), is one of the auditory spatial illusions. Few studies have explored the FE, and the mechanisms underlying it remain unknown. The present study was conducted to clarify the FE occurrence with different tasks and presentation modes in young adults. It also sought to investigate possible neurophysiological similarities between interaural time difference (ITD) cue processing and FE perception. FE perception was evaluated using two different tasks and two presentation modes (i.e., insert phones and loudspeakers). Sound reflections (reverberation) were presented in the diffuse field (loudspeaker mode). ITD performance was investigated using different stimuli delivered via insert phones. No significant difference between the two FE perception tasks was found ( F 1,25 = 0.138, p = 0.713). However, the FE perception showed a significant difference between the two presentation modes (F 1,25 = 434.03, p < 0.001). Spearman’s correlation did not reveal a significant relationship between FE perception and ITD scores ( p > 0.05). The current findings show the importance of reverberation in the FE occurrence. Also, the non-significant correlation between the results of the behavioral binaural temporal resolution test and FE perception in young people with normal temporal resolution may indicate that room reflections (reverberation) complicate the ability to process ITDs (rather than poor ITD processing for the “steady state” portion of signal).

Neural mechanisms of spatial auditory attention with magnified interaural level difference cues

Bilateral cochlear implant users struggle in spatial release from masking (SRM) tasks, likely due to restricted access to interaural time difference (ITD) cues. Instead, they must rely on interaural level difference (ILD) cues; however, our previous behavioral experiments suggest that magnification of ILDs can facilitate SRM. Here, we probed the neural mechanisms underlying the benefit of magnified ILDs. We tested 18 normal-hearing subjects in an anechoic chamber. Listeners heard target and masker sequences of object and color words from opposite (left and right) quarterfields and were asked to detect color words in the target stream. Both streams were spatialized using either 50 μS ITD (ITD50), 500 μS ITD (ITD500), a broadband 10 dB ILD (ILD10), or the largest naturally occurring frequency-specific ILD (70 degrees; ILD70n). We recorded task-elicited hemodynamic responses in dorsolateral prefrontal cortex (DLPFC) using functional Near-Infrared Spectroscopy. Subjects performed best in the ITD500 and ILD10 conditions. Hemodynamic response magnitudes were smaller for ITD50 than for all other conditions, consistent with frontal activity increasing when perceptual segregation is possible and spatial attention can be deployed successfully. These data show that magnified ILD cues enhance SRM and that the benefit ILDs confer arises because listeners can engage cognitive attentional processes.

Electrophysiological and behavioral assessment of binaural processing: Effects of age

Spatial hearing deteriorates with age, but the basis(es) of this age-dependency is not clear and could reflect both bottom-up and top-down factors. Since binaural processing depends in part on interaural time difference cues, this study assessed binaural temporal acuity using both objective and behavioral measures. Three tasks incorporating interaural time/phase differences were tested: (1) in-phase and out-of-phase frequency modulation (FM) detection as a function of FM rate; (2) upper frequency limit of in-phase versus out-of-phase tone discrimination; and (3) minimum audible angle for low frequency tones. Each task incorporated parallel behavioral and electrophysiological measures: For behavior, forced-choice adaptive methods were employed; for electrophysiology, the acoustic change complex (ACC) was recorded. Additional measures of peripheral auditory function, as well as cognitive status, were also collected. Young and middle-aged adults (n = 20 per age group) with normal audiometric hearing were tested. Differences in behavioral measures of binaural performance were noted between the two age groups and these were reflected to some extent in the ACC results. However, group differences were also noted in terms of cochlear function and in terms of cognitive abilities. This pattern of results suggests that age-related deterioration in spatial perception is likely to be multi-faceted.

Interaural frequency mismatch jointly modulates neural brainstem binaural interaction and behavioral interaural time difference sensitivity in humans

The binaural interaction component (BIC) of the auditory brainstem response (ABR) is the difference obtained after subtracting the sum of right and left ear ABRs from binaurally evoked ABRs. The BIC has attracted interest as a biomarker of binaural processing abilities. Best binaural processing is presumed to require spectrally-matched inputs at the two ears, but peripheral pathology and/or impacts of hearing devices can lead to mismatched inputs. Such mismatching can degrade behavioral sensitivity to interaural time difference (ITD) cues, but might be detected using the BIC. Here, we examine the effect of interaural frequency mismatch (IFM) on BIC and behavioral ITD sensitivity in audiometrically normal adult human subjects (both sexes). Binaural and monaural ABRs were recorded and BICs computed from subjects in response to narrowband tones. Left ear stimuli were fixed at 4000 Hz while right ear stimuli varied over a ∼2-octave range (re: 4000 Hz). Separately, subjects performed psychophysical lateralization tasks using the same stimuli to determine ITD discrimination thresholds jointly as a function of IFM and sound level. Results demonstrated significant effects of IFM on BIC amplitudes, with lower amplitudes in mismatched conditions than frequency-matched. Behavioral ITD discrimination thresholds were elevated at mismatched frequencies and lower sound levels, but also more sharply modulated by IFM at lower sound levels. Combinations of ITD, IFM and overall sound level that resulted in fused and lateralized percepts were bound by the empirically-measured BIC, and also by model predictions simulated using an established computational model of the brainstem circuit thought to generate the BIC.

Bilateral Cochlear Implant Processing of Coding Strategies With CCi-MOBILE, an Open-Source Research Platform.

While speech understanding for cochlear implant (CI) users in quiet is relatively effective, listeners experience difficulty in identification of speaker and sound location. To assist for better residual hearing abilities and speech intelligibility support, bilateral and bimodal forms of assisted hearing is becoming popular among CI users. Effective bilateral processing calls for testing precise algorithm synchronization and fitting between both left and right ear channels in order to capture interaural time and level difference cues (ITD and ILDs). This work demonstrates bilateral implant algorithm processing using a custom-made CI research platform - CCi-MOBILE, which is capable of capturing precise source localization information and supports researchers in testing bilateral CI processing in real-time naturalistic environments. Simulation-based, objective, and subjective testing has been performed to validate the accuracy of the platform. The subjective test results produced an RMS error of ±8.66° for source localization, which is comparable to the performance of commercial CI processors.

Chickens have excellent sound localization ability.

The mechanisms of sound localization are actively debated, especially which cues are predominately used and why. Our study provides behavioural data in chickens (Gallus gallus) and relates these to estimates of the perceived physical cues. Sound localization acuity was quantified as the minimum audible angle (MAA) in azimuth. Pure-tone MAA was 12.3, 9.3, 8.9 and 14.5deg for frequencies of 500, 1000, 2000 and 4000 Hz, respectively. Broadband-noise MAA was 12.2deg, which indicates excellent behavioural acuity. We determined 'external cues' from head-related transfer functions of chickens. These were used to derive 'internal cues', taking into account published data on the effect of the coupled middle ears. Our estimates of the internal cues indicate that chickens likely relied on interaural time difference cues alone at low frequencies of 500 and 1000 Hz, whereas at 2000 and 4000 Hz, interaural level differences may be the dominant cue.

Effect of gap detection threshold and localisation acuity on spatial release from masking in older adults*

Objective The primary objective of this experiment was to measure the temporal and spatial processing capabilities of older individuals and use statistical models to identify the individual contributions of these temporal and spatial processing capabilities to spatial release from masking (SRM). Design Repeated measures Study sample Twenty-five older listeners with varying degrees of hearing loss participated in this experiment. SRM using the coordinate response measure, gap detection thresholds and localisation acuity for 1/3-octave-wide Gaussian noise bands centred at 500 and 4000 Hz were measured for all the listeners. Results Older listeners had better speech recognition thresholds when target and maskers were spatially separated as compared to when they were co-located. In addition, hearing loss and localisation acuity at 500 Hz were significant predictors in a multiple regression model predicting SRM. However, gap detection thresholds did not significantly contribute to the multiple regression model predicting SRM. Conclusion Based on our data, we conclude that SRM at 30° spatial separation between the target and symmetric maskers is driven by the ability of the individuals to use interaural time difference cues.

Web-based remote testing as a viable option for measuring binaural hearing abilities

Web-based remote testing can increase access to clinically diverse populations in hearing research. However, whether remote testing affects data quality compared to in-lab testing is unknown. Data for binaural hearing tasks may be particularly vulnerable to commercial-grade hardware limitations and background noise from the testing environment. We replicated two published studies on binaural hearing abilities using a web-based behavioral experimental platform (Gorilla.sc). In Experiment 1, we replicated an experiment by Goupell et al. [JASA 133(4) (2013)] that tested intra-cranial lateralization to interaural time and level difference cues. In Experiment 2, we replicated an experiment by Goupell et al. [JASA 140(3) (2016)] that investigated binaural and contralateral unmasking of speech. Two groups of college-aged young adults were tested: one with verified normal hearing (NH) and one with self-reported NH. Testing took place in participants’ homes using their own computer and audio hardware. Performance was compared between the two groups of participants as well as with published data collected in-lab. For both experiments, performance was similar for in-lab and web-based remote testing. We found no effect of verified versus self-reported NH. These results suggest that remote testing may be a feasible option for binaural hearing experiments. [Work funded by NIH-NIDCD.]

Effects of interaural decoherence on sensitivity to interaural level differences across frequency.

The interaural level difference (ILD) is a robust indicator of sound source azimuth, and human ILD sensitivity persists under conditions that degrade normally-dominant interaural time difference (ITD) cues. Nonetheless, ILD sensitivity varies somewhat with both stimulus frequency and interaural correlation (coherence). To further investigate the combined binaural perceptual influence of these variables, the present study assessed ILD sensitivity at frequencies 250-4000 Hz using stimuli of varied interaural correlation. In the first of two experiments, ILD discrimination thresholds were modestly elevated, and subjective lateralization slightly reduced, for both half-correlated and uncorrelated narrowband noise tokens relative to correlated tokens. Different from thresholds in the correlated condition, which were worst at 1000 Hz [Grantham, D.W. (1984). J. Acoust. Soc. Am. 75, 1191-1194], thresholds in the decorrelated conditions were independent of frequency. However, intrinsic envelope fluctuations in narrowband stimuli caused moment-to-moment variation of the nominal ILD, complicating interpretation of measured thresholds. Thus, a second experiment employed low-fluctuation noise tokens, revealing a clear effect of interaural decoherence per se that was strongly frequency-dependent, decreasing in magnitude from low to high frequencies. Measurements are consistent with known integration times in ILD-sensitive neurons and also suggest persistent influences of covert ITD cues in putative "ILD" tasks.

The influence of envelope shape on the lateralization of amplitude-modulated, low-frequency sound.

For abruptly gated sound, interaural time difference (ITD) cues at onset carry greater perceptual weight than those following. This research explored how envelope shape influences such carrier ITD weighting. Experiment 1 assessed the perceived lateralization of a tonal binaural beat that transitioned through ITD (diotic envelope, mean carrier frequency of 500 Hz). Listeners' left/right lateralization judgments were compared to those for static-ITD tones. For an 8 Hz sinusoidally amplitude-modulated envelope, ITD cues 24 ms after onset well-predicted reported sidedness. For an equivalent-duration "abrupt" envelope, which was unmodulated besides 20-ms onset/offset ramps, reported sidedness corresponded to ITDs near onset (e.g., 6 ms). However, unlike for sinusoidal amplitude modulation, ITDs toward offset seemingly also influenced perceived sidedness. Experiment 2 adjusted the duration of the offset ramp (25-75 ms) and found evidence for such offset weighting only for the most abrupt ramp tested. In experiment 3, an ITD was imposed on a brief segment of otherwise diotic filtered noise. Listeners discriminated right- from left-leading ITDs. In sinusoidal amplitude modulation, thresholds were lowest when the ITD segment occurred during rising amplitude. For the abrupt envelope, the lowest thresholds were observed when the segment occurred at either onset or offset. These experiments demonstrate the influence of envelope profile on carrier ITD sensitivity.

Study of Correlation Between EEG Electrodes for the Analysis of Cortical Responses Related to Binaural Hearing

Binaural hearing is the ability of the human auditory system to integrate information received from both ears simultaneously. Binaural hearing is fundamental in understanding speech in noisy backgrounds. Any disfunction in one or both ears could cause a disruption in the processing mechanism. Auditory evoked potentials (AEPs) are electrical potentials evoked by externally presented auditory stimuli from any part of the auditory system. A non-invasive technology, electroencephalography (EEG) is used for the monitoring of AEPs. The research aims to identify the best suited electrode positions through correlation analysis and analyse the AEP signals from the selected electrodes in order to detect binaural sensitivity of the human brain. The study evaluates the time-averaged EEG responses of normal hearing subjects to auditory stimuli. The stimuli used for the study are 500 Hz Blackman windowed pure tones, presented in either homophasic (the same phase in both ears) or antiphasic (180-degree phase difference between the two ears) conditions. The study focuses on understanding the effect of phase reversal of auditory stimuli, an under interaural time difference (ITD) cue, on the middle latency response (MLR) region of the AEPs. A correlation analysis was carried out between the eight different locations and as a result, Cz and Pz electrode positions were selected as the best suited positions for further analysis. The selected electrode signals were further processed in the time domain and frequency domain analysis. In the time domain analysis, it was found that Cz electrode for eight subjects out of nine and Pz electrode for seven subjects out of nine, had the larger area under signal curve obtained in the antiphasic condition than in the homophasic signals. Frequency domain analysis showed that the frequency bands 20 to 25Hz and 25 to 30Hz had the most energy when elicited by antiphasic stimuli than by homophasic stimuli. The findings of this study can be further utilised for the detection of binaural processing in a human brain.

Performance Analysis of the Extended Binaural MVDR Beamformer With Partial Noise Estimation

Besides reducing undesired noise sources and limiting speech distortion, another important objective of a binaural noise reduction algorithm is the preservation of the binaural cues of all sound sources in the acoustic scene. In this paper, we consider the binaural minimum variance distortionless response beamformer with partial noise estimation (BMVDR-N), which allows to trade off between noise reduction performance and binaural cue preservation of the noise component by mixing the output signals of the BMVDR beamformer with the noisy reference microphone signals. For a directional noise source, it has been shown that incorporating an external microphone in addition to the head-mounted microphones enables both the noise reduction performance as well as the interaural time and level difference cues of the noise component to be improved in the output signals. In this paper, we consider an arbitrary noise field and analytically show that incorporating an external microphone in the BMVDR-N beamformer enables 1) a larger output signal-to-noise ratio (SNR) for the same mixing parameter, 2) the same output SNR for a larger mixing parameter, and 3) the same desired output magnitude squared coherence (MSC) of the noise component for a smaller mixing parameter to be obtained. The derived analytical expressions are firstly validated using simulated anechoic acoustic transfer functions, where the listener’s head is modelled as a rigid sphere. Experimental results using recorded signals for a binaural hearing device setup in a reverberant environment also show that in a realistic scenario incorporating an external microphone in the BMVDR-N beamformer significantly improves the output SNR and reduces the mixing parameter that is required to obtain a desired output MSC of the noise component compared to using only the head-mounted microphones.

Solving the cocktail party problem for bilateral cochlear implant users

It is well-known that listeners with hearing impairment have trouble solving the cocktail party problem. Bilateral cochlear implant users have shown little or no perceptual abilities in this regard. This is due in large part to poor encoding of interaural time difference cues by these devices. Interaural level difference cues, which are well-encoded by bilateral cochlear implants, are not thought to facilitate benefit beyond improved signal-to-noise ratio benefits from head-shadow. An approach to mitigating this problem will be presented, that magnifies interaural level difference cues in real time to increase the perceptual distance between sound sources that are separated in the horizontal plane. The effects of ILD magnification on source localization and speech intelligibility in cocktail-party settings will be discussed.

Estimating the perceptual weighting of interaural time difference cues in amplitude modulated binaural beats.

For an abruptly gated sound, perceived lateralization is determined primarily by binaural cues at onset. Relatively less is known about the temporal weighing of binaural cues-such as interaural time difference (ITD)-during more naturalistic modulation profiles. Here, an experiment measured the lateralization of a tonal binaural beat modulated by a diotic, 8-Hz sinusoidal amplitude modulation. Binaural beat lateralization (left/right, two alternatives) was compared to that for tones with static ITDs. Across three mean carrier frequencies (200, 500, and 800 Hz), ITDs occurring during early rising amplitude (e.g., 20-25 ms after onset) predicted the perceived lateralization of the binaural beat signals well.

The role of reliable interaural time difference cues in ambiguous binaural signals for the intelligibility of multitalker speech.

When listening to speech in the presence of concurrent talkers, listeners can benefit from glimpses that occur as a result of spectro-temporal modulations in the speech signals. These glimpses are characterized by a high local signal-to-noise ratio and allow listeners to collect relatively undistorted and reliable information on target speech features. A series of experiments was designed to measure the spatial advantage for binaurally presented speech when useful interaural time difference (ITD) information was provided only in glimpses of speech signals with otherwise ambiguous ITDs. For interaurally coherent signals, ITD information provided by target glimpses contributed substantially to the spatial advantage, but consistent target ITDs overall appeared to be of minor importance to speech intelligibility. For interaurally incoherent signals, a similarly large contribution of coherent ITD information in glimpses to the spatial advantage was not observed. Rather, target speech intelligibility depended on the interaural coherence of the interfering speech signals. While the previous observation conforms with models of auditory object formation, and the latter is consistent with equalization-cancellation theory modeling the spatial advantage, the two seem to be at odds for the presented set of experiments. A conceptual framework employing different strategies to process the perceptual foreground and background may solve this issue.

Localization Uncertainty in Time-Amplitude Stereophonic Reproduction

This article studies the effects of inter-channel time and level differences in stereophonic reproduction on perceived localization uncertainty, which is defined as how difficult it is for a listener to tell where a sound source is located. Towards this end, a computational model of localization uncertainty is proposed first. The model calculates inter-aural time and level difference cues, and compares them to those associated to free-field point-like sources. The comparison is carried out using a particular distance functional that replicates the increased uncertainty observed experimentally with inconsistent inter-aural time and level difference cues. The model is validated by formal listening tests, achieving a Pearson correlation of 0.99. The model is then used to predict localization uncertainty for stereophonic setups and a listener in central and off-central positions. Results show that amplitude methods achieve a slightly lower localization uncertainty for a listener positioned exactly in the center of the sweet spot. As soon as the listener moves away from that position, the situation reverses, with time-amplitude methods achieving a lower localization uncertainty.

Spatial variation in signal and sensory precision both constrain auditory acuity at high frequencies

Sensory performance is constrained by the information in the stimulus and the precision of the involved sensory system(s). Auditory spatial acuity is robust across a broad range of sound frequencies and source locations, but declines at eccentric lateral angles. The basis of such variation is not fully understood. Low-frequency auditory spatial acuity is mediated by sensitivity to interaural time difference (ITD) cues. While low-frequency spatial acuity varies across azimuth and some physiological models predict strong medial bias in the precision of ITD sensitivity, human psychophysical ITD sensitivity appears to vary only slightly with reference ITD magnitude. Correspondingly, recent analyses suggest that spatial variation in human low-frequency acuity is well-accounted for by acoustic factors alone. Here we examine the matter of high-frequency auditory acuity, which is mediated by sensitivity to interaural level difference (ILD) cues. Using two different psychophysical tasks in human subjects, we demonstrate decreasing ILD acuity with increasing ILD magnitude. We then demonstrate that the multiplicative combination of spatially variant sensory precision and physical cue information (local slope of the ILD cue) provides improved prediction of classic high-frequency spatial acuity data. Finally, we consider correlates of magnitude dependent acuity in neurons that are sensitive to ILDs.

Realtime Active Sound Source Localization for Unmanned Ground Robots Using a Self-Rotational Bi-Microphone Array

This work presents a novel technique that performs both orientation and distance localization of a sound source in a three-dimensional (3D) space using only the interaural time difference (ITD) cue, generated by a newly-developed self-rotational bi-microphone robotic platform. The system dynamics is established in the spherical coordinate frame using a state-space model. The observability analysis of the state-space model shows that the system is unobservable when the sound source is placed with elevation angles of $90$ and $0$ degree. The proposed method utilizes the difference between the azimuth estimates resulting from respectively the 3D and the two-dimensional models to check the zero-degree-elevation condition and further estimates the elevation angle using a polynomial curve fitting approach. Also, the proposed method is capable of detecting a $90$-degree elevation by extracting the zero-ITD signal 'buried' in noise. Additionally, a distance localization is performed by first rotating the microphone array to face toward the sound source and then shifting the microphone perpendicular to the source-robot vector by a predefined distance of a fixed number of steps. The integrated rotational and translational motions of the microphone array provide a complete orientation and distance localization using only the ITD cue. A novel robotic platform using a self-rotational bi-microphone array was also developed for unmanned ground robots performing sound source localization. The proposed technique was first tested in simulation and was then verified on the newly-developed robotic platform. Experimental data collected by the microphones installed on a KEMAR dummy head were also used to test the proposed technique. All results show the effectiveness of the proposed technique.