Non-individualized Head-related Transfer Functions Research Articles

Spatial Release From Masking With Bilateral Bone Conduction Stimulation at Mastoid for Normal Hearing Subjects.

This study investigates the effect of spatial release from masking (SRM) in bilateral bone conduction (BC) stimulation at the mastoid. Nine adults with normal hearing were tested to determine SRM based on speech recognition thresholds (SRTs) in simulated spatial configurations ranging from 0 to 180 degrees. These configurations were based on nonindividualized head-related transfer functions. The participants were subjected to sound stimulation through either air conduction (AC) via headphones or BC. The results indicated that both the angular separation between the target and the masker, and the modality of sound stimulation, significantly influenced speech recognition performance. As the angular separation between the target and the masker increased up to 150°, both BC and AC SRTs decreased, indicating improved performance. However, performance slightly deteriorated when the angular separation exceeded 150°. For spatial separations less than 75°, BC stimulation provided greater spatial benefits than AC, although this difference was not statistically significant. For separations greater than 75°, AC stimulation offered significantly more spatial benefits than BC. When speech and noise originated from the same side of the head, the "better ear effect" did not significantly contribute to SRM. However, when speech and noise were located on opposite sides of the head, this effect became dominant in SRM.

Effect of Individualized Head-Related Transfer Functions on Distance Perception in Virtual Reproduction for a Nearby Sound Source

The head-related transfer function (HRTF) is dependent on the position of the sound source (both direction and distance) and is also affected by individual anatomical parameters. Individualized HRTFs have been shown to affect the perception of sound direction, but have not been considered in distance perception. This work aims to discover, by means of psychoacoustic experiments for a virtual reproduction system through a pair of in-ear headphones, the effect of individualized HRTF on auditory distance perception for a nearby sound source. The individualized HRTFs of six subjects and the non-individualized HRTFs of a mannequin at seven distances between 0.2 and 1.0 m and five lateral azimuths between 45X and 135X in the horizontal plane were processed with white noise to generate binaural signals. Further, the individualized and non-individualized HRTFs were used in the auditory distance perception experiments. Results of distance perception show that the variance of distance perception results among subjects is significant, the reason could be the stimuli are lack of dynamic cue and early reflections, or the auditory difference of distance perception among subjects. However, via the analyses of mean slope of perceptual distance and correlation between the perceptual and real distance, we find that the individualized HRTF cue has insignificant influence on distance perception.

A Bayesian model for human directional localization of broadband static sound sources

Humans estimate sound-source directions by combining prior beliefs with sensory evidence. Prior beliefs represent statistical knowledge about the environment, and the sensory evidence consists of auditory features such as interaural disparities and monaural spectral shapes. Models of directional sound localization often impose constraints on the contribution of these features to either the horizontal or vertical dimension. Instead, we propose a Bayesian model that flexibly incorporates each feature according to its spatial precision and integrates prior beliefs in the inference process. The model estimates the direction of a single, broadband, stationary sound source presented to a static human listener in an anechoic environment. We simplified interaural features to be broadband and compared two model variants, each considering a different type of monaural spectral features: magnitude profiles and gradient profiles. Both model variants were fitted to the baseline performance of five listeners and evaluated on the effects of localizing with non-individual head-related transfer functions (HRTFs) and sounds with rippled spectrum. We found that the variant equipped with spectral gradient profiles outperformed other localization models. The proposed model appears particularly useful for the evaluation of HRTFs and may serve as a basis for future extensions towards modeling dynamic listening conditions.

Spatial release of masking in children and adults in non-individualized virtual environments.

The spatial release of masking (SRM) is often measured in virtual auditory environments created from head-related transfer functions (HRTFs) of a standardized adult head. Adults and children, however, differ in head dimensions and mismatched HRTFs are known to affect some aspects of binaural hearing. So far, there has been little research on HRTFs in children and it is unclear whether a large mismatch of spatial cues can degrade speech perception in complex environments. In two studies, the effect of non-individualized virtual environments on SRM accuracy in adults and children was examined. The SRMs were measured in virtual environments created from individual and non-individualized HRTFs and the equivalent real anechoic environment. Speech reception thresholds (SRTs) were measured for frontal target sentences and symmetrical speech maskers at 0° or ±90° azimuth. No significant difference between environments was observed for adults. In 7 to 12-year-old children, SRTs and SRMs improved with age, with SRMs approaching adult levels. SRTs differed slightly between environments and were significantly worse in a virtual environment based on HRTFs from a spherical head. Adult HRTFs seem sufficient to accurately measure SRTs in children even in complex listening conditions.

Perceptual Impact on Localization Quality Evaluations of Common Pre-Processing for Non-Individual Head-Related Transfer Functions

Perceptual Impact on Localization Quality Evaluations of Common Pre-Processing for Non-Individual Head-Related Transfer Functions

Effects of Stimulation Position and Frequency Band on Auditory Spatial Perception with Bilateral Bone Conduction.

Virtual sound localization tests were conducted to examine the effects of stimulation position (mastoid, condyle, supra-auricular, temple, and bone-anchored hearing aid implant position) and frequency band (low frequency, high frequency, and broadband) on bone-conduction (BC) horizontal localization. Non-individualized head-related transfer functions were used to reproduce virtual sound through bilateral BC transducers. Subjective experiments showed that stimulation at the mastoid gave the best performance while the temple gave the worst performance in localization. Stimulation at the mastoid and condyle did not differ significantly from that using air-conduction (AC) headphones in localization accuracy. However, binaural reproduction at all BC stimulation positions led to similar levels of front-back confusion (FBC), which were also comparable to that with AC headphones. Binaural BC reproduction with high-frequency stimulation led to significantly higher localization accuracy than with low-frequency stimulation. When transcranial attenuation (TA) was measured, the attenuation became larger at the condyle and mastoid, and increased at high frequencies. The experiments imply that larger TAs may improve localization accuracy but do not improve FBC. The present study indicates that the BC stimulation at the mastoid and condyle can effectively convey spatial information, especially with high-frequency stimulation.

Can I trust my ears in VR? Head-related transfer functions and valuation methods with descriptive attributes in virtual reality

In this article, we present the current state of the art in binaural audio with the focus on head-related transfer functions (HRTFs) and valuation methods of virtual acoustics with descriptive attributes. This combination provides a methodology, which delivers the basis for research studies in virtual reality (VR) on individual and non-individual head-related transfer functions. Based on the largely explored localization perception of static audio signals, this review offers an overview of the directional hearing during head and sound source movement and multimodality in audiovisual virtual environments. Perceptual quality characteristics provide evaluation methods from which future HRTF VR experiments and virtual environments studies on binaural acoustics could benefit.

On the role of head rotation in solving the HRTF inverse problem

The sound arriving at the eardrum is a complex composition of the sound source spectrum, the acoustic properties of the listener’s environment, and the directionally dependent filtering of the listener’s head-related transfer function (HRTF). Listeners only ever have access to this mixture, and it remains unknown how they are nonetheless capable of disentangling features intrinsic to the sound source from those created by the source’s position in the environment. We hypothesized that head movements, by changing only the HRTF-related components of an arriving sound, inform a listener’s judgement of source spectrum. We tested this with virtual acoustics, presenting listeners with a speech sound rendered at an elevated frontal location and asked them to judge which of two subsequent copies of the same sound rendered at the horizon had spectral noise added to them. The test sounds were either head-locked, world-locked, or moved inverted to the listener’s movements, and were rendered with either individual or non-individual HRTFs. Error patterns across HRTF and motion conditions appear to confirm the hypothesis that head rotation plays a role in the estimation of sound source spectrum, and further indicate that listeners have expectations about how the signal at the ear should change as the head moves.

Impact of non-individualised head related transfer functions on speech-in-noise performances within a synthesised virtual environment.

When performing binaural spatialisation, it is widely accepted that the choice of the head related transfer functions (HRTFs), and in particular the use of individually measured ones, can have an impact on localisation accuracy, externalization, and overall realism. Yet the impact of HRTF choices on speech-in-noise performances in cocktail party-like scenarios has not been investigated in depth. This paper introduces a study where 22 participants were presented with a frontal speech target and two lateral maskers, spatialised using a set of non-individual HRTFs. Speech reception threshold (SRT) was measured for each HRTF. Furthermore, using the SRT predicted by an existing speech perception model, the measured values were compensated in the attempt to remove overall HRTF-specific benefits. Results show significant overall differences among the SRTs measured using different HRTFs, consistently with the results predicted by the model. Individual differences between participants related to their SRT performances using different HRTFs could also be found, but their significance was reduced after the compensation. The implications of these findings are relevant to several research areas related to spatial hearing and speech perception, suggesting that when testing speech-in-noise performances within binaurally rendered virtual environments, the choice of the HRTF for each individual should be carefully considered.

Investigation Into Consistency of Subjective and Objective Perceptual Selection of Non-individual Head-Related Transfer Functions

Investigation Into Consistency of Subjective and Objective Perceptual Selection of Non-individual Head-Related Transfer Functions

Head-related transfer function recommendation based on perceptual similarities and anthropometric features.

Individualization of head-related transfer functions (HRTFs) can improve the quality of binaural applications with respect to the localization accuracy, coloration, and other aspects. Using anthropometric features (AFs) of the head, neck, and pinna for individualization is a promising approach to avoid elaborate acoustic measurements or numerical simulations. Previous studies on HRTF individualization analyzed the link between AFs and technical HRTF features. However, the perceptual relevance of specific errors might not always be clear. Hence, the effects of AFs on perceived perceptual qualities with respect to the overall difference, coloration, and localization error are directly explored. To this end, a listening test was conducted in which subjects rated differences between their own HRTF and a set of nonindividual HRTFs. Based on these data, a machine learning model was developed to predict the perceived differences using ratios of a subject's individual AFs and those of presented nonindividual AFs. Results show that perceived differences can be predicted well and the HRTFs recommended by the models provide a clear improvement over generic or randomly selected HRTFs. In addition, the most relevant AFs for the prediction of each type of error were determined. The developed models are available under a free cultural license.

Usability of Individualized Head-Related Transfer Functions in Virtual Reality: Empirical Study With Perceptual Attributes in Sagittal Plane Sound Localization.

BackgroundIn order to present virtual sound sources via headphones spatially, head-related transfer functions (HRTFs) can be applied to audio signals. In this so-called binaural virtual acoustics, the spatial perception may be degraded if the HRTFs deviate from the true HRTFs of the listener.ObjectiveIn this study, participants wearing virtual reality (VR) headsets performed a listening test on the 3D audio perception of virtual audiovisual scenes, thus enabling us to investigate the necessity and influence of the individualization of HRTFs. Two hypotheses were investigated: first, general HRTFs lead to limitations of 3D audio perception in VR and second, the localization model for stationary localization errors is transferable to nonindividualized HRTFs in more complex environments such as VR.MethodsFor the evaluation, 39 subjects rated individualized and nonindividualized HRTFs in an audiovisual virtual scene on the basis of 5 perceptual qualities: localizability, front-back position, externalization, tone color, and realism. The VR listening experiment consisted of 2 tests: in the first test, subjects evaluated their own and the general HRTF from the Massachusetts Institute of Technology Knowles Electronics Manikin for Acoustic Research database and in the second test, their own and 2 other nonindividualized HRTFs from the Acoustics Research Institute HRTF database. For the experiment, 2 subject-specific, nonindividualized HRTFs with a minimal and maximal localization error deviation were selected according to the localization model in sagittal planes.ResultsWith the Wilcoxon signed-rank test for the first test, analysis of variance for the second test, and a sample size of 78, the results were significant in all perceptual qualities, except for the front-back position between own and minimal deviant nonindividualized HRTF (P=.06).ConclusionsBoth hypotheses have been accepted. Sounds filtered by individualized HRTFs are considered easier to localize, easier to externalize, more natural in timbre, and thus more realistic compared to sounds filtered by nonindividualized HRTFs.

HRTF Selection by Anthropometric Regression for Improving Horizontal Localization Accuracy

This work focuses on objective Head-Related Transfer Function (HRTF) selection from anthropometric measurements for minimizing localization error in the frontal half of the horizontal plane. Localization predictions for every pair of 90 subjects in the HUTUBS database are first computed through an interaural time difference-based auditory model, and an error metric based on the predicted lateral error is derived. A multiple stepwise linear regression model for predicting error from inter-subject anthropometric differences is then built on a subset of subjects and evaluated on a complementary test set. Results show that by using just three anthropometric parameters of the head and torso (head width, head depth, and shoulder circumference) the model is able to identify non-individual HRTFs whose predicted horizontal localization error generally lies below the localization blur. When using a lower number of anthropometric parameters, this result is not guaranteed.

Short-term effects of sound localization training in virtual reality

Head-related transfer functions (HRTFs) capture the direction-dependant way that sound interacts with the head and torso. In virtual audio systems, which aim to emulate these effects, non-individualized, generic HRTFs are typically used leading to an inaccurate perception of virtual sound location. Training has the potential to exploit the brain’s ability to adapt to these unfamiliar cues. In this study, three virtual sound localization training paradigms were evaluated; one provided simple visual positional confirmation of sound source location, a second introduced game design elements (“gamification”) and a final version additionally utilized head-tracking to provide listeners with experience of relative sound source motion (“active listening”). The results demonstrate a significant effect of training after a small number of short (12-minute) training sessions, which is retained across multiple days. Gamification alone had no significant effect on the efficacy of the training, but active listening resulted in a significantly greater improvements in localization accuracy. In general, improvements in virtual sound localization following training generalized to a second set of non-individualized HRTFs, although some HRTF-specific changes were observed in polar angle judgement for the active listening group. The implications of this on the putative mechanisms of the adaptation process are discussed.

Impoverished auditory cues limit engagement of brain networks controlling spatial selective attention

Spatial selective attention enables listeners to process a signal of interest in natural settings. However, most past studies on auditory spatial attention used impoverished spatial cues: presenting competing sounds to different ears, using only interaural differences in time (ITDs) and/or intensity (IIDs), or using non-individualized head-related transfer functions (HRTFs). Here we tested the hypothesis that impoverished spatial cues impair spatial auditory attention by only weakly engaging relevant cortical networks. Eighteen normal-hearing listeners reported the content of one of two competing syllable streams simulated at roughly +30° and −30° azimuth. The competing streams consisted of syllables from two different-sex talkers. Spatialization was based on natural spatial cues (individualized HRTFs), individualized IIDs, or generic ITDs. We measured behavioral performance as well as electroencephalographic markers of selective attention. Behaviorally, subjects recalled target streams most accurately with natural cues. Neurally, spatial attention significantly modulated early evoked sensory response magnitudes only for natural cues, not in conditions using only ITDs or IIDs. Consistent with this, parietal oscillatory power in the alpha band (8–14 ​Hz; associated with filtering out distracting events from unattended directions) showed significantly less attentional modulation with isolated spatial cues than with natural cues. Our findings support the hypothesis that spatial selective attention networks are only partially engaged by impoverished spatial auditory cues. These results not only suggest that studies using unnatural spatial cues underestimate the neural effects of spatial auditory attention, they also illustrate the importance of preserving natural spatial cues in assistive listening devices to support robust attentional control.

Spectral manipulation improves elevation perception with non-individualized head-related transfer functions.

Spatially rendering sounds using head-related transfer functions (HRTFs) is an important part of creating immersive audio experiences for virtual reality applications. However, elevation perception remains challenging when generic, non-personalized HRTFs are used. This study investigated whether digital audio effects applied to a generic set of HRTFs could improve sound localization in the vertical plane. Several of the tested effects significantly improved elevation judgment, and trial-by-trial variability in spectral energy between 2 and 10 kHz correlated strongly with perceived elevation. Digital audio effects may therefore be a promising strategy to improve elevation perception where personalized HRTFs are not available.

Auditory Accommodation to Poorly Matched Non-Individual Spectral Localization Cues Through Active Learning

This study examines the effect of adaptation to non-ideal auditory localization cues represented by the Head-Related Transfer Function (HRTF) and the retention of training for up to three months after the last session. Continuing from a previous study on rapid non-individual HRTF learning, subjects using non-individual HRTFs were tested alongside control subjects using their own measured HRTFs. Perceptually worst-rated non-individual HRTFs were chosen to represent the worst-case scenario in practice and to allow for maximum potential for improvement. The methodology consisted of a training game and a localization test to evaluate performance carried out over 10 sessions. Sessions 1–4 occurred at 1 week intervals, performed by all subjects. During initial sessions, subjects showed improvement in localization performance for polar error. Following this, half of the subjects stopped the training game element, continuing with only the localization task. The group that continued to train showed improvement, with 3 of 8 subjects achieving group mean polar errors comparable to the control group. The majority of the group that stopped the training game retained their performance attained at the end of session 4. In general, adaptation was found to be quite subject dependent, highlighting the limits of HRTF adaptation in the case of poor HRTF matches. No identifier to predict learning ability was observed.

Do We Need Individual Head-Related Transfer Functions for Vertical Localization? The Case Study of a Spectral Notch Distance Metric

This paper deals with the issue of individualizing the head-related transfer function (HRTF) rendering process for auditory elevation perception. Is it possible to find a nonindividual, personalized HRTF set that allows a listener to have an equally accurate localization performance than with his/her individual HRTFs? We propose a psychoacoustically motivated, anthropometry based mismatch function between HRTF pairs that exploits the close relation between the listener's pinna geometry and localization cues. This is evaluated using an auditory model that computes a mapping between HRTF spectra and perceived spatial locations. Results on a large number of subjects in the center for image processing and integrated computing (CIPIC) and acoustics research institute (ARI) HRTF databases suggest that there exists a nonindividual HRTF set, which allows a listener to have an equally accurate vertical localization than with individual HRTFs. Furthermore, we find the optimal parameterization of the proposed mismatch function, i.e., the one that best reflects the information given by the auditory model. Our findings show that the selection procedure yields statistically significant improvements with respect to dummy-head HRTFs or random HRTF selection, with potentially high impact from an applicative point of view.

Effect of sound level on virtual and free-field localization of brief sounds in the anterior median plane

The detection of high-frequency spectral notches has been shown to be worse at 70–80 dB sound pressure level (SPL) than at higher levels up to 100 dB SPL. The performance improvement at levels higher than 70–80 dB SPL has been related to an ‘ideal observer’ comparison of population auditory nerve spike trains to stimuli with and without high-frequency spectral notches. Insofar as vertical localization partly relies on information provided by pinna-based high-frequency spectral notches, we hypothesized that localization would be worse at 70–80 dB SPL than at higher levels. Results from a first experiment using a virtual localization set-up and non-individualized head-related transfer functions (HRTFs) were consistent with this hypothesis, but a second experiment using a free-field set-up showed that vertical localization deteriorates monotonically with increasing level up to 100 dB SPL. These results suggest that listeners use different cues when localizing sound sources in virtual and free-field conditions. In addition, they confirm that the worsening in vertical localization with increasing level continues beyond 70–80 dB SPL, the highest levels tested by previous studies. Further, they suggest that vertical localization, unlike high-frequency spectral notch detection, does not rely on an ‘ideal observer’ analysis of auditory nerve spike trains.

Use of non-individualized head-related transfer functions to measure spatial release from masking in children with normal hearing

Spatial hearing studies with children have typically been conducted using loudspeakers in laboratories. However, loudspeaker arrays are rare in clinics due to high cost and technical set-up requirements. The use of virtual auditory space (VAS) with non-individualized head-related transfer functions (HRTFs) can increase the feasibility of assessing spatial hearing abilities in clinical settings. A novel paradigm for measuring spatial release from masking (SRM) was developed using non-individualized HRTFs. This paradigm measures the minimum angular separation needed between target and masker to achieve a 20% increase in target speech intelligibility. First, the 50% speech reception threshold (SRT) was measured with target and masker co-located to one side. Then, the masker position was adaptively changed to achieve 70.7% intelligibility while maintaining the signal-to-noise ratio at the level of the co-located SRT. To verify the use of non-individualized HRTFs, normal-hearing children were tested (1) using a loudspeaker array and (2) in headphone-based VAS created using KEMAR HRTFs measured in the same setup as (1). Preliminary results showed that co-located SRTs and target-masker angle separation to achieve a 20% SRM were similar in loudspeaker array and in headphone-based VAS. This suggests that non-individualized HRTFs might be used in an SRM task for clinical testing.