Sound Source Localization Performance Research Articles

Sound-Source Localization Outcomes with Auditory Prostheses for Single-Sided Deafness: A Systematic Review (CINAHL).

Abstract The specific review questions to be addressed are: (1) For individuals with SSD, to what extent do available auditory prostheses provide improvement in sound-source localization performance (as measured by root-mean-square [rms] degree error)? (2) For individuals with SSD, is there an auditory prosthetic modality that provides significantly better improvement in sound-source localization performance (as measured by rms degree error)? (3) For individuals with SSD, to what extent do available auditory prostheses provide subjective improvement in sound-source localization (as measured by self-report questionnaire)?

Sound-Source Localization Outcomes with Auditory Prostheses for Single-Sided Deafness: A Systematic Review (Web of Science Core Collection).

Abstract The specific review questions to be addressed are: (1) For individuals with SSD, to what extent do available auditory prostheses provide improvement in sound-source localization performance (as measured by root-mean-square [rms] degree error)? (2) For individuals with SSD, is there an auditory prosthetic modality that provides significantly better improvement in sound-source localization performance (as measured by rms degree error)? (3) For individuals with SSD, to what extent do available auditory prostheses provide subjective improvement in sound-source localization (as measured by self-report questionnaire)?

Sound-Source Localization Outcomes with Auditory Prostheses for Single-Sided Deafness: A Systematic Review (Scopus).

Abstract The specific review questions to be addressed are: (1) For individuals with SSD, to what extent do available auditory prostheses provide improvement in sound-source localization performance (as measured by root-mean-square [rms] degree error)? (2) For individuals with SSD, is there an auditory prosthetic modality that provides significantly better improvement in sound-source localization performance (as measured by rms degree error)? (3) For individuals with SSD, to what extent do available auditory prostheses provide subjective improvement in sound-source localization (as measured by self-report questionnaire)?

Sound-Source Localization Outcomes with Auditory Prostheses for Single-Sided Deafness: A Systematic Review (PsycINFO).

Abstract The specific review questions to be addressed are: (1) For individuals with SSD, to what extent do available auditory prostheses provide improvement in sound-source localization performance (as measured by root-mean-square [rms] degree error)? (2) For individuals with SSD, is there an auditory prosthetic modality that provides significantly better improvement in sound-source localization performance (as measured by rms degree error)? (3) For individuals with SSD, to what extent do available auditory prostheses provide subjective improvement in sound-source localization (as measured by self-report questionnaire)?

Sound-Source Localization Outcomes with Auditory Prostheses for Single-Sided Deafness: A Systematic Review (MEDLINE, Ovid).

Abstract The specific review questions to be addressed are: (1) For individuals with SSD, to what extent do available auditory prostheses provide improvement in sound-source localization performance (as measured by root-mean-square [rms] degree error)? (2) For individuals with SSD, is there an auditory prosthetic modality that provides significantly better improvement in sound-source localization performance (as measured by rms degree error)? (3) For individuals with SSD, to what extent do available auditory prostheses provide subjective improvement in sound-source localization (as measured by self-report questionnaire)?

Sound-Source Localization Outcomes with Auditory Prostheses for Single-Sided Deafness: A Systematic Review (Embase).

Abstract The specific review questions to be addressed are: (1) For individuals with SSD, to what extent do available auditory prostheses provide improvement in sound-source localization performance (as measured by root-mean-square [rms] degree error)? (2) For individuals with SSD, is there an auditory prosthetic modality that provides significantly better improvement in sound-source localization performance (as measured by rms degree error)? (3) For individuals with SSD, to what extent do available auditory prostheses provide subjective improvement in sound-source localization (as measured by self-report questionnaire)?

Sound-Source Localization Outcomes with Auditory Prostheses for Single-Sided Deafness: A Systematic Review (Cochrane CENTRAL Trials).

Abstract The specific review questions to be addressed are: (1) For individuals with SSD, to what extent do available auditory prostheses provide improvement in sound-source localization performance (as measured by root-mean-square [rms] degree error)? (2) For individuals with SSD, is there an auditory prosthetic modality that provides significantly better improvement in sound-source localization performance (as measured by rms degree error)? (3) For individuals with SSD, to what extent do available auditory prostheses provide subjective improvement in sound-source localization (as measured by self-report questionnaire)?

Study on sound source localization inside a structure using a domain transfer model for real-world adaption of a trained model

Sound source localization (SSL) is important to reduce noise of products such as machinery and electrical appliances. Currently, SSL methods have been proposed that use the correlation of time-frequency signals of sound waves observed by multiple microphones. However, the application of these SSL methods are limited to the case where the acoustic signals can be directly observed. In the case of estimating the location of a sound source inside a structure from outside the structure, these methods are not applicable because the acoustic signal is observed as indirect sound. An SSL method using deep neural network (DNN) and computer-aided engineering (CAE) was proposed to estimate sound sources inside structures. This method successfully estimates the location of sound sources inside a structure from signals observed by accelerometers installed on the outer surface of the structure in both CAE and real domains. Nevertheless, the proposed method still has the challenge of adapting DNNs trained in CAE domain to real domain. In this research, deep convolution auto-encoder (DCAE) was used as a domain transformation model built from CAE and actual experimental data. DCAE contributed to the improvement of the SSL performance of the trained DNN over the baseline.

Algorithms with randomization-based acceleration strategies for sound source localization by non-synchronous measurements

The Non-Synchronous Measurements is an efficient technique to improve the acoustic image of conventional beamforming for sound source localization. It is unable to quickly reveal the sound sources of the large machinery which requires a large synthetic array with many microphones to capture enough sound pressure data. In this paper, four Non-Synchronous Measurement algorithms with improved computational efficiency are demonstrated. They are implemented by combining the Alternative Direction Method of Multipliers (ADMM) method with different randomization-based acceleration strategies. The new algorithms are developed firstly by (1) using Randomized Singular Value Decomposition (RSVD) to construct the projection basis, and then by (2) migrating the computation platform from the Central Processing Unit to the Graphics Processing Unit for the Cross-Spectral Matrix completion steps, (3) accelerating the soft threshold shrinkage operator with RSVD, or (4) replacing the soft threshold shrinkage with RSVD-enhanced optimal shrinkage in the Cross-Spectral Matrix completion steps. Numerical simulations are carried out under different conditions, including the number of sequential measurement positions, the step length between two sequential measurement positions, the frequency of the sound sources, and the Signal-to-Noise Ratio of the sound pressure signals measured by the microphones. The sound source localization performance of the improved algorithms is assessed by examining their acoustic maps, and the computational performance of these algorithms is compared through their Cross-Spectral Matrix reconstruction errors and time consumption.

Head‐related transfer function–reserved time‐frequency masking for robust binaural sound source localization

Various time-frequency (T-F) masks are being applied to sound source localization tasks. Moreover, deep learning has dramatically advanced T-F mask estimation. However, existing masks are usually designed for speech separation tasks and are suitable only for single-channel signals. A novel complex-valued T-F mask is proposed that reserves the head-related transfer function (HRTF), customized for binaural sound source localization. In addition, because the convolutional neural network that is exploited to estimate the proposed mask takes binaural spectral information as the input and output, accurate binaural cues can be preserved. Compared with conventional T-F masks that emphasize single speech source–dominated T-F units, HRTF-reserved masks eliminate the speech component while keeping the direct propagation path. Thus, the estimated HRTF is capable of extracting more reliable localization features for the final direction of arrival estimation. Hence, binaural sound source localization guided by the proposed T-F mask is robust under noisy and reverberant acoustic environments. The experimental results demonstrate that the new T-F mask is superior to conventional T-F masks and lead to the better performance of sound source localization in adverse environments.

Speech perception in noise and localization performance of digital noise reduction algorithm in hearing aids with ear-to-ear synchronization

Purpose: The present study aimed to compare speech perception in noise and horizontal localization with and without activating digital noise reduction (DNR) in hearing aids with and without an ear-to-ear synchronization. Materials and Methods: Twenty-five listeners with mild-to-moderate bilateral sensorineural hearing loss, aged between 18 and 55 years, were the participants. Each participant’s horizontal sound-source localization performance was measured as a root-mean-square degree of error. Speech recognition in the presence of speech babble noise was measured as the signal-to-noise ratio required for 50% recognition score (SNR-50). Further, SNR-50 was measured with noise source from four different directions and was recorded in four aided conditions, with and without an independent activation of wireless link and DNR. Results: Results showed that wireless synchronization technology in hearing aids improved localization and speech perception in noise under certain conditions. Adding the activation of DNR improved the overall performance in the horizontal sound-source localization task. However, the amount of improvement in speech perception in noise with the activation of wireless synchronization and/or DNR depended on the spatial separation between the direction of speech and the noise. Conclusions: The activation of DNR and wireless synchronization in hearing aids showed a better performance in assessed parameters in the current study. However, the improvement in scores may or may not be beneficial to the listener, depending on the direction of noise and speech.

DOANet: a deep dilated convolutional neural network approach for search and rescue with drone-embedded sound source localization

Drone-embedded sound source localization (SSL) has interesting application perspective in challenging search and rescue scenarios due to bad lighting conditions or occlusions. However, the problem gets complicated by severe drone ego-noise that may result in negative signal-to-noise ratios in the recorded microphone signals. In this paper, we present our work on drone-embedded SSL using recordings from an 8-channel cube-shaped microphone array embedded in an unmanned aerial vehicle (UAV). We use angular spectrum-based TDOA (time difference of arrival) estimation methods such as generalized cross-correlation phase-transform (GCC-PHAT), minimum-variance-distortion-less-response (MVDR) as baseline, which are state-of-the-art techniques for SSL. Though we improve the baseline method by reducing ego-noise using speed correlated harmonics cancellation (SCHC) technique, our main focus is to utilize deep learning techniques to solve this challenging problem. Here, we propose an end-to-end deep learning model, called DOANet, for SSL. DOANet is based on a one-dimensional dilated convolutional neural network that computes the azimuth and elevation angles of the target sound source from the raw audio signal. The advantage of using DOANet is that it does not require any hand-crafted audio features or ego-noise reduction for DOA estimation. We then evaluate the SSL performance using the proposed and baseline methods and find that the DOANet shows promising results compared to both the angular spectrum methods with and without SCHC. To evaluate the different methods, we also introduce a well-known parameter—area under the curve (AUC) of cumulative histogram plots of angular deviations—as a performance indicator which, to our knowledge, has not been used as a performance indicator for this sort of problem before.

Development of an auditory virtual reality system based on pre-computed B-format impulse responses for building design evaluation

This study presents an auditory virtual reality system which relies on pre-computed B-format impulse responses in a grid across the domain. Spatial information is encoded in the impulse responses by means of higher order Ambisonics and decoded to a virtual loudspeaker array, which follows the listener during run-time. The impulse responses are convolved with source signals, played back through the virtual loudspeaker array and synthesized for binaural headphone reproduction through head related transfer functions. This approach allows for a completely free movement and orientation of the listener in the virtual scene. Furthermore, it allows for the usage of highly accurate offline simulations of room impulse responses. The system is validated with two listening tests. First, the sound source localization performance in virtual reverberant rooms is tested while varying the order of Ambisonics, visuals and head movement. Second, the effects of the grid resolution on the perceived realism, sound source size and sound continuity are investigated. The results reveal that when using second order Ambisonics, together with visuals and allowing head movement, the localization error is very low, being less than one just-noticeable difference. Furthermore, when using a coarse grid, the perceptual sound source size is increased and spread out. Perceived realism and sound continuity are not significantly affected by the grid resolution. Two video files that show the proposed system in use are provided.

Azimuthal sound source localization of various sound stimuli under different conditions

AimTo evaluate azimuthal sound-source localization performance under different conditions, with a view to optimizing a routine sound localization protocol. Material and methodTwo groups of healthy, normal-hearing subjects were tested identically, except that one had to keep their head still while the other was allowed to turn it. Sound localization was tested without and then with a right ear plug (acute auditory asymmetry) for each of the following sound stimuli: pulsed narrow-band centered on 250Hz, continuous narrowband centered on 2000Hz, 4000Hz and 8000Hz, continuous 4000Hz warble, pulsed white noise, and word (“lac” (lake)). Root mean square error was used to calculate sound-source localization accuracy. ResultsWith fixed head, localization was significantly disturbed by the earplug for all stimuli (P<0.05). The most discriminating stimulus was continuous 4000Hz narrow-band: area under the ROC curve (AUC), 0.99 [95% CI, 0.95–1.01] for screening and 0.85 [0.82–0.89] for diagnosis. With mobile head, localization was significantly better than with fixed head for 4000 and 8000Hz stimuli (P<0.05). The most discriminating stimulus was continuous 2000Hz narrow-band: AUC, 0.90 [0.83–0.97] for screening and 0.75 [0.71–0.79] for diagnosis. In both conditions, pulsed noise (250Hz narrow-band, white noise or word) was less difficult to localize than continuous noise. ConclusionThe test was more sensitive with the head immobile. Continuous narrow-band stimulation centered on 4000Hz most effectively explored interaural level difference. Pulsed narrow-band stimulation centered on 250Hz most effectively explored interaural time difference. Testing with mobile head, closer to real-life conditions, was most effective with continuous narrow-band stimulation centered on 2000Hz.

Localization Performance Under Middle and Low Frequency Sound Source Based on Time Reversal Method in Enclosed Space

Multipath interference, reflection, sound absorption, and obstacles are important factors affect the sound source localization performance in enclosed space. Time reversal has the advantages of adaptive focusing, strong anti-reverberation capability, and the ability to overcome multipath effects, which are quite suitable for sound source localization in enclosed space due to its complex environment that many methods (e.g., beamforming, high-resolution spectral estimation, and the time delay of arrival) are not applicable. Therefore, this paper studies the localization performance under middle and low frequency sound sources cover single-frequency sinusoidal signal, bandwidth signal, and impulse signal through dual-channel matching based on time reversal method. When the frequency is below 1 kHz, the media’s absorption is generally negligible. Therefore, this paper only studies frequencies within 1 kHz. In this paper, numerical simulations are used to verify the feasibility of dual-channel matching under middle and low frequency sound sources in ordinary enclosed space. Then, actual experiments are conducted in an ordinary office on the case of different sound sources. The numerical simulation and experiment results show that dual-channel matching method has satisfying localization effect. The localization effect of medium frequency signal is superior to low frequency signal. Bandwidth signals have better localization effect than single-frequency sinusoidal signals, and steady state sound source has better localization effect than impulse sound source. In general, dual-channel matching method has strong robustness and applicability for sound source localization in enclosed space.

Fast and Robust RBF Neural Network Based on Global K-means Clustering with Adaptive Selection Radius for Sound Source Angle Estimation

The sound source localization technique is widely applied to target detection and localization. However, the application of conventional sound source localization methods is limited in actual environment because of estimation accuracy, computational complexity, and flexibility of the environment. In order to improve the sound source localization performance in actual environment, a fast and robust radial basis function (RBF) neural network based on global K-means clustering with adaptive selection radius is proposed in this paper. In the proposed method, an adaptive selection radius is calculated according to the population density sampling method to remove unnecessary points around cluster centers during the global K-means clustering; thus, compared with the conventional neural network, a fast optimization of hidden layer neuron parameters can be achieved. Afterward, the RBF neural network is trained to locate the sound source by solving nonlinear equations of the time difference of arrival and sound source location. Because of the adoption of adaptive selection radius in global K-means clustering, the proposed method can provide desirable performance with low computational complexity. Based on the simulated and actual experimental data, the proposed method is verified and an improved performance is achieved compared with that of conventional neural network sound source localization methods.

Sound Localization in Patients With Congenital Unilateral Conductive Hearing Loss With a Transcutaneous Bone Conduction Implant.

There is no consensus regarding the benefit of implantable hearing aids in congenital unilateral conductive hearing loss (UCHL). This study aimed to measure sound source localization performance in patients with congenital UCHL and contralateral normal hearing who received a new bone conduction implant. Evaluation of within-subject performance differences for sound source localization in a horizontal plane. Tertiary referral center. Five patients with atresia of the external auditory canal and contralateral normal hearing implanted with transcutaneous bone conduction implant at the Medical University of Vienna were tested. Activated/deactivated implant. Sound source localization test; localization performance quantified using the root mean square (RMS) error. Sound source localization ability was highly variable among individual subjects, with RMS errors ranging from 21 to 40 degrees. Horizontal plane localization performance in aided conditions showed statistically significant improvement compared with the unaided conditions, with RMS errors ranging from 17 to 27 degrees. The mean RMS error decreased by a factor of 0.71 (p < 0.001). Analysis revealed improved sound localization performance in a horizontal plane with the activated transcutaneous bone conduction implant. Some patients with congenital UCHL might be capable of developing improved horizontal plane localization abilities with the binaural cues provided by this device.

Sound Source Localization Using Joint Bayesian Estimation With a Hierarchical Noise Model

The performance of sound source localization is often reduced by the presence of colored noise in the environment, such as room reverberation. In this study, a method for estimating the noise spatial covariance using a hierarchical model is proposed and its performance is evaluated. By employing the hierarchical model in joint Bayesian estimation, robust estimation of the covariance is expected with a relatively small amount of data. Moreover, a method of jointly estimating the number of sources is introduced so that it can be used for cases in which the number of active sources dynamically changes, for example, speech signals. The results of the experiments performed using actual room reverberation show the effectiveness of the proposed method.

Sound source localization of filtered noises by listeners with normal hearing: A statistical analysis

Several measures of sound source localization performance of 45 listeners with normal hearing were obtained when loudspeakers were in the front hemifield. Localization performance was not statistically affected by filtering the 200-ms, 2-octave or wider noise bursts (125 to 500, 1500 to 6000, and 125 to 6000 Hz wide noise bursts). This implies that sound source localization performance for noise stimuli is not differentially affected by which interaural cue (interaural time or level difference) a listener with normal hearing uses for sound source localization, at least for relatively broadband signals. This sound source localization task suggests that listeners with normal hearing perform with high reliability/repeatability, little response bias, and with performance measures that are normally distributed with a mean root-mean-square error of 6.2° and a standard deviation of 1.79°.

Sound source localization: Bandwidth and envelope

Human listeners were asked to locate six sound sources separated by 15o in the right quarter field. Sound sources were located in a sound-deadened room (reverberation time &amp;lt;90 ms) at the height of the listener’s pinna 1.67 meters from the listener. In experiment 1, eight, 200-ms pure tones covering the frequency range from 250 to 7011 Hz were presented. In experiment 2, 200-ms noise bursts with different bandwidths (1/6, 1/3/, 1, and 2 octaves) at three center frequencies (250, 2000, and 4000 Hz) were presented. In experiment 3, 200-ms, 4000-Hz tones were presented with transposed envelopes with rates of 50, 100, 150, and 250 Hz. Several indicators of sound source localization performance were measured including root-mean-square (rms) error in degrees. RMS error decreased with increasing bandwidth from approximately 20 degrees for pure tones to approximately 6 degrees for 2-octave wide noises. RMS error depended on center frequency much more for narrow bandwidths than for broader bandwidths. RMS error decreased slightly from 50-Hz rate of modulation to 250-Hz rate of modulation. The data suggest that stimulus bandwidth is the primary variable effecting sound source localization performance in the free-field. [Research supported by an AFOSR Grant.]