Auditory Signal Processing Research Articles

DSP-Based Implementation and Optimization of Auditory Filter-Bank

The auditory filter-bank is the key component of auditory model, and its implementation involves a lot of computations. The time spent by an auditory filter-bank to finish its work has a significant effect on the real-time implementation of auditory model-based audio signal processing systems. In this paper, we give a brief introduction to the auditory filter-bank at the first, and then discuss its DSP-based implementation and optimization in details.

Does Tinnitus Annoyance Correlate to Auditory Brainsteam Responses?

Objectives: Tinnitus is more common in patients with some degree of hearing loss, but may be present in approximately 10-20% of people with normal hearing. There is evidence of involvement of the central auditory nervous system and interrelation with various parts of the nervous system, which may be involved in the mechanism of central processing of auditory signals. We aimed to analyze the annoyance of tinnitus in patients without hearing loss and to correlate the findings with auditory brainsteam response (ABR). Methods: We selected 84 patients with tinnitus and 47 patients without tinnitus, with ages ranging from 18 to 48 years old and hearing threshold less than or equal to 25 dB at frequencies between 500 and 8000Hz. We conducted the evaluation of tinnitus annoyance with the Tinnitus Handicap Inventory (THI), and examination of ABR. Results: Among the 84 patients in the study group, we found 35.7% of abnormal tests in at least one of the seven parameters tested, however, only the difference in the interaural wave V latency in patients with unilateral tinnitus was significant difference between the study and control group. Most patients in the study group had mild or very mild tinnitus. The discomfort of tinnitus showed no correlation with the results of ABR results. Conclusions: ABR results did not play a role in tinnitus annoyance in this study. It is important to investigate the role of anxiety and depression in the discomfort of tinnitus.

A Multi-Rate Implementation of Auditory Filter Bank

The auditory filter-bank is the key component of auditory model, and its implementation involves a lot of computations. The time spent by an auditory filter-bank to finish its work has a significant effect on the real-time implementation of auditory model-based audio signal processing systems. In this paper, a multi-rate implementation of auditory filter bank is presented. Through using low sampling rate for the filters with low centre frequency, and using high sampling rate for the filters with high centre frequency, we can greatly reduce the computation requirement.

Agnosia for accents in primary progressive aphasia

As an example of complex auditory signal processing, the analysis of accented speech is potentially vulnerable in the progressive aphasias. However, the brain basis of accent processing and the effects of neurodegenerative disease on this processing are not well understood. Here we undertook a detailed neuropsychological study of a patient, AA with progressive nonfluent aphasia, in whom agnosia for accents was a prominent clinical feature. We designed a battery to assess AA's ability to process accents in relation to other complex auditory signals. AA's performance was compared with a cohort of 12 healthy age and gender matched control participants and with a second patient, PA, who had semantic dementia with phonagnosia and prosopagnosia but no reported difficulties with accent processing. Relative to healthy controls, the patients showed distinct profiles of accent agnosia. AA showed markedly impaired ability to distinguish change in an individual's accent despite being able to discriminate phonemes and voices (apperceptive accent agnosia); and in addition, a severe deficit of accent identification. In contrast, PA was able to perceive changes in accents, phonemes and voices normally, but showed a relatively mild deficit of accent identification (associative accent agnosia). Both patients showed deficits of voice and environmental sound identification, however PA showed an additional deficit of face identification whereas AA was able to identify (though not name) faces normally. These profiles suggest that AA has conjoint (or interacting) deficits involving both apperceptive and semantic processing of accents, while PA has a primary semantic (associative) deficit affecting accents along with other kinds of auditory objects and extending beyond the auditory modality. Brain MRI revealed left peri-Sylvian atrophy in case AA and relatively focal asymmetric (predominantly right sided) temporal lobe atrophy in case PA. These cases provide further evidence for the fractionation of brain mechanisms for complex sound analysis, and for the stratification of progressive aphasia syndromes according to the signature of nonverbal auditory deficits they produce.

The computational prediction of masking thresholds for ecologically valid interference scenarios

Auditory interference scenarios, where a listener wishes to attend to some target audio while being presented with interfering audio, are prevalent in daily life. The goal of developing an accurate computational model which can predict masking thresholds for such scenarios is still incomplete. While some sophisticated, physiologically inspired, masking prediction models exist, they are rarely tested with ecologically valid programs (such as music and speech). In order to test the accuracy of model predictions human listener data is required. To that end a masking threshold experiment was conducted for a variety of target and interferer programs. The results were analyzed alongside predictions made by the computational auditory signal processing and prediction model described by Jepsen et al. (2008). Masking thresholds were predicted to within 3 dB root mean squared error with the greatest prediction inaccuracies occurring in the presence of speech. These results are comparable to those of the model by Glasberg and Moore (2005) for predicting the audibility of time-varying sounds in the presence of background sounds, which otherwise represent the most accurate predictions of this type in the literature.

Autocorrelation-based features for speech representation

This study investigates autocorrelation-based features as a potential basis for phonetic and syllabic distinctions. The work comes out of a theory of auditory signal processing based on central monaural autocorrelation and binaural crosscorrelation representations. Correlation-based features are used to predict monaural and binaural perceptual attributes that are important for the architectural acoustic design of concert halls: pitch, timbre, loudness, duration, reverberation-related coloration, sound direction, apparent source width, and envelopment (Ando, 1985, 1998; Ando and Cariani, 2009). The current study investigates the use of features of monaural autocorrelation functions (ACFs) for representing phonetic elements (vowels), syllables (CV pairs), and phrases using a small set of temporal factors extracted from the short-term running ACF. These factors include listening level (loudness), zero-lag ACF peak width (spectral tilt), τ1 (voice pitch period), φ1 (voice pitch strength), τe (effective duration of the ACF envelope, temporal repetitive continuity/contrast), segment duration, and Δφ1/Δt (the rate of pitch strength change, related to voice pitch attack-decay dynamics). Times at which ACF effective duration τe is minimal reflect rapid signal pattern changes that usefully demarcate segmental boundaries. Results suggest that vowels, CV syllables, and phrases can be distinguished on the basis of this ACF-derived feature set.

Activation patterns in the auditory association area involved in glottal stop perception

Abstract Objective Owing to the complexity of the human language, numerous individuals develop different types of speech disorders. Some patients with cleft lip and/or palate (CLP) exhibit compensatory misarticulations (CMAs), which decrease speech fluency and interfere with the intelligibility of the speaker. The glottal stop (GS) is representative of CMAs in CLP patients. The glottal stop results from an occlusion or lack of airflow at the level of the glottis. In the context of speech therapy for CLP patients, intelligibility is usually used as an outcome measure. However, little is known about the behavioral and neurobiological mechanisms involved in the perception of speech produced by an individual with CMAs. We aimed to investigate the perception of GS compared to normal articulation (NA) using behavioral and neuroimaging experiments. Materials and methods Twenty healthy subjects without CMAs listened to auditory stimuli (NA and GS) and were asked to distinguish NA from GS using the button-press response during functional magnetic resonance imaging (fMRI). Results The reaction time for the perception of GS was significantly longer than that for NA. Additionally, the activation area and the percentage signal change in the auditory cortex were larger when the subjects listened to GS compared to NA. The auditory association area, which controls the higher-level processing of auditory signals, exhibited more intense bilateral activation in response to GS as compared to NA. Conclusions In subjects without GS, the perception of GS sounds may require more auditory attention and more complex auditory processing than the perception of NA sounds.

Bilateral collicular interaction: Modulation of auditory signal processing in frequency domain

In the ascending auditory pathway, the inferior colliculus (IC) receives and integrates excitatory and inhibitory inputs from a variety of lower auditory nuclei, intrinsic projections within the IC, contralateral IC through the commissure of the IC and the auditory cortex. All these connections make the IC a major center for subcortical temporal and spectral integration of auditory information. In this study, we examine bilateral collicular interaction in the modulation of frequency-domain signal processing of mice using electrophysiological recording and focal electrical stimulation. Focal electrical stimulation of neurons in one IC produces widespread inhibition and focused facilitation of responses of neurons in the other IC. This bilateral collicular interaction decreases the response magnitude and lengthens the response latency of inhibited IC neurons but produces an opposite effect on the response of facilitated IC neurons. In the frequency domain, the focal electrical stimulation of one IC sharpens or expands the frequency tuning curves (FTCs) of neurons in the other IC to improve frequency sensitivity and the frequency response range. The focal electrical stimulation also produces a shift in the best frequency (BF) of modulated IC (ICMdu) neurons toward that of electrically stimulated IC (ICES) neurons. The degree of bilateral collicular interaction is dependent upon the difference in the BF between the ICES neurons and ICMdu neurons. These data suggest that bilateral collicular interaction is a part of dynamic acoustic signal processing that adjusts and improves signal processing as well as reorganizes collicular representation of signal parameters according to the acoustic experience.

Neural interactions in unilateral colliculus and between bilateral colliculi modulate auditory signal processing

In the auditory pathway, the inferior colliculus (IC) is a major center for temporal and spectral integration of auditory information. There are widespread neural interactions in unilateral (one) IC and between bilateral (two) ICs that could modulate auditory signal processing such as the amplitude and frequency selectivity of IC neurons. These neural interactions are either inhibitory or excitatory, and are mostly mediated by γ-aminobutyric acid (GABA) and glutamate, respectively. However, the majority of interactions are inhibitory while excitatory interactions are in the minority. Such unbalanced properties between excitatory and inhibitory projections have an important role in the formation of unilateral auditory dominance and sound location, and the neural interaction in one IC and between two ICs provide an adjustable and plastic modulation pattern for auditory signal processing.

Modeling within- and across-channel processes in comodulation masking release

The relative contributions of within-channel and across-channel processes to perceptual comodulation masking release (CMR) were investigated in the framework of an auditory processing model. A generalized version of the computational auditory signal processing and perception model [CASP; Jepsen et al., J. Acoust. Soc. Am. 124, 422-438 (2008)] was used and extended by an across-channel modulation processing stage according to Piechowiak et al. [J. Acoust. Soc. Am. 121, 2111-2126 (2007)]. Five experimental paradigms were considered: CMR with a broadband noise masker as a function of the masker spectrum level; CMR with four widely spaced flanking bands (FBs) varying in overall level; CMR with one FB varying in frequency and level relative to the on-frequency band (OFB); CMR with one FB varying in frequency; and CMR as a function of the number of FBs. The predictions suggest that at least three different mechanisms contribute to overall CMR in the considered conditions: (1) a within-channel process based on changes in the envelope characteristic due to the addition of the signal to the masker; (2) a within-channel process based on nonlinear peripheral processing of the OFB's envelope caused by the FB(s); and (3) an across-channel process that is robust across presentation levels but relatively small (2-5 dB).

Visual Input Modulates Audiomotor Function via Hypothalamic Dopaminergic Neurons through a Cooperative Mechanism

Visual cues often modulate auditory signal processing, leading to improved sound detection. However, the synaptic and circuit mechanism underlying this cross-modal modulation remains poorly understood. Using larval zebrafish, we first established a cross-modal behavioral paradigm in which a preceding flash enhances sound-evoked escape behavior, which is known to be executed through auditory afferents (VIII(th) nerves) and command-like neurons (Mauthner cells). In vivo recording revealed that the visual enhancement of auditory escape is achieved by increasing sound-evoked Mauthner cell responses. This increase in Mauthner cell responses is accounted for by the increase in the signal-to-noise ratio of sound-evoked VIII(th) nerve spiking and efficacy of VIII(th) nerve-Mauthner cell synapses. Furthermore, the visual enhancement of Mauthner cell response and escape behavior requires light-responsive dopaminergic neurons in the caudal hypothalamus and D1 dopamine receptor activation. Our findings illustrate a cooperative neural mechanism for visual modulation of audiomotor processing that involves dopaminergic neuromodulation.

Purinergic Modulation of Neuronal Activity in Developing Auditory Brainstem

In the developing nervous system, spontaneous neuronal activity arises independently of experience or any environmental input. This activity may play a major role in axonal pathfinding, refinement of topographic maps, dendritic morphogenesis, and the segregation of axonal terminal arbors. In the auditory system, endogenously released ATP in the cochlea activates inner hair cells to trigger bursts of action potentials (APs), which are transferred to the central auditory system. Here we show the modulatory role of purinergic signaling beyond the cochlea, i.e., the developmentally regulated and cell-type-specific depolarizing effects on auditory brainstem neurons of Mongolian gerbil. We assessed the effects of P2X receptors (P2XRs) on neuronal excitability from prehearing to early stages of auditory signal processing. Our results demonstrate that in neurons expressing P2XRs, extracellular ATP can evoke APs in sync with Ca(2+) signals. In cochlear nucleus (CN) bushy cells, ATP increases spontaneous and also acoustically evoked activity in vivo, but these effects diminish with maturity. Moreover, ATP not only augmented glutamate-driven firing, but it also evoked APs in the absence of glutamatergic transmission. In vivo recordings also revealed that endogenously released ATP in the CN contributes to neuronal firing activity by facilitating AP generation and prolonging AP duration. Given the enhancing effect of ATP on AP firing and confinement of P2XRs to certain auditory brainstem nuclei, and to distinct neurons within these nuclei, it is conceivable that purinergic signaling plays a specific role in the development of neuronal brainstem circuits.

Bilateral Collicular Interaction: Modulation of Auditory Signal Processing in Amplitude Domain

In the ascending auditory pathway, the inferior colliculus (IC) receives and integrates excitatory and inhibitory inputs from many lower auditory nuclei, intrinsic projections within the IC, contralateral IC through the commissure of the IC and from the auditory cortex. All these connections make the IC a major center for subcortical temporal and spectral integration of auditory information. In this study, we examine bilateral collicular interaction in modulating amplitude-domain signal processing using electrophysiological recording, acoustic and focal electrical stimulation. Focal electrical stimulation of one (ipsilateral) IC produces widespread inhibition (61.6%) and focused facilitation (9.1%) of responses of neurons in the other (contralateral) IC, while 29.3% of the neurons were not affected. Bilateral collicular interaction produces a decrease in the response magnitude and an increase in the response latency of inhibited IC neurons but produces opposite effects on the response of facilitated IC neurons. These two groups of neurons are not separately located and are tonotopically organized within the IC. The modulation effect is most effective at low sound level and is dependent upon the interval between the acoustic and electric stimuli. The focal electrical stimulation of the ipsilateral IC compresses or expands the rate-level functions of contralateral IC neurons. The focal electrical stimulation also produces a shift in the minimum threshold and dynamic range of contralateral IC neurons for as long as 150 minutes. The degree of bilateral collicular interaction is dependent upon the difference in the best frequency between the electrically stimulated IC neurons and modulated IC neurons. These data suggest that bilateral collicular interaction mainly changes the ratio between excitation and inhibition during signal processing so as to sharpen the amplitude sensitivity of IC neurons. Bilateral interaction may be also involved in acoustic-experience-dependent plasticity in the IC. Three possible neural pathways underlying the bilateral collicular interaction are discussed.

Interdisciplinary implications on autism, savantism, Asperger syndrome and the biophysical picture representation: Thinking in pictures

It seems that neurotypical individuals (people without autism) have a hidden ability for savant-like skills, and these special abilities can be accessible via top-down cortical disinhibition of the left fronto-temporal lobe by repetitive transcranial magnetic stimulation (rTMS). It is well known that enhanced visual function in striate and extrastriate areas is a common character in autists, savants and subjects with Asperger syndrome. In addition, visual cortex not only processes visual signals but also is involved in the processing of mathematical thinking and auditory signals among them. Here we argue about the essential (and more ancient) role of picture representation over linguistic representation in ASD and that extraordinary savant-like skills are due to the explicit predominance of the right hemisphere (a malfunction of top-down control processes) accompanied with prevalence of lower level detailed visual information in the right hemisphere. Our recently presented novel biophysical picture representation hypothesis (also called as intrinsic biophysical virtual visual reality) about visual perception and imagery is also briefly described and linked to the predominance of lower level and detailed visual representation in the right hemisphere that may be a common character in autism, savantism, and Asperger syndrome.

Modulation of thalamic auditory neurons by the primary auditory cortex

The central auditory system consists of the lemniscal and nonlemniscal pathways or systems, which are anatomically and physiologically different from each other. In the thalamus, the ventral division of the medial geniculate body (MGBv) belongs to the lemniscal system, whereas its medial (MGBm) and dorsal (MGBd) divisions belong to the nonlemniscal system. Lemniscal neurons are sharply frequency-tuned and provide highly frequency-specific information to the primary auditory cortex (AI), whereas nonlemniscal neurons are generally broadly frequency-tuned and project widely to cortical auditory areas including AI. These two systems are presumably different not only in auditory signal processing, but also in eliciting cortical plastic changes. Electric stimulation of narrowly frequency-tuned MGBv neurons evokes the shift of the frequency-tuning curves of AI neurons toward the tuning curves of the stimulated MGBv neurons (tone-specific plasticity). In contrast, electric stimulation of broadly frequency-tuned MGBm neurons augments the auditory responses of AI neurons and broadens their frequency-tuning curves (nonspecific plasticity). In our current studies, we found that electric stimulation of AI evoked tone-specific plastic changes of the MGBv neurons, whereas it degraded the frequency tuning of MGBm neurons by inhibiting their auditory responses. AI apparently modulates the lemniscal and nonlemniscal thalamic neurons in quite different ways. High MGBm activity presumably makes AI neurons less favorable for fine auditory signal processing, whereas high MGBv activity makes AI neurons more suitable for fine processing of specific auditory signals and reduces MGBm activity.

Thalamic Activation Modulates the Responses of Neurons in Rat Primary Auditory Cortex: An In Vivo Intracellular Recording Study

Auditory cortical plasticity can be induced through various approaches. The medial geniculate body (MGB) of the auditory thalamus gates the ascending auditory inputs to the cortex. The thalamocortical system has been proposed to play a critical role in the responses of the auditory cortex (AC). In the present study, we investigated the cellular mechanism of the cortical activity, adopting an in vivo intracellular recording technique, recording from the primary auditory cortex (AI) while presenting an acoustic stimulus to the rat and electrically stimulating its MGB. We found that low-frequency stimuli enhanced the amplitudes of sound-evoked excitatory postsynaptic potentials (EPSPs) in AI neurons, whereas high-frequency stimuli depressed these auditory responses. The degree of this modulation depended on the intensities of the train stimuli as well as the intervals between the electrical stimulations and their paired sound stimulations. These findings may have implications regarding the basic mechanisms of MGB activation of auditory cortical plasticity and cortical signal processing.

Preliminary studies on differential expression of auditory functional genes in the brain after repeated blast exposures

The mechanisms of central auditory processing involved in auditory/vestibular injuries and subsequent tinnitus and hearing loss in Active Duty servicemembers exposed to blast are not currently known. We analyzed the expression of hearing-related genes in different regions of the brain 6 h after repeated blast exposures in mice. Preliminary data showed that the expression of the deafness-related genes otoferlin and otoancorin was significantly changed in the hippocampus after blast exposures. Differential expression of cadherin and protocadherin genes, which are involved in hearing impairment, was observed in the hippocampus, cerebellum, frontal cortex, and midbrain after repeated blasts. A series of calcium-signaling genes that are known to be involved in auditory signal processing were also found to be significantly altered after repeated blast exposures. The hippocampus and midbrain showed significant increase in the gene expression of hearing loss-related antioxidant enzymes. Histopathology of the auditory cortex showed more significant injury in the inner layer compared to the outer layer. In summary, mice exposed to repeated blasts showed injury to the auditory cortex and significant alterations in multiple genes in the brain known to be involved in age- or noise-induced hearing impairment.

AUX: A scripting language for auditory signal processing and software packages for psychoacoustic experiments and education

This article introduces AUX (AUditory syntaX), a scripting syntax specifically designed to describe auditory signals and processing, to the members of the behavioral research community. The syntax is based on descriptive function names and intuitive operators suitable for researchers and students without substantial training in programming, who wish to generate and examine sound signals using a written script. In this article, the essence of AUX is discussed and practical examples of AUX scripts specifying various signals are illustrated. Additionally, two accompanying Windows-based programs and development libraries are described. AUX Viewer is a program that generates, visualizes, and plays sounds specified in AUX. AUX Viewer can also be used for class demonstrations or presentations. Another program, Psycon, allows a wide range of sound signals to be used as stimuli in common psychophysical testing paradigms, such as the adaptive procedure, the method of constant stimuli, and the method of adjustment. AUX Library is also provided, so that researchers can develop their own programs utilizing AUX. The philosophical basis of AUX is to separate signal generation from the user interface needed for experiments. AUX scripts are portable and reusable; they can be shared by other researchers, regardless of differences in actual AUX-based programs, and reused for future experiments. In short, the use of AUX can be potentially beneficial to all members of the research community—both those with programming backgrounds and those without.

Gender differences in bone conduction auditory signal processing: Communication equipment design implications

Previous research studies have suggested the possibility of gender differences in auditory processing for air conduction (AC) hearing. This study was designed to determine if the same gender differences are also present for bone conduction (BC) hearing and if the gender differences were dictated by the BC transducer location. Thirty participants (15 females and 15 males) ages 18 to 25 years participated in the hearing threshold study. Six frequencies (250, 500, 1000, 4000, 6000, and 8000 Hz) were tested at four bone vibrator locations (condyle, mastoid, vertex, and temple). Hearing thresholds for all conditions were measured and recorded and the BC hearing thresholds were compared to AC thresholds measured during prequalifying hearing tests. A B-72 bone vibrator was used to conduct the BC tests and Telephonics TDH-39P earphones were used for the AC tests. The results of this study suggest that females have significantly lower AC thresholds for the 8000 Hz signal only. The BC hearing analysis indicated that females had significantly better hearing thresholds at 6000 Hz and 8000 Hz. In addition, the location analysis indicated that the BC transducer location may also impact the threshold differences. For instance, in this study females had significantly better hearing thresholds for the 8000 Hz signal at the mastoid location only. Relevance to industry If organizations intend to utilize BC technology as a part of their communication systems, it is important that characteristics which impact signal perception be identified in order to develop the most effective communication devices for the user population.

Differentially Organized Top-Down Modulation of Prepulse Inhibition of Startle

Prepulse inhibition (PPI) of startle is the suppression of the startle reflex when a weaker sensory stimulus (the prepulse) shortly precedes the startling stimulus. PPI can be attentionally enhanced in both humans and laboratory animals. This study investigated whether the following three forebrain structures, which are critical for initial cortical processing of auditory signals, auditory fear conditioning/memories, and spatial attention, respectively, play a role in the top-down modulation of PPI in rats: the primary auditory cortex (A1), lateral nucleus of the amygdala (LA), and posterior parietal cortex (PPC). The results show that, under the noise-masking condition, PPI was enhanced by fear conditioning of the prepulse in a prepulse-specific manner, and the conditioning-induced PPI enhancement was further increased by perceptual separation between the conditioned prepulse and the noise masker. Reversibly blocking glutamate receptors in the A1 with 2 mm kynurenic acid eliminated both the conditioning-induced and perceptual separation-induced PPI enhancements. Blocking the LA eliminated the conditioning-induced but not the perceptual separation-induced PPI enhancement, and blocking the PPC specifically eliminated the perceptual separation-induced PPI enhancement. The two types of PPI enhancements were also eliminated by the extinction manipulation. Thus, the top-down modulation of PPI is differentially organized and depends on operations of various forebrain structures. Due to the fine-tuned modulation by higher-order cognitive processes, functions of PPI can be more flexible to complex environments. The top-down enhancements of PPI in rats are also useful for modeling some mental disorders, such as schizophrenia, attention deficit/hyperactivity disorder, and posttraumatic stress disorder.