Auditory Recognition Research Articles

Shape Recognition With Sounds: Improvement in Sighted Individuals After Audio-Motor Training.

Recent studies have demonstrated that audition used to complement or substitute visual feedback is effective in conveying spatial information, e.g., sighted individuals can understand the curvature of a shape when solely auditory input is provided. Recently we also demonstrated that, in the absence of vision, auditory feedback of body movements can enhance spatial perception in visually impaired adults and children. In the present study, we assessed whether sighted adults can also improve their spatial abilities related to shape recognition with an audio-motor training based on the idea that the coupling of auditory and motor information can further refine the representation of space when vision is missing. Auditory shape recognition was assessed in 22 blindfolded sighted adults with an auditory task requiring participants to identify four shapes by means of the sound conveyed through a set of consecutive loudspeakers embedded on a fixed two-dimensional vertical array. We divided participants into two groups of 11 adults each, performing a training session in two different modalities: active audio-motor training (experimental group) and passive auditory training (control group). The audio-motor training consisted in the reproduction of specific movements with the arm by relying on the sound produced by an auditory source positioned on the wrist of participants. Results showed that sighted individuals improved the recognition of auditory shapes only after active training, suggesting that audio-motor feedback can be an effective tool to enhance spatial representation when visual information is lacking.

Semantic priming effects can be modulated by crosslinguistic interactions during second-language auditory word recognition

AbstractThe current study investigates how second languageauditoryword recognition, in early and highly proficient Spanish–Basque (L1-L2) bilinguals, is influenced by crosslinguistic phonological-lexical interactions and semantic priming. Phonological overlap between a word and its translation equivalent (phonological cognate status), and semantic relatedness of a preceding prime were manipulated. Experiment 1 examined word recognition performance in noisy listening conditions that introduce a high degree of uncertainty, whereas Experiment 2 employed clear listening conditions, with low uncertainty. Under noisy listening conditions, semantic priming effects interacted with phonological cognate status: for word recognition accuracy, a related prime overcame inhibitory effects of phonological overlap between target words and their translations. These findings are consistent with models of bilingual word recognition that incorporate crosslinguistic phonological-lexical-semantic interactions. Moreover, they suggest an interplay between L2-L1 interactions and the integration of information across acoustic and semantic levels of processing in flexibly mapping the speech signal onto the spoken words, under adverse listening conditions.

Auditory recognition of Persian digits in presence of speech-spectrum noise and multi-talker babble: a validation study

Background and Aim: Digits are suitable speech materials for evaluating recognition of speech-in-noise in clients with the wide range of language abilities. Farsi Auditory Recognition of Digit-in-Noise (FARDIN) test has been deve­loped and validated in learning-disabled child­ren showing dichotic listening deficit. This stu­dy was conducted for further validation of FARDIN and to survey the effects of noise type on the recognition performance in individuals with sensory-neural hearing impairment. Methods: Persian monosyllabic digits 1−10 were extracted from the audio file of FARDIN test. Ten lists were compiled using a random order of the triplets. The first five lists were mixed with multi-talker babble noise (MTBN) and the second five lists with speech-spectrum noise (SSN). Signal- to- noise ratio (SNR) var­ied from +5 to −15 in 5 dB steps. 20 normal hearing and 19 hearing-impaired individuals participated in the current study. Results: Both types of noise could differentiate the hearing loss from normal hearing. Hearing-impaired group showed weaker performance for digit recognition in MTBN and SSN and needed 4−5.6 dB higher SNR (50%), compared to the normal hearing group. MTBN was more challenging for normal hearing than SSN. Conclusion: Farsi Auditory Recognition of Digit-in-Noise is a validated test for estimating SNR (50%) in clients with hearing loss. It seems SSN is more appropriate for using as a back­ground noise for testing the performance of aud­itory recognition of digit-in-noise. Keywords: Auditory recognition; hearing loss; speech perception in noise; digit recognition in noise

Repetition effects in auditory and visual recognition

Repetition manipulations are robust ways of manipulating levels of memory performance, but are not without exception. A recent paper (Kassim, Rehman, & Price, 2018) found effects of repetition on visual and multi-modal recognition but not on auditory recognition in a continuous recognition task. We aimed to replicate and generalize this result by testing continuous recognition in three experiments and in a standard old/new recognition in a fourth experiment. Experiment 1 showed that repetition did affect auditory recognition in a continuous recognition task, but to a lesser extent than visual recognition. Experiment 2 demonstrated that the difference in repetition effects between auditory and visual modalities was due to a speed/accuracy tradeoff in the visual recognition condition; when reaction times were similar in the visual and auditory conditions repetition effects were the same in the two modalities. Experiment 3 replicated the repetition effects when performance was lower than in Experiments 1 and 2. Experiment 4 showed that repetition affected both auditory and visual recognition in an old/new recognition task, and to approximately the same extent. Thus, while evidence has suggested that auditory recognition is more difficult than visual recognition, it may depend on the types of stimuli and the type of test. Overall, the mechanics of auditory and visual recognition for words appear to be similar in that they are affected by repetition in similar ways.

The Rapid Emergence of Auditory Object Representations in Cortex Reflect Central Acoustic Attributes.

Human listeners are bombarded by acoustic information that the brain rapidly organizes into coherent percepts of objects and events in the environment, which aids speech and music perception. The efficiency of auditory object recognition belies the critical constraint that acoustic stimuli necessarily require time to unfold. Using magnetoencephalography, we studied the time course of the neural processes that transform dynamic acoustic information into auditory object representations. Participants listened to a diverse set of 36 tokens comprising everyday sounds from a typical human environment. Multivariate pattern analysis was used to decode the sound tokens from the magnetoencephalographic recordings. We show that sound tokens can be decoded from brain activity beginning 90 msec after stimulus onset with peak decoding performance occurring at 155 msec poststimulus onset. Decoding performance was primarily driven by differences between category representations (e.g., environmental vs. instrument sounds), although within-category decoding was better than chance. Representational similarity analysis revealed that these emerging neural representations were related to harmonic and spectrotemporal differences among the stimuli, which correspond to canonical acoustic features processed by the auditory pathway. Our findings begin to link the processing of physical sound properties with the perception of auditory objects and events in cortex.

An Intelligent System for Grinding Wheel Condition Monitoring Based on Machining Sound and Deep Learning

Immediate monitoring of the conditions of the grinding wheel during the grinding process is important because it directly affects the surface accuracy of the workpiece. Because the variation in machining sound during the grinding process is very important for the field operator to judge whether the grinding wheel is worn or not, this study applies artificial intelligence technology to attempt to learn the experiences of auditory recognition of experienced operators. Therefore, we propose an intelligent system based on machining sound and deep learning to recognize the grinding wheel condition. This study uses a microphone embedded in the grinding machine to collect audio signals during the grinding process, and extracts the most discriminated feature from spectrum analysis. The features will be input the designed CNNs architecture to create a training model based on deep learning for distinguishing different conditions of the grinding wheel. Experimental results show that the proposed system can achieve an accuracy of 97.44%, a precision of 98.26% and a recall of 96.59% from 820 testing samples.

Context Effect on L2 Word Recognition: Visual Versus Auditory Modalities.

This study tested the effect of constraining sentence context on word recognition time (RT) in the first and second language. Native (L1) and nonnative (L2) speakers of English performed self-paced reading and listening tasks to see whether a semantically-rich preceding context would lead to the activation of a probable upcoming word prior to encountering it. The pre-access prediction model (e.g., Altmann and Kamide in Cognition 73(3):247-264, 1999; McClelland and Rumelhart in Psychol Rev 88:375-407, 1981) posits that when the preceding context is semantically high-constraining, the perceptual system anticipates a probable upcoming word prior to encountering it. In contrast, the post-access model (e.g., Fodor in The modularity of mind, MIT Press, Cambridge, 1983; Forster in Q J Exp Psychol Sect A 33(4):465-495, 1981; Traxler et al. in J Psycholinguist Res 29(6):581-595, 2000; Van Petten and Luka in Int J Psychophysiol 83(2): 176-190, 2012) suggests that it is only after a word is encountered that a subsequent process integrates it into the preceding context. The integration process is easier and faster when the word is more congruent with the preceding context. In line with these two models of visual word recognition, auditory word recognition is modeled by the TRACE model (McClelland and Elman in Cogn Psychol 18(1):1-86, 1986), which suggests that a spoken word is influenced by the preceding sentence context, whereas models such as the cohort model (Marslen-Wilson in Cognition 25(1-2):71-102, 1987) support a post-access integration process. Some studies observe a facilitative effect of sentence context on L2 word recognition (e.g., Kamide et al. in J Mem Lang 49(1):133-156, 2003), while others find no effect of sentence context in L2 (e.g., Ito et al. in Lang Cogn Neurosci 32(8):954-965, 2017; Martin et al. in J Mem Lang 69(4):574-588, 2013). In the present experiments, the RTs of native English speakers (L1) and non-native English speakers (L2) were collected in both visual and auditory word recognition in semantically high-constraint sentences and semantically low-constraint sentences. A linear, mixed-effects model shows that both groups of participants are faster to recognize a word when it is preceded by a semantically high-constraining context. This result is observed in both the visual and the auditory modalities, lending some support for a mechanism facilitating the access of target words based on sentence context in both L1 and L2.

Eye-closure & the retrieval of item-specific information in recognition memory.

Two experiments investigated the effect of eye-closure on visual and auditory memory under conditions based on the retrieval of item-specific information. Experiment 1 investigated visual recognition memory for studied, perceptually similar and unrelated items. It was found that intermittent eye-closure increased memory for studied items and decreased memory for related items. This finding was reflected by enhanced item-specific and reduced gist memory. Experiment 2 used the Deese-Roediger-McDermott (DRM) paradigm to assess auditory recognition memory for studied, related and unrelated words that had (vs. had not) been accompanied by pictures during encoding. Pictures but not eye-closure produced a picture superiority effect by enhancing memory for studied items. False memory was reduced by pictures but not eye-closure. Methodological and theoretical considerations are discussed in relation to existing explanations of eye-closure and retrieval strategies.

Morphological sensitivity generalizes across modalities

Abstract A growing body of psycholinguistic research suggests that visual and auditory word recognition involve morphological decomposition: Individual morphemes are extracted and lexically accessed when participants are presented with multi-morphemic stimuli. This view is supported by the Morpheme Interference Effect (MIE), where responses to pseudowords that contain real morphemes are slower and less accurate than responses to pseudowords that contain invented morphemes. The MIE was previously demonstrated primarily for visually presented stimuli. Here, we examine whether individuals’ sensitivity to morphological structure generalizes across modalities. Participants performed a lexical decision task on visually and auditorily presented Hebrew stimuli, including pseudowords derived from real or invented roots. The results show robust MIEs in both modalities. We further show that visual MIE is consistently stronger than auditory MIE, both at the group level and at the individual level. Finally, the data show a significant correlation between visual and auditory MIEs at the individual level. These findings suggest that the MIE reflects a general sensitivity to morphological structure, which varies considerably across individuals, but is largely consistent across modalities within individuals. Thus, we propose that the MIE captures an important aspect of language processing, rather than a property specific to visual word recognition.

Improvements in the Recognition of Sounds after Presentation during Sleep

The effect of targeted memory reactivation during sleep on auditory recognition remains unstudied. We report here our verification that the recognition of sounds which are difficult to discriminate can be improved by repeat presentation during daytime sleep following training. After two sequential sessions of recognizing one of two deviant sounds in the oddball paradigm, subjects of the study group were presented with one of the recognized deviants in sleep stage 3 (slow-wave sleep, SWS). The control group was presented with a novel deviant during sleep, which had not been presented for recognition. After sleep, the study group showed significant improvement in the recognition of sounds presented during SWS, which was accompanied by an increase in the amplitude and a decrease in the latency of the mismatch negativity (MMN) component of the event-related potential. The control group showed no significant differences in discriminating sounds or in MMN parameters after sleep. Our data provide evidence that targeted reactivation of sound memory during sleep promotes the neuroplastic rearrangements underlying learning sound recognition.

Categorical processing of fast temporal sequences in the guinea pig auditory brainstem

Discrimination of temporal sequences is crucial for auditory object recognition, phoneme categorization and speech understanding. The present study shows that auditory brainstem responses (ABR) to pairs of noise bursts separated by a short gap can be classified into two distinct groups based on the ratio of gap duration to initial noise burst duration in guinea pigs. If this ratio was smaller than 0.5, the ABR to the trailing noise burst was strongly suppressed. On the other hand, if the initial noise burst duration was short compared to the gap duration (a ratio greater than 0.5), a release from suppression and/or enhancement of the trailing ABR was observed. Consequently, initial noise bursts of shorter duration caused a faster transition between response classes than initial noise bursts of longer duration. We propose that the described findings represent a neural correlate of subcortical categorical preprocessing of temporal sequences in the auditory system.

A Novel EEG-Based Four-Class Linguistic BCI.

In this work, we present a novel EEG-based Linguistic BCI, which uses the four phonemic structures "BA", "FO", "LE", and "RY" as covert speech task classes. Six neurologically healthy volunteers with the age range of 19-37 participated in this experiment. Participants were asked to covertly speak a phonemic structure when they heard an auditory cue. EEG was recorded with 64 electrodes at 2048 samples/s. The duration of each trial is 312ms starting with the cue. The BCI was trained using a mixed randomized recording run containing 15 trials per class. The BCI is tested by playing a simple game of "Wack a mole" containing 5 trials per class presented in random order. The average classification accuracy for the 6 users is 82.5%. The most valuable features emerge after Auditory cue recognition (~100ms post onset), and within the 70-128 Hz frequency range. The most significant identified brain regions were the Prefrontal Cortex (linked to stimulus driven executive control), Wernicke's area (linked to Phonological code retrieval), the right IFG, and Broca's area (linked to syllabification). In this work, we have only scratched the surface of using Linguistic tasks for BCIs and the potential for creating much more capable systems in the future using this approach exists.

Gender differences in aphasia outcomes: evidence from the AphasiaBank.

Stroke is one of the leading causes of death in the United States. Aphasia is a language impairment which results as a consequence of stroke. Gender differences are reported in underlying mechanisms of stroke, however, gender differences in aphasia type and severity remain unclear. To examine gender differences in aphasia impairment based on data from AphasiaBank, a research repository of data obtained from studies of aphasia. The data were collected from AphasiaBank for 294 persons with aphasia (PWA) (172 men, 122 women). Baseline comparisons by gender groups were completed using independent samples t-tests and Pearson Chi square statistics. Univariate comparisons of the total Western Aphasia Battery-Revised (WAB-R) -AQ and -R subtests' scores were compared between the two groups using independent samples t-tests. Multivariate comparisons were completed by using multivariate analysis of variance (MANOVA). Gender differences were observed in the severity of aphasia with men exhibiting more severe aphasia than women. Analyses of WAB-R indicated greater impairment among men based on AQ and greater impairment was observed in individual subtest performance. Men exhibited statistically significantly lower WAB-R AQs than women (67.4 versus 75.6). Lower WAB-R AQs were derived from lower scores among men on individual subtests; information content, fluency, repetition, sentence completion, responsive speech and tests of comprehension (yes/no, auditory word recognition and sequential commands). This study offers evidence of gender differences in aphasia severity, global communication impairment and lower scores on individual subtests used to derive the WAB-R AQ. The limitations of the study with suggestions for future directions are presented.

Prediction of orthographic information during listening comprehension: A printed-word visual world study.

Two visual world eye-tracking experiments examined the role of orthographic information in the visual context in pre-activation of orthographic and phonological information using Japanese. Participants heard sentences that contained a predictable target word and viewed a display showing four words in a logogram, kanji (Experiment 1) or in a phonogram, hiragana (Experiment 2). The four words included either the target word (e.g., /sakana/; fish), an orthographic competitor (e.g., /tuno/; horn), a phonological competitor (e.g., /sakura/; cherry blossom), or an unrelated word (e.g., /hon/; book), together with three distractor words. The orthographic competitor was orthographically or phonologically dissimilar to the target in hiragana. In Experiment 1, target and orthographic competitor words attracted more fixations than unrelated words before the target word was mentioned, suggesting that participants pre-activated orthographic form of the target word. In Experiment 2, target and phonological competitor words attracted more predictive fixations than unrelated words, but orthographic competitor words did not, suggesting a critical role of the visual context. This pre-activation pattern does not fit with the pattern of lexical activation in auditory word recognition, where orthography and phonology interact. However, it is compatible with the pattern of lexical activation in spoken word production, where orthographic information is not automatically activated, in line with production-based prediction accounts.

The time course of auditory recognition measured with rapid sequences of short natural sounds

Human listeners are able to recognize accurately an impressive range of complex sounds, such as musical instruments or voices. The underlying mechanisms are still poorly understood. Here, we aimed to characterize the processing time needed to recognize a natural sound. To do so, by analogy with the “rapid visual sequential presentation paradigm”, we embedded short target sounds within rapid sequences of distractor sounds. The core hypothesis is that any correct report of the target implies that sufficient processing for recognition had been completed before the time of occurrence of the subsequent distractor sound. We conducted four behavioral experiments using short natural sounds (voices and instruments) as targets or distractors. We report the effects on performance, as measured by the fastest presentation rate for recognition, of sound duration, number of sounds in a sequence, the relative pitch between target and distractors and target position in the sequence. Results showed a very rapid auditory recognition of natural sounds in all cases. Targets could be recognized at rates up to 30 sounds per second. In addition, the best performance was observed for voices in sequences of instruments. These results give new insights about the remarkable efficiency of timbre processing in humans, using an original behavioral paradigm to provide strong constraints on future neural models of sound recognition.

Neural mechanisms of auditory species recognition in birds.

Auditory communication in humans and other animals frequently takes place in noisy environments with many co-occurring signallers. Receivers are thus challenged to rapidly recognize salient auditory signals and filter out irrelevant sounds. Most bird species produce a variety of complex vocalizations that function to communicate with other members of their own species and behavioural evidence broadly supports preferences for conspecific over heterospecific sounds (auditory species recognition). However, it remains unclear whether such auditory signals are categorically recognized by the sensory and central nervous system. Here, we review 53 published studies that compare avian neural responses between conspecific versus heterospecific vocalizations. Irrespective of the techniques used to characterize neural activity, distinct nuclei of the auditory forebrain are consistently shown to be repeatedly conspecific selective across taxa, even in response to unfamiliar individuals with distinct acoustic properties. Yet, species-specific neural discrimination is not a stereotyped auditory response, but is modulated according to its salience depending, for example, on ontogenetic exposure to conspecific versus heterospecific stimuli. Neuromodulators, in particular norepinephrine, may mediate species recognition by regulating the accuracy of neuronal coding for salient conspecific stimuli. Our review lends strong support for neural structures that categorically recognize conspecific signals despite the highly variable physical properties of the stimulus. The available data are in support of a 'perceptual filter'-based mechanism to determine the saliency of the signal, in that species identity and social experience combine to influence the neural processing of species-specific auditory stimuli. Finally, we present hypotheses and their testable predictions, to propose next steps in species-recognition research into the emerging model of the neural conceptual construct in avian auditory recognition.

Formation and decay of auditory short-term memory in the macaque monkey.

Echoic memory (EM) is a short-lived, precategorical, and passive form of auditory short-term memory (STM). A key hallmark of EM is its rapid exponential decay with a time constant between 1 and 2 s. It is not clear whether auditory STM in the rhesus, an important model system, shares this rapid exponential decay. To resolve this shortcoming, two rhesus macaques were trained to perform a delayed frequency discrimination task. Discriminability of delayed tones was measured as a function of retention duration and the number of times the standard had been repeated before the target. Like in the human, our results show a rapid decline of discriminability with retention duration. In addition, the results suggest a gradual strengthening of discriminability with repetition number. Model-based analyses suggest the presence of two components of auditory STM: a short-lived component with a time constant on the order of 550 ms that most likely corresponds to EM and a more stable memory trace with time constants on the order of 10 s that strengthens with repetition and most likely corresponds to auditory recognition memory. NEW & NOTEWORTHY This is the first detailed quantification of the rapid temporal dynamics of auditory short-term memory in the rhesus. Much of the auditory information in short-term memory is lost within the first couple of seconds. Repeated presentations of a tone strengthen its encoding into short-term memory. Model-based analyses suggest two distinct components: an echoic memory homolog that mediates the rapid decay and a more stable but less detail-rich component that mediates strengthening of the trace with repetition.

Spatiotemporal dynamics of auditory and picture naming-related high-gamma modulations: A study of Japanese-speaking patients

ObjectiveTo characterize the spatiotemporal dynamics of auditory and picture naming-related cortical activation in Japanese-speaking patients. MethodsTen patients were assigned auditory naming and picture naming tasks during extraoperative intracranial EEG recording in a tertiary epilepsy center. Time-frequency analysis determined at what electrode sites and at what time windows during each task the amplitude of high-gamma activity (65–95 Hz) was modulated. ResultsThe superior-temporal gyrus on each hemisphere showed high-gamma augmentation during sentence listening, whereas the left middle-temporal and inferior-frontal gyri showed high-gamma augmentation peaking around stimulus offset. Auditory naming-specific high-gamma augmentation was noted in the bilateral superior-temporal gyri as well as left frontal-parietal-temporal perisylvian network regions, whereas picture naming-specific augmentation was noted in the occipital-fusiform regions, bilaterally. The inferior pre- and postcentral gyri on each hemisphere showed modality-common high-gamma augmentation time-locked to overt responses. ConclusionsThe spatiotemporal dynamics of auditory and picture naming-related high-gamma augmentation in Japanese-speaking patients were qualitatively similar to those previously reported in studies of English-speaking patients. SignificanceThe cortical dynamics for auditory sentence recognition are at least partly shared by cohorts speaking two distinct languages. Multicenter studies regarding the clinical utility of high-gamma language mapping across Eastern and Western hemispheres may be feasible.

Closing eyes during auditory memory retrieval modulates alpha rhythm but does not alter tau rhythm

The alpha power increase that occurs when the eyes are closed is one of the most well-known effects in human electrophysiology. In particular, previous psychological studies have investigated whether eye closure can boost memory performance under certain circumstances, providing contradictory evidence across sensory input modalities. Although alpha power is modulated during different phases of memory and these modulations are correlated with performance, few studies have reported on the relationship between eye closure, memory, and alpha-band power. The present study investigates the influence of eye closure while participants (n = 21) performed an auditory recognition memory task with spoken words during the recording of magnetoencephalography (MEG) data. Our results showed no evidence for a behavioural effect of eye closure in the performance of the task. In addition, electrophysiological responses to the stimuli showed the expected alpha event-related desynchronization (ERD) 0.5–1 s and a high-alpha/beta event-related synchronization (ERS) 1–2 s after word onset. The data showed the expected memory effect, i.e. remembered words elicited greater 10 Hz ERD than forgotten words in the brain regions typically associated with the language network, suggesting a modulation of tau rhythm. Eye closure modulated alpha rhythm only in posterior-parietal and occipital regions. The lack of interaction and the different localizations found for modulations of tau and classical alpha rhythms suggests that these rhythms play distinct functional roles in memory performance.

T32. INTACT AUDITORY PERCEPTION IN INDIVIDUALS AT CLINICAL HIGH RISK FOR PSYCHOSIS

Basic perceptual processes are impaired in schizophrenia and may explain key social deficits such as the ability to identify emotions in other people. We recently reported widespread auditory impairments across multiple domains of auditory function in individuals with schizophrenia. Additionally, we found that these auditory impairments are associated with auditory emotion recognition deficits in patients with schizophrenia. These auditory deficits may be closely linked to the neural circuits relevant for the development of psychotic symptoms and thus may be useful predictors of psychosis onset and promising therapeutic targets. However, it is not yet known if basic auditory processing deficits are associated with the impaired emotional processing preceding the illness. We have assessed 25 individuals at clinical high-risk for psychosis and 42 healthy controls between the ages of 12 and 30 on a comprehensive battery of tasks spanning the four empirically derived domains of auditory function. We explored group differences across the battery of basic auditory tasks using between groups t-tests. We also explored the relationship between basic auditory processing and auditory emotion identification within the high-risk group using correlational analysis. We did not observe significant group differences in the ability to identify emotion in vocal samples or in basic auditory skills, with the exception of frequency discrimination, which was significantly better in high-risk subjects (Cohen’s =.67, p<.05). Additionally, none of the basic auditory skills correlated with emotion recognition in the high-risk group. Previous research has indicated widespread impairment of basic auditory skills in schizophrenia that is associated with difficulty understanding emotion from the vocal characteristics of a speaker. We investigated whether these impairments and correlations are present in individuals at high-risk for psychosis. We found no indication of impaired emotion recognition or basic auditory skills in high-risk individuals. Our results suggest that auditory impairment is not a characteristic of high-risk status and thus may emerge after psychosis onset.