Natural Auditory Stimuli Research Articles

Perceptual assessment of urban park audio-visual stimuli a comparison between Italian and Chinese groups

Previous research demonstrated a preference for natural auditory stimuli over human-made sounds in urban park environments. However, little attention has been given to the perceived dimensions of these sounds and their consistency across diverse cultural groups. The present study aimed at revealing possible culture differences among visual (Green, Square, Color) and auditory (Nature, Music, Anthropic) elements in urban parks. Eighty participants from both Chinese and Italian groups were administered a questionnaire to emotionally assess the stimuli. The differences in emotional salience were found across both sensory inputs. For the visual inputs, Green parks were perceived as more pleasant than Colorful parks, and the latter were more pleasant than Square parks, indicating the more natural the setting, the more restorative the effects. An important finding refers to the cross-culture consistency of the preferences. For the auditory inputs in urban parks, although both components of emotional salience were cross-culture consistent, some specific differences emerged.

Auditory salience using natural scenes: An online study.

Salience is the quality of a sensory signal that attracts involuntary attention in humans. While it primarily reflects conspicuous physical attributes of a scene, our understanding of processes underlying what makes a certain object or event salient remains limited. In the vision literature, experimental results, theoretical accounts, and large amounts of eye-tracking data using rich stimuli have shed light on some of the underpinnings of visual salience in the brain. In contrast, studies of auditory salience have lagged behind due to limitations in both experimental designs and stimulus datasets used to probe the question of salience in complex everyday soundscapes. In this work, we deploy an online platform to study salience using a dichotic listening paradigm with natural auditory stimuli. The study validates crowd-sourcing as a reliable platform to collect behavioral responses to auditory salience by comparing experimental outcomes to findings acquired in a controlled laboratory setting. A model-based analysis demonstrates the benefits of extending behavioral measures of salience to broader selection of auditory scenes and larger pools of subjects. Overall, this effort extends our current knowledge of auditory salience in everyday soundscapes and highlights the limitations of low-level acoustic attributes in capturing the richness of natural soundscapes.

Attentional disengagement from negative natural sounds for high-anxious individuals

ABSTRACTBackground and objectives: Previous studies have not consistently concluded whether high-anxious persons exhibit attentional bias towards negative natural auditory stimuli. The present study explores whether auditory negative stimuli could induce attentional bias to negative sounds in real life and investigates the exact nature of these biases using an emotional spatial cueing task.Design: Experimental study with a mixed factorial design.Method: We created two groups according to the state-trait anxiety scale, namely high and low trait anxiety. Participants (N = 68 undergraduate students) were required to respond to an auditory target after receiving a negative (aversive sounds from natural life) or neutral auditory stimuli.Results: A 2 (Validity: valid/invalid) × 2 (Cue Valence: negative/neutral) × 2 (Anxiety Group: LA/HA) repeated-measures ANOVA on reaction times revealed that participants with high trait anxiety exhibited slower reaction times in invalid trials following negative cues than following neutral cues. Higher levels of trait anxiety were associated with more difficult attentional disengagement from negative auditory information.Conclusions: The results demonstrate that impaired attentional disengagement was one of the mechanisms by which high-anxious participants exhibited auditory attentional bias to natural negative information.

Toward a reliable gaze-independent hybrid BCI combining visual and natural auditory stimuli

BackgroundBrain computer interfaces (BCIs) are one of the last communication options for patients in the locked-in state (LIS). For complete LIS patients, interfaces must be gaze-independent due to their eye impairment. However, unimodal gaze-independent approaches typically present levels of performance substantially lower than gaze-dependent approaches. The combination of multimodal stimuli has been pointed as a viable way to increase users’ performance.New method: A hybrid visual and auditory (HVA) P300-based BCI combining simultaneously visual and auditory stimulation is proposed. Auditory stimuli are based on natural meaningful spoken words, increasing stimuli discrimination and decreasing user's mental effort in associating stimuli to the symbols. The visual part of the interface is covertly controlled ensuring gaze-independency. ResultsFour conditions were experimentally tested by 10 healthy participants: visual overt (VO), visual covert (VC), auditory (AU) and covert HVA. Average online accuracy for the hybrid approach was 85.3%, which is more than 32% over VC and AU approaches. Questionnaires’ results indicate that the HVA approach was the less demanding gaze-independent interface. Interestingly, the P300 grand average for HVA approach coincides with an almost perfect sum of P300 evoked separately by VC and AU tasks.Comparison with existing methods: The proposed HVA–BCI is the first solution simultaneously embedding natural spoken words and visual words to provide a communication lexicon. Online accuracy and task demand of the approach compare favorably with state-of-the-art. ConclusionsThe proposed approach shows that the simultaneous combination of visual covert control and auditory modalities can effectively improve the performance of gaze-independent BCIs.

Dissociable neural response signatures for slow amplitude and frequency modulation in human auditory cortex.

Natural auditory stimuli are characterized by slow fluctuations in amplitude and frequency. However, the degree to which the neural responses to slow amplitude modulation (AM) and frequency modulation (FM) are capable of conveying independent time-varying information, particularly with respect to speech communication, is unclear. In the current electroencephalography (EEG) study, participants listened to amplitude- and frequency-modulated narrow-band noises with a 3-Hz modulation rate, and the resulting neural responses were compared. Spectral analyses revealed similar spectral amplitude peaks for AM and FM at the stimulation frequency (3 Hz), but amplitude at the second harmonic frequency (6 Hz) was much higher for FM than for AM. Moreover, the phase delay of neural responses with respect to the full-band stimulus envelope was shorter for FM than for AM. Finally, the critical analysis involved classification of single trials as being in response to either AM or FM based on either phase or amplitude information. Time-varying phase, but not amplitude, was sufficient to accurately classify AM and FM stimuli based on single-trial neural responses. Taken together, the current results support the dissociable nature of cortical signatures of slow AM and FM. These cortical signatures potentially provide an efficient means to dissect simultaneously communicated slow temporal and spectral information in acoustic communication signals.

A place for time: the spatiotemporal structure of neural dynamics during natural audition

We use functional magnetic resonance imaging (fMRI) to analyze neural responses to natural auditory stimuli. We characterize the fMRI time series through the shape of the voxel power spectrum and find that the timescales of neural dynamics vary along a spatial gradient, with faster dynamics in early auditory cortex and slower dynamics in higher order brain regions. The timescale gradient is observed through the unsupervised clustering of the power spectra of individual brains, both in the presence and absence of a stimulus, and is enhanced in the stimulus-locked component that is shared across listeners. Moreover, intrinsically faster dynamics occur in areas that respond preferentially to momentary stimulus features, while the intrinsically slower dynamics occur in areas that integrate stimulus information over longer timescales. These observations connect the timescales of intrinsic neural dynamics to the timescales of information processing, suggesting a temporal organizing principle for neural computation across the cerebral cortex.

Dynamics of electrocorticographic (ECoG) activity in human temporal and frontal cortical areas during music listening.

Previous studies demonstrated that brain signals encode information about specific features of simple auditory stimuli or of general aspects of natural auditory stimuli. How brain signals represent the time course of specific features in natural auditory stimuli is not well understood. In this study, we show in eight human subjects that signals recorded from the surface of the brain (electrocorticography (ECoG)) encode information about the sound intensity of music. ECoG activity in the high gamma band recorded from the posterior part of the superior temporal gyrus as well as from an isolated area in the precentral gyrus was observed to be highly correlated with the sound intensity of music. These results not only confirm the role of auditory cortices in auditory processing but also point to an important role of premotor and motor cortices. They also encourage the use of ECoG activity to study more complex acoustic features of simple or natural auditory stimuli.

Inferring the role of inhibition in auditory processing of complex natural stimuli

Intracellular studies have revealed the importance of cotuned excitatory and inhibitory inputs to neurons in auditory cortex, but typical spectrotemporal receptive field models of neuronal processing cannot account for this overlapping tuning. Here, we apply a new nonlinear modeling framework to extracellular data recorded from primary auditory cortex (A1) that enables us to explore how the interplay of excitation and inhibition contributes to the processing of complex natural sounds. The resulting description produces more accurate predictions of observed spike trains than the linear spectrotemporal model, and the properties of excitation and inhibition inferred by the model are furthermore consistent with previous intracellular observations. It can also describe several nonlinear properties of A1 that are not captured by linear models, including intensity tuning and selectivity to sound onsets and offsets. These results thus offer a broader picture of the computational role of excitation and inhibition in A1 and support the hypothesis that their interactions play an important role in the processing of natural auditory stimuli.

Multisensory Integration of Natural Odors and Sounds in the Auditory Cortex

Motherhood is associated with different forms of physiological alterations including transient hormonal changes and brain plasticity. The underlying impact of these changes on the emergence of maternal behaviors and sensory processing within the mother's brain are largely unknown. By using invivo cell-attached recordings in the primary auditory cortex of female mice, we discovered that exposure to pups' body odor reshapes neuronal responses to pure tones and natural auditory stimuli. This olfactory-auditory interaction appeared naturally in lactating mothers shortly after parturition and was long lasting. Naive virgins that had experience with the pups also showed an appearance of olfactory-auditory integration in A1, suggesting that multisensory integration may be experience dependent. Neurons from lactating mothers were more sensitive to sounds as compared to those from experienced mice, independent of the odor effects. These uni- and multisensory cortical changes may facilitate the detection and discrimination of pup distress calls and strengthen the bond between mothers and their neonates.

Differential Responsiveness of Great Tit Nestlings, Parus major, to Natural Auditory Stimuli

In one field and two laboratory experiments, wild, wild-captured and partly laboratory-raised 16 to 18-day old great tit nestlings were subjected to repeated presentations of auditory stimuli of varying biological significance. The frequency of occurrence of the stimuli in the study area was censused. — All nestlings showed strong aversive reactions to the ‘seeet’ alarm-call of the species. It is concluded that a selective responsiveness to this call develops independently of previous exposure to it. A functional interpretation of this reaction is derived from its presumed adaptive value. Three hypothetical interpretations are suggested to explain its emergence in the individual nestling; The ‘seeet’-call elicits aversive reactions because of, 1) its novelty, 2) its intensity in terms of relative concentration of energy over its frequency range and 3) its contrasting acoustic structure compared to the nestlings' begging-call which has become strongly associated with approach behavior.

Rapid Synaptic Depression Explains Nonlinear Modulation of Spectro-Temporal Tuning in Primary Auditory Cortex by Natural Stimuli

In this study, we explored ways to account more accurately for responses of neurons in primary auditory cortex (A1) to natural sounds. The auditory cortex has evolved to extract behaviorally relevant information from complex natural sounds, but most of our understanding of its function is derived from experiments using simple synthetic stimuli. Previous neurophysiological studies have found that existing models, such as the linear spectro-temporal receptive field (STRF), fail to capture the entire functional relationship between natural stimuli and neural responses. To study this problem, we compared STRFs for A1 neurons estimated using a natural stimulus, continuous speech, with STRFs estimated using synthetic ripple noise. For about one-third of the neurons, we found significant differences between STRFs, usually in the temporal dynamics of inhibition and/or overall gain. This shift in tuning resulted primarily from differences in the coarse temporal structure of the speech and noise stimuli. Using simulations, we found that the stimulus dependence of spectro-temporal tuning can be explained by a model in which synaptic inputs to A1 neurons are susceptible to rapid nonlinear depression. This dynamic reshaping of spectro-temporal tuning suggests that synaptic depression may enable efficient encoding of natural auditory stimuli.

Sound Categories Are Represented as Distributed Patterns in the Human Auditory Cortex

The ability to recognize sounds allows humans and animals to efficiently detect behaviorally relevant events, even in the absence of visual information. Sound recognition in the human brain has been assumed to proceed through several functionally specialized areas, culminating in cortical modules where category-specific processing is carried out. In the present high-resolution fMRI experiment, we challenged this model by using well-controlled natural auditory stimuli and by employing an advanced analysis strategy based on an iterative machine-learning algorithm that allows modeling of spatially distributed, as well as localized, response patterns. Sounds of cats, female singers, acoustic guitars, and tones were controlled for their time-varying spectral characteristics and presented to subjects at three different pitch levels. Sound category information--not detectable with conventional contrast-based methods analysis--could be detected with multivoxel pattern analyses and attributed to spatially distributed areas over the supratemporal cortices. A more localized pattern was observed for processing of pitch laterally to primary auditory areas. Our findings indicate that distributed neuronal populations within the human auditory cortices, including areas conventionally associated with lower-level auditory processing, entail categorical representations of sounds beyond their physical properties.

Perceptual-motor processing of phonetic features in speech.

Some reaction time experiments are reported on the relation between the perception and production of phonetic features in speech. Subjects had to produce spoken consonant-vowel syllables rapidly in response to other consonant-vowel stimulus syllables. The stimulus syllables were presented auditorily in one condition and visually in another. Reaction time was measured as a function of the phonetic features shared by the consonants of the stimulus and response syllables. Responses to auditory stimulus syllables were faster when the response syllables started with consonants that had the same voicing feature as those of the stimulus syllables. A shared place-of-articulation feature did not affect the speed of responses to auditory stimulus syllables, even though the place feature was highly salient. For visual stimulus syllables, performance was independent of whether the consonants of the response syllables had the same voicing, same place of articulation, or no shared features. This pattern of results occurred in cases where the syllables contained stop consonants and where they contained fricatives. It held for natural auditory stimuli as well as artificially synthesized ones. The overall data reveal a close relation between the perception and production of voicing features in speech. It does not appear that such a relation exists between perceiving and producing places of articulation. The experiments are relevant to the motor theory of speech perception and to other models of perceptual-motor interactions.

Perceptual-motor processing of phonetic features in speech.

Some reaction time experiments are reported on the relation between the perception and production of phonetic features in speech. Subjects had to produce spoken consonant-vowel syllables rapidly in response to other consonant-vowel stimulus syllables. The stimulus syllables were presented auditorily in one condition and visually in another. Reaction time was measured as a function of the phonetic features shared by the consonants of the stimulus and response syllables. Responses to auditory stimulus syllables were faster when the response syllables started with consonants that had the same voicing feature as those of the stimulus syllables. A shared place-of-articulation feature did not affect the speed of responses to auditory stimulus syllables, even though the place feature was highly salient. For visual stimulus syllables, performance was independent of whether the consonants of the response syllables had the same voicing, same place of articulation, or no shared features. This pattern of results occurred in cases where the syllables contained stop consonants and where they contained fricatives. It held for natural auditory stimuli as well as artificially synthesized ones. The overall data reveal a close relation between the perception and production of voicing features in speech. It does not appear that such a relation exists between perceiving and producing places of articulation. The experiments are relevant to the motor theory of speech perception and to other models of perceptual-motor interactions.