Self-generated Sounds Research Articles

Do actions structure auditory memory? Action-based event segmentation effects on sensory responses, pupil dilation and sequential memory.

Our actions shape our everyday experience: what we experience, how we perceive, and remember it are deeply affected by how we interact with the world. Performing an action to deliver a stimulus engages neurophysiological processes which are reflected in the modulation of sensory and pupil responses. We hypothesized that these processes shape memory encoding, parsing the experience by grouping self- and externally generated stimuli into differentiated events. Participants encoded sound sequences, in which either the first or last few sounds were self-generated and the rest externally generated. We tested recall of the sequential order of sounds that had originated from the same (within event) or different sources (across events). Memory performance was not higher for within-event sounds, suggesting that actions did not structure the memory representation. However, during encoding, we observed the expected electrophysiological response attenuation for self-generated sounds, together with increased pupil dilation triggered by actions. Moreover, at the boundary between events, physiological responses to the first sound from the new source were influenced by the direction of the source switch. Our results suggest that introducing actions creates a stronger contextual shift than removing them, even though actions do not directly contribute to memory performance. This study contributes to our understanding of how interacting with sensory input shapes experiences by exploring the relationships between action effects on sensory responses, pupil dilation, and memory encoding. Importantly, it challenges the notion of a meaningful contribution from low-level neurophysiological mechanisms associated with action execution in the modulation of the self-generation effect.

Sensation and expectation are embedded in mouse motor cortical activity

During behavior, the motor cortex sends copies of motor-related signals to sensory cortices. Here, we combine closed-loop behavior with large-scale physiology, projection-pattern-specific recordings, and circuit perturbations to show that neurons in mouse secondary motor cortex (M2) encode sensation and are influenced by expectation. When a movement unexpectedly produces a sound, M2 becomes dominated by sound-evoked activity. Sound responses in M2 are inherited partially from the auditory cortex and are routed back to the auditory cortex, providing a path for the reciprocal exchange of sensory-motor information during behavior. When the acoustic consequences of a movement become predictable, M2 responses to self-generated sounds are selectively gated off. These changes in single-cell responses are reflected in population dynamics, which are influenced by both sensation and expectation. Together, these findings reveal the embedding of sensory and expectation signals in motor cortical activity.

Suppression and omission effects in auditory predictive processing-Two of the same?

Recent theories describe perception as an inferential process based on internal predictive models that are adjusted by prediction violations (prediction error). Two different modulations of the auditory N1 event-related brain potential component are often discussed as an expression of auditory predictive processing. The sound-related N1 component is attenuated for self-generated sounds compared to the N1 elicited by externally generated sounds (N1 suppression). An omission-related component in the N1 time-range is elicited when the self-generated sounds are occasionally omitted (omission N1). Both phenomena were explained by action-related forward modelling, which takes place when the sensory input is predictable: prediction error signals are reduced when predicted sensory input is presented (N1 suppression) and elicited when predicted sensory input is omitted (omission N1). This common theoretical account is appealing but has not yet been directly tested. We manipulated the predictability of a sound in a self-generation paradigm in which, in two conditions, either 80% or 50% of the button presses did generate a sound, inducing a strong or a weak expectation for the occurrence of the sound. Consistent with the forward modelling account, an omission N1 was observed in the 80% but not in the 50% condition. However, N1 suppression was highly similar in both conditions. Thus, our results demonstrate a clear effect of predictability for the omission N1 but not for the N1 suppression. These results imply that the two phenomena rely (at least in part) on different mechanisms and challenge prediction related accounts of N1 suppression.

Object recognition via echoes: quantifying the crossmodal transfer of three-dimensional shape information between echolocation, vision, and haptics.

Active echolocation allows blind individuals to explore their surroundings via self-generated sounds, similarly to dolphins and other echolocating animals. Echolocators emit sounds, such as finger snaps or mouth clicks, and parse the returning echoes for information about their surroundings, including the location, size, and material composition of objects. Because a crucial function of perceiving objects is to enable effective interaction with them, it is important to understand the degree to which three-dimensional shape information extracted from object echoes is useful in the context of other modalities such as haptics or vision. Here, we investigated the resolution of crossmodal transfer of object-level information between acoustic echoes and other senses. First, in a delayed match-to-sample task, blind expert echolocators and sighted control participants inspected common (everyday) and novel target objects using echolocation, then distinguished the target object from a distractor using only haptic information. For blind participants, discrimination accuracy was overall above chance and similar for both common and novel objects, whereas as a group, sighted participants performed above chance for the common, but not novel objects, suggesting that some coarse object information (a) is available to both expert blind and novice sighted echolocators, (b) transfers from auditory to haptic modalities, and (c) may be facilitated by prior object familiarity and/or material differences, particularly for novice echolocators. Next, to estimate an equivalent resolution in visual terms, we briefly presented blurred images of the novel stimuli to sighted participants (N = 22), who then performed the same haptic discrimination task. We found that visuo-haptic discrimination performance approximately matched echo-haptic discrimination for a Gaussian blur kernel σ of ~2.5°. In this way, by matching visual and echo-based contributions to object discrimination, we can estimate the quality of echoacoustic information that transfers to other sensory modalities, predict theoretical bounds on perception, and inform the design of assistive techniques and technology available for blind individuals.

Altered corollary discharge signaling in the auditory cortex of a mouse model of schizophrenia predisposition

The ability to distinguish sensations that are self-generated from those caused by external events is disrupted in schizophrenia patients. However, the neural circuit abnormalities underlying this sensory impairment and its relationship to the risk factors for the disease is not well understood. To address this, we examined the processing of self-generated sounds in male Df(16)A+/− mice, which model one of the largest genetic risk factors for schizophrenia, the 22q11.2 microdeletion. We find that auditory cortical neurons in Df(16)A+/− mice fail to attenuate their responses to self-generated sounds, recapitulating deficits seen in schizophrenia patients. Notably, the auditory cortex of Df(16)A+/− mice displayed weaker motor-related signals and received fewer inputs from the motor cortex, suggesting an anatomical basis underlying the sensory deficit. These results provide insights into the mechanisms by which a major genetic risk factor for schizophrenia disrupts the top-down processing of sensory information.

Stimulus-Specific Prediction Error Neurons in Mouse Auditory Cortex.

Comparing expectation with experience is an important neural computation performed throughout the brain and is a hallmark of predictive processing. Experiments that alter the sensory outcome of an animal's behavior reveal enhanced neural responses to unexpected self-generated stimuli, indicating that populations of neurons in sensory cortex may reflect prediction errors (PEs), mismatches between expectation and experience. However, enhanced neural responses to self-generated stimuli could also arise through nonpredictive mechanisms, such as the movement-based facilitation of a neuron's inherent sound responses. If sensory prediction error neurons exist in sensory cortex, it is unknown whether they manifest as general error responses, or respond with specificity to errors in distinct stimulus dimensions. To answer these questions, we trained mice of either sex to expect the outcome of a simple sound-generating behavior and recorded auditory cortex activity as mice heard either the expected sound or sounds that deviated from expectation in one of multiple distinct dimensions. Our data reveal that the auditory cortex learns to suppress responses to self-generated sounds along multiple acoustic dimensions simultaneously. We identify a distinct population of auditory cortex neurons that are not responsive to passive sounds or to the expected sound but that encode prediction errors. These prediction error neurons are abundant only in animals with a learned motor-sensory expectation, and encode one or two specific violations rather than a generic error signal. Together, these findings reveal that cortical predictions about self-generated sounds have specificity in multiple simultaneous dimensions and that cortical prediction error neurons encode specific violations from expectation.SIGNIFICANCE STATEMENT Audette et. al record neural activity in the auditory cortex while mice perform a sound-generating forelimb movement and measure neural responses to sounds that violate an animal's expectation in different ways. They find that predictions about self-generated sounds are highly specific across multiple stimulus dimensions and that a population of typically nonsound-responsive neurons respond to sounds that violate an animal's expectation in a specific way. These results identify specific prediction error (PE) signals in the mouse auditory cortex and suggest that errors may be calculated early in sensory processing.

My view on your actions: Dynamic changes in viewpoint-dependent auditory ERP attenuation during action observation.

It has been suggested that during action observation, a sensory representation of the observed action is mapped onto one's own motor system. However, it is largely unexplored what this may imply for the early processing of the action's sensory consequences, whether the observational viewpoint exerts influence on this and how such a modulatory effect might change over time. We tested whether the event-related potential of auditory effects of actions observed from a first- versus third-person perspective show amplitude reductions compared with externally generated sounds, as revealed for self-generated sounds. Multilevel modeling on trial-level data showed distinct dynamic patterns for the two viewpoints on reductions of the N1, P2, and N2 components. For both viewpoints, an N1 reduction for sounds generated by observed actions versus externally generated sounds was observed. However, only during first-person observation, we found a temporal dynamic within experimental runs (i.e., the N1 reduction only emerged with increasing trial number), indicating time-variant, viewpoint-dependent processes involved in sensorimotor prediction during action observation. For the P2, only a viewpoint-independent reduction was found for sounds elicited by observed actions, which disappeared in the second half of the experiment. The opposite pattern was found in an exploratory analysis concerning the N2, revealing a reduction that increased in the second half of the experiment, and, moreover, a temporal dynamic within experimental runs for the first-person perspective, possibly reflecting an agency-related process. Overall, these results suggested that the processing of auditory outcomes of observed actions is dynamically modulated by the viewpoint over time.

Auditory orientation and distance estimation of sighted humans using virtual echolocation with artificial and self-generated sounds.

Active echolocation of sighted humans using predefined synthetic and self-emitted sounds, as habitually used by blind individuals, was investigated. Using virtual acoustics, distance estimation and directional localization of a wall in different rooms were assessed. A virtual source was attached to either the head or hand with realistic or increased source directivity. A control condition was tested with a virtual sound source located at the wall. Untrained echolocation performance comparable to performance in the control condition was achieved on an individual level. On average, the echolocation performance was considerably lower than in the control condition, however, it benefitted from increased directivity.

Precise movement-based predictions in the mouse auditory cortex

Many of the sensations experienced by an organism are caused by their own actions, and accurately anticipating both the sensory features and timing of self-generated stimuli is crucial to a variety of behaviors. In the auditory cortex, neural responses to self-generated sounds exhibit frequency-specific suppression, suggesting that movement-based predictions may be implemented early in sensory processing. However, it remains unknown whether this modulation results from a behaviorally specific and temporally precise prediction, nor is it known whether corresponding expectation signals are present locally in the auditory cortex. To address these questions, we trained mice to expect the precise acoustic outcome of a forelimb movement using a closed-loop sound-generating lever. Dense neuronal recordings in the auditory cortex revealed suppression of responses to self-generated sounds that was specific to the expected acoustic features, to a precise position within the movement, and to the movement that was coupled to sound during training. Prediction-based suppression was concentrated in L2/3 and L5, where deviations from expectation also recruited a population of prediction-error neurons that was otherwise unresponsive. Recording in the absence of sound revealed abundant movement signals in deep layers that were biased toward neurons tuned to the expected sound, as well as expectation signals that were present throughout the cortex and peaked at the time of expected auditory feedback. Together, these findings identify distinct populations of auditory cortical neurons with movement, expectation, and error signals consistent with a learned internal model linking an action to its specific acoustic outcome.

Integration of somatosensory and motor-related information in the auditory system.

An ability to integrate information provided by different sensory modalities is a fundamental feature of neurons in many brain areas. Because visual and auditory inputs often originate from the same external object, which may be located some distance away from the observer, the synthesis of these cues can improve localization accuracy and speed up behavioral responses. By contrast, multisensory interactions occurring close to the body typically involve a combination of tactile stimuli with other sensory modalities. Moreover, most activities involving active touch generate sound, indicating that stimuli in these modalities are frequently experienced together. In this review, we examine the basis for determining sound-source distance and the contribution of auditory inputs to the neural encoding of space around the body. We then consider the perceptual consequences of combining auditory and tactile inputs in humans and discuss recent evidence from animal studies demonstrating how cortical and subcortical areas work together to mediate communication between these senses. This research has shown that somatosensory inputs interface with and modulate sound processing at multiple levels of the auditory pathway, from the cochlear nucleus in the brainstem to the cortex. Circuits involving inputs from the primary somatosensory cortex to the auditory midbrain have been identified that mediate suppressive effects of whisker stimulation on auditory thalamocortical processing, providing a possible basis for prioritizing the processing of tactile cues from nearby objects. Close links also exist between audition and movement, and auditory responses are typically suppressed by locomotion and other actions. These movement-related signals are thought to cancel out self-generated sounds, but they may also affect auditory responses via the associated somatosensory stimulation or as a result of changes in brain state. Together, these studies highlight the importance of considering both multisensory context and movement-related activity in order to understand how the auditory cortex operates during natural behaviors, paving the way for future work to investigate auditory-somatosensory interactions in more ecological situations.

The function of the tensor tympani muscle: a comprehensive review of the literature.

The tensor tympani muscle is structurally important in the middle ear, specifically through its involvement in the impedance of sound in response to intense auditory and non-auditory stimuli. Despite numerous studies, its true function has been debated for many years; questions still remain about its role in auditory and non-auditory reflexes and in sound damping. Some studies suggest that the tensor tympani muscle contracts as a result of non-auditory stimulation such as facial or head movements; others suggest that it contracts due to input from the cochlear nucleus, therefore by way of auditory stimulation. Whatever the cause, contraction of the tensor tympani muscle results in low frequency mixed hearing loss, either to protect the inner ear from loud sounds or to desensitize the ear to self-generated sounds. A review of these studies indicated that the tensor tympani muscle has a wide range of functions, yet the mechanisms of some of them have not been clearly demonstrated. One major question is whether the tensor tympani muscle contributes to sound damping; and if it does, what specific role it serves. The primary purpose of this review article is to explore the functions of the tensor tympani muscle in light of recent research advances.

Descending Axonal Projections from the Inferior Colliculus Target Nearly All Excitatory and Inhibitory Cell Types of the Dorsal Cochlear Nucleus.

The dorsal cochlear nucleus (DCN) integrates auditory nerve input with nonauditory sensory signals and is proposed to function in sound source localization and suppression of self-generated sounds. The DCN also integrates activity from descending auditory pathways, including a particularly large feedback projection from the inferior colliculus (IC), the main ascending target of the DCN. Understanding how these descending feedback signals are integrated into the DCN circuit and what role they play in hearing requires knowing the targeted DCN cell types and their postsynaptic responses. In order to explore these questions, neurons in the DCN that received descending synaptic input from the IC were labeled with a trans-synaptic viral approach in male and female mice, which allowed them to be targeted for whole-cell recording in acute brain slices. We tested their synaptic responses to optogenetic activation of the descending IC projection. Every cell type in the granule cell domain received monosynaptic, glutamatergic input from the IC, indicating that this region, considered an integrator of nonauditory sensory inputs, processes auditory input as well and may have complex and underappreciated roles in hearing. Additionally, we found that DCN cell types outside the granule cell regions also receive descending IC signals, including the principal projection neurons, as well as the neurons that inhibit them, leading to a circuit that may sharpen tuning through feedback excitation and lateral inhibition.SIGNIFICANCE STATEMENT Auditory processing starts in the cochlea and ascends through the dorsal cochlear nucleus (DCN) to the inferior colliculus (IC) and beyond. Here, we investigated the feedback projection from IC to DCN, whose synaptic targets and roles in auditory processing are unclear. We found that all cell types in the granule cell regions, which process multisensory feedback, also process this descending auditory feedback. Surprisingly, all except one cell type in the entire DCN receive IC input. The IC-DCN projection may therefore modulate the multisensory pathway as well as sharpen tuning and gate auditory signals that are sent to downstream areas. This excitatory feedback loop from DCN to IC and back to DCN could underlie hyperexcitability in DCN, widely considered an etiology of tinnitus.

Cortical auditory responses to self-generated sounds in tinnitus and schizophrenia patients with deficits of auditory processing sensory hierarchy

Cortical auditory responses to self-generated sounds in tinnitus and schizophrenia patients with deficits of auditory processing sensory hierarchy

Expectation of self-generated sounds drives predictive processing in mouse auditory cortex

Behavior exerts a strong influence over sensory responses in the brain. In the auditory cortex, neural responses to self-generated sounds are suppressed, suggesting that prediction may play a critical role in local sensory processing. However, it is unclear whether this phenomenon derives from a precise movement-based prediction or how it affects the neural representation of incoming stimuli. We address these questions by designing a behavioral paradigm where mice learn to expect the predictable acoustic consequences of a simple forelimb movement. Dense neuronal recordings from auditory cortex revealed suppression of neural responses that was strongest for the expected tone during a narrow time window surrounding the specific sound-associated movement. Predictive suppression was concentrated in layers 2/3 and 5, preceded by the arrival of movement information in deep layers, and driven by motor-sensory coupling rather than task engagement, behavioral relevance, or reward association. Despite large-scale suppression at the population level, the auditory cortex retained a sparse representation of the expected self-generated sounds, while a substantial population of auditory cortex neurons in L2/3 and L5 encoded prediction errors. These findings illustrate that expectation, learned through motor-sensory experience, drives layer-specific predictive processing in the mouse auditory cortex.

Action-Locked Neural Responses in Auditory Cortex to Self-Generated Sounds

Action-Locked Neural Responses in Auditory Cortex to Self-Generated Sounds

Self-generation and sound intensity interactively modulate perceptual bias, but not perceptual sensitivity

The ability to distinguish self-generated stimuli from those caused by external sources is critical for all behaving organisms. Although many studies point to a sensory attenuation of self-generated stimuli, recent evidence suggests that motor actions can result in either attenuated or enhanced perceptual processing depending on the environmental context (i.e., stimulus intensity). The present study employed 2-AFC sound detection and loudness discrimination tasks to test whether sound source (self- or externally-generated) and stimulus intensity (supra- or near-threshold) interactively modulate detection ability and loudness perception. Self-generation did not affect detection and discrimination sensitivity (i.e., detection thresholds and Just Noticeable Difference, respectively). However, in the discrimination task, we observed a significant interaction between self-generation and intensity on perceptual bias (i.e. Point of Subjective Equality). Supra-threshold self-generated sounds were perceived softer than externally-generated ones, while at near-threshold intensities self-generated sounds were perceived louder than externally-generated ones. Our findings provide empirical support to recent theories on how predictions and signal intensity modulate perceptual processing, pointing to interactive effects of intensity and self-generation that seem to be driven by a biased estimate of perceived loudness, rather by changes in detection and discrimination sensitivity.

Trigeminal Contributions to the Dorsal Cochlear Nucleus in Mouse.

The dorsal cochlear nucleus (DCN) is the first site of multisensory integration in the auditory pathway of mammals. The DCN circuit integrates non-auditory information, such as head and ear position, with auditory signals, and this convergence may contribute to the ability to localize sound sources or to suppress perceptions of self-generated sounds. Several extrinsic sources of these non-auditory signals have been described in various species, and among these are first- and second-order trigeminal axonal projections. Trigeminal sensory signals from the face and ears could provide the non-auditory information that the DCN requires for its role in sound source localization and cancelation of self-generated sounds, for example, head and ear position or mouth movements that could predict the production of chewing or licking sounds. There is evidence for these axonal projections in guinea pigs and rats, although the size of the pathway is smaller than might be expected for a function essential for a prey animals’ survival. However, evidence for these projections in mice, an increasingly important species in auditory neuroscience, is lacking, raising questions about the universality of such proposed functions. We therefore investigated the presence of trigeminal projections to the DCN in mice, using viral and transgenic approaches. We found that the spinal trigeminal nucleus indeed projects to DCN, targeting granule cells and unipolar brush cells. However, direct axonal projections from the trigeminal ganglion itself were undetectable. Thus, secondary brainstem sources carry non-auditory signals to the DCN in mice that could provide a processed trigeminal signal to the DCN, but primary trigeminal afferents are not integrated directly by DCN.

Action-locked Neural Responses in Auditory Cortex to Self-generated Sounds.

Sensory perception is a product of interactions between the internal state of an organism and the physical attributes of a stimulus. It has been shown across the animal kingdom that perception and sensory-evoked physiological responses are modulated depending on whether or not the stimulus is the consequence of voluntary actions. These phenomena are often attributed to motor signals sent to relevant sensory regions that convey information about upcoming sensory consequences. However, the neurophysiological signature of action-locked modulations in sensory cortex, and their relationship with perception, is still unclear. In the current study, we recorded neurophysiological (using Magnetoencephalography) and behavioral responses from 16 healthy subjects performing an auditory detection task of faint tones. Tones were either generated by subjects' voluntary button presses or occurred predictably following a visual cue. By introducing a constant temporal delay between button press/cue and tone delivery, and applying source-level analysis, we decoupled action-locked and auditory-locked activity in auditory cortex. We show action-locked evoked-responses in auditory cortex following sound-triggering actions and preceding sound onset. Such evoked-responses were not found for button-presses that were not coupled with sounds, or sounds delivered following a predictive visual cue. Our results provide evidence for efferent signals in human auditory cortex that are locked to voluntary actions coupled with future auditory consequences.

Sensory attenuation is modulated by the contrasting effects of predictability and control

Self-generated stimuli have been found to elicit a reduced sensory response compared with externally-generated stimuli. However, much of the literature has not adequately controlled for differences in the temporal predictability and temporal control of stimuli. In two experiments, we compared the N1 (and P2) components of the auditory-evoked potential to self- and externally-generated tones that differed with respect to these two factors. In Experiment 1 (n = 42), we found that increasing temporal predictability reduced N1 amplitude in a manner that may often account for the observed reduction in sensory response to self-generated sounds. We also observed that reducing temporal control over the tones resulted in a reduction in N1 amplitude. The contrasting effects of temporal predictability and temporal control on N1 amplitude meant that sensory attenuation prevailed when controlling for each. Experiment 2 (n = 38) explored the potential effect of selective attention on the results of Experiment 1 by modifying task requirements such that similar levels of attention were allocated to the visual stimuli across conditions. The results of Experiment 2 replicated those of Experiment 1, and suggested that the observed effects of temporal control and sensory attenuation were not driven by differences in attention. Given that self- and externally-generated sensations commonly differ with respect to both temporal predictability and temporal control, findings of the present study may necessitate a re-evaluation of the experimental paradigms used to study sensory attenuation.

Essential Role of Somatic Kv2 Channels in High-Frequency Firing in Cartwheel Cells of the Dorsal Cochlear Nucleus.

Among all voltage-gated potassium (Kv) channels, Kv2 channels are the most widely expressed in the mammalian brain. However, studying Kv2 in neurons has been challenging because of a lack of high-selective blockers. Recently, a peptide toxin, guangxitoxin-1E (GxTX), has been identified as a specific inhibitor of Kv2, thus facilitating the study of Kv2 in neurons. The mammalian dorsal cochlear nucleus (DCN) integrates auditory and somatosensory information. In the DCN, cartwheel inhibitory interneurons receive excitatory synaptic inputs from parallel fibers conveying somatosensory information. The activation of parallel fibers drives action potentials in the cartwheel cells up to 130 Hz in vivo, and the excitation of cartwheel cells leads to the strong inhibition of principal cells. Therefore, cartwheel cells play crucial roles in monaural sound localization and cancelling detection of self-generated sounds. However, how Kv2 controls the high-frequency firing in cartwheel cells is unknown. In this study, we performed immunofluorescence labeling with anti-Kv2.1 and anti-Kv2.2 antibodies using fixed mouse brainstem slice preparations. The results revealed that Kv2.1 and Kv2.2 were largely present on the cartwheel cell body membrane but not on the axon initial segment (AIS) nor the proximal dendrite. Whole-cell patch-clamp recordings using mouse brainstem slice preparation and GxTX demonstrated that blockade of Kv2 induced failure of parallel fiber-induced action potentials when parallel fibers were stimulated at high frequencies (30–100 Hz). Thus, somatic Kv2 in cartwheel cells regulates the action potentials in a frequency-dependent manner and may play important roles in the DCN function.