Time-locked Responses Research Articles

Examining the consistency of continuous affect annotations and psychophysiological measures in response to emotional videos

Despite the growing necessity of understanding the dynamics of emotion by naturalistic stimuli, averaging time-locked responses seems insufficient to capture emotional experiences that change over time. Intersubject correlation (ISC) has been implemented to examine dynamic emotional experiences by quantifying the consistency of responses across individuals. While previous research has shown that enhanced psychophysiological ISC can capture dynamic emotional experiences in response to long-lasting videos that evoke dimensional emotions, it is not yet fully understood how psychophysiological consistency varies during videos that elicit distinct emotions, such as fear. In this study, we re-analyzed publicly available data consisting of continuous affect annotations and psychophysiological signals, namely heart rate (HR), electrodermal activity (EDA), electromyographic signals from zygomaticus major (EMG-z), and corrugator supercilii (EMG-c), in response to categorical emotional videos, namely amusing, boring, relaxing, and fearful. Results showed an overall increase in ISC in multiple measures during fearful videos, indicating that emotional experiences during fearful videos were reliably consistent across participants. The effect of amusing and boring videos on ISC revealed varying results depending on the measurements. In particular, larger ISC in valence rating, EDA, and EMG-z was found for amusing than boring videos, whereas larger ISC in HR and EMG-c was observed for boring than amusing movies. Lastly, decreased ISC for relaxing videos was observed across multiple measurements, showing inconsistent emotional experiences during relaxing videos. This study builds on previous research on physiological consistency during emotional experiences by examining how the consistency of continuous affect annotations and psychophysiological measures differs in response to videos that elicit distinct emotions.

Asynchronous axonal firing patterns evoked via continuous subthreshold kilohertz stimulation

Objective. Transcutaneous electrical stimulation of peripheral nerves is a common technique to assist or rehabilitate impaired muscle activation. However, conventional stimulation paradigms activate nerve fibers synchronously with action potentials time-locked with stimulation pulses. Such synchronous activation limits fine control of muscle force due to synchronized force twitches. Accordingly, we developed a subthreshold high-frequency stimulation waveform with the goal of activating axons asynchronously. Approach. We evaluated our waveform experimentally and through model simulations. During the experiment, we delivered continuous subthreshold pulses at frequencies of 16.67, 12.5, or 10 kHz transcutaneously to the median and ulnar nerves. We obtained high-density electromyographic (EMG) signals and fingertip forces to quantify the axonal activation patterns. We used a conventional 30 Hz stimulation waveform and the associated voluntary muscle activation for comparison. We modeled stimulation of biophysically realistic myelinated mammalian axons using a simplified volume conductor model to solve for extracellular electric potentials. We compared the firing properties under kHz and conventional 30 Hz stimulation. Main results. EMG activity evoked by kHz stimulation showed high entropy values similar to voluntary EMG activity, indicating asynchronous axon firing activity. In contrast, we observed low entropy values in EMG evoked by conventional 30 Hz stimulation. The muscle forces evoked by kHz stimulation also showed more stable force profiles across repeated trials compared with 30 Hz stimulation. Our simulation results provide direct evidence of asynchronous firing patterns across a population of axons in response to kHz frequency stimulation, while 30 Hz stimulation elicited synchronized time-locked responses across the population. Significance. We demonstrate that the continuous subthreshold high-frequency stimulation waveform can elicit asynchronous axon firing patterns, which can lead to finer control of muscle forces.

Time-Comparator Neural Circuits of Gymnotiform Electric Fishes.

Weakly electric fish possess electrosensory neural systems that are dedicated to detect microsecond time differences between sensory signals. Many features of this timing system, such as electroreceptor encoding, time-locked responses, and time-comparator neural circuit, are shared by closely related as well as distantly related electric fishes. The appearance and location of the time-comparator neural structures, however, are different among species. The timing systems of different electric fish species are compared.

Time-locked auditory cortical responses in the high-gamma band: A window into primary auditory cortex.

Primary auditory cortex is a critical stage in the human auditory pathway, a gateway between subcortical and higher-level cortical areas. Receiving the output of all subcortical processing, it sends its output on to higher-level cortex. Non-invasive physiological recordings of primary auditory cortex using electroencephalography (EEG) and magnetoencephalography (MEG), however, may not have sufficient specificity to separate responses generated in primary auditory cortex from those generated in underlying subcortical areas or neighboring cortical areas. This limitation is important for investigations of effects of top-down processing (e.g., selective-attention-based) on primary auditory cortex: higher-level areas are known to be strongly influenced by top-down processes, but subcortical areas are often assumed to perform strictly bottom-up processing. Fortunately, recent advances have made it easier to isolate the neural activity of primary auditory cortex from other areas. In this perspective, we focus on time-locked responses to stimulus features in the high gamma band (70-150 Hz) and with early cortical latency (∼40 ms), intermediate between subcortical and higher-level areas. We review recent findings from physiological studies employing either repeated simple sounds or continuous speech, obtaining either a frequency following response (FFR) or temporal response function (TRF). The potential roles of top-down processing are underscored, and comparisons with invasive intracranial EEG (iEEG) and animal model recordings are made. We argue that MEG studies employing continuous speech stimuli may offer particular benefits, in that only a few minutes of speech generates robust high gamma responses from bilateral primary auditory cortex, and without measurable interference from subcortical or higher-level areas.

Large-scale cortico-cerebellar computations for horizontal and vertical vergence in humans

Horizontal and vertical vergence eye movements play a central role in binocular coordination. Neurophysiological studies suggest that cortical and subcortical regions in animals and humans are involved in horizontal vergence. However, little is known about the extent to which the neural mechanism underlying vertical vergence overlaps with that of horizontal vergence. In this study, to explore neural computation for horizontal and vertical vergence, we simultaneously recorded electrooculography (EOG) and whole-head magnetoencephalography (MEG) while presenting large-field stereograms for 29 healthy human adults. The stereograms were designed to produce vergence responses by manipulating horizontal and vertical binocular disparities. A model-based approach was used to assess neural sensitivity to horizontal and vertical disparities via MEG source estimation and the theta-band (4 Hz) coherence between brain activity and EOG vergence velocity. We found similar time-locked neural responses to horizontal and vertical disparity in cortical and cerebellar areas at around 100–250 ms after stimulus onset. In contrast, the low-frequency oscillatory neural activity associated with the execution of vertical vergence differed from that of horizontal vergence. These findings indicate that horizontal and vertical vergence involve partially shared but distinct computations in large-scale cortico-cerebellar networks.

Mechanistic insights into ultrasonic neurostimulation of disconnected neurons using single short pulses

Ultrasonic neurostimulation is a potentially potent noninvasive therapy, whose mechanism has yet to be elucidated. We designed a system capable of applying ultrasound with minimal reflections to neuronal cultures. Synaptic transmission was pharmacologically controlled, eliminating network effects, enabling examination of single-cell processes. Short single pulses of low-intensity ultrasound were applied, and time-locked responses were examined using calcium imaging.Low-pressure (0.35 MPa) ultrasound directly stimulated ∼20% of pharmacologically disconnected neurons, regardless of membrane poration. Stimulation was resistant to the blockade of several purinergic receptor and mechanosensitive ion channel types. Stimulation was blocked, however, by suppression of action potentials. Surprisingly, even extremely short (4 μs) pulses were effective, stimulating ∼8% of the neurons. Lower-pressure pulses (0.35 MPa) were less effective than higher-pressure ones (0.65 MPa). Attrition effects dominated, with no indication of compromised viability.Our results detract from theories implicating cavitation, heating, non-transient membrane pores >1.5 nm, pre-synaptic release, or gradual effects. They implicate a post-synaptic mechanism upstream of the action potential, and narrow down the list of possible targets involved.

Cold evoked potentials elicited by rapid cooling of the skin in young and elderly healthy individuals

Cold-evoked potentials (CEPs) constitute a novel electrophysiological tool to assess cold-specific alterations in somatosensory function. As an important step towards the clinical implementation of CEPs as a diagnostic tool, we evaluated the feasibility and reliability of CEPs in response to rapid cooling of the skin (−300 °C/s) and different stimulation sites in young and elderly healthy individuals. Time-locked electroencephalographic responses were recorded from at vertex in fifteen young (20–40 years) and sixteen elderly (50–70 years), individuals in response to 15 rapid cold stimuli (−300 °C/s) applied to the skin of the hand dorsum, palm, and foot dorsum. High CEP proportions were shown for young individuals at all sites (hand dorsum/palm: 100% and foot: 79%) and elderly individuals after stimulation of the hand dorsum (81%) and palm (63%), but not the foot (44%). Depending on the age group and stimulation site, test–retest reliability was “poor” to “substantial” for N2P2 amplitudes and N2 latencies. Rapid cooling of the skin enables the recording of reliable CEPs in young individuals. In elderly individuals, CEP recordings were only robust after stimulation of the hand, but particularly challenging after stimulation of the foot. Further improvements in stimulation paradigms are warranted to introduce CEPs for clinical diagnostics.

Er81 Transcription Factor Fine-Tunes Striatal Cholinergic Interneuron Activity and Drives Habit Formation.

The molecular mechanisms tuning cholinergic interneuron (CIN) activity, although crucial for striatal function and behavior, remain largely unexplored. Previous studies report that the Etv1/Er81 transcription factor is vital for regulating neuronal maturation and activity. While Er81 is known to be expressed in the striatum during development, its specific role in defining CIN properties and the resulting consequences on striatal function is unknown. We report here that Er81 is expressed in CINs and its specific ablation leads to prominent changes in their molecular, morphologic, and electrophysiological features. In particular, the lack of Er81 amplifies intrinsic delayed-rectifier and hyperpolarization-activated currents, which subsequently alters the tonic and phasic activity of CINs. We further reveal that Er81 expression is required for normal CIN pause and time-locked responses to sensorimotor inputs in awake mice. Overall, this study uncovers a new cell type-specific control of CIN function in the striatum which drives habit formation in adult male mice.SIGNIFICANCE STATEMENT Although previous studies have shown that cholinergic interneurons drive striatal activity and habit formation, the underlying molecular mechanisms controlling their function are unknown. Here we reveal that key cholinergic interneuron physiological properties are controlled by Er81, a transcription factor regulating neuronal activity and development in a cell-specific manner. Moreover, our findings uncover a link between the Er81-dependent molecular control of cholinergic interneuron function and habit formation in mice. These insights will contribute to the future enhancement of our understanding of disorders that involve behavioral inflexibility, such as autism and addiction.

A Parametric EEG Signal Model for BCIs with Rapid-Trial Sequences.

Electroencephalogram (EEG) signals have been shown very effective for inferring user intents in brain-computer interface (BCI) applications. However, existing EEG-based BCIs, in many cases, lack sufficient performance due to utilizing classifiers that operate on EEG signals induced by individual trials. While many factors influence the classification performance, an important aspect that is often ignored is the temporal dependency of these trial-EEG signals, in some cases impacted by interference of brain responses to consecutive target and non-target trials. In this study, the EEG signals are analyzed in a parametric sequence-based fashion, which considers all trials that induce brain responses in a rapid-sequence fashion, including a mixture of consecutive target and non-target trials. EEG signals are described as a linear combination of time-shifted cortical source activities plus measurement noise. Using a superposition of time invariant with an auto-regressive (AR) process, EEG signals are treated as a linear combination of a stationary Gaussian process and time-locked impulse responses to the stimulus (input events) onsets. The model performance is assessed in the framework of a rapid serial visualization presentation (RSVP) based typing task for three healthy subjects across two sessions. Signal modeling in this fashion yields promising performance outcomes considering a single EEG channel to estimate the user intent.

Dynamic Encoding of Acoustic Features in Neural Responses to Continuous Speech.

Humans are unique in their ability to communicate using spoken language. However, it remains unclear how the speech signal is transformed and represented in the brain at different stages of the auditory pathway. In this study, we characterized electroencephalography responses to continuous speech by obtaining the time-locked responses to phoneme instances (phoneme-related potential). We showed that responses to different phoneme categories are organized by phonetic features. We found that each instance of a phoneme in continuous speech produces multiple distinguishable neural responses occurring as early as 50 ms and as late as 400 ms after the phoneme onset. Comparing the patterns of phoneme similarity in the neural responses and the acoustic signals confirms a repetitive appearance of acoustic distinctions of phonemes in the neural data. Analysis of the phonetic and speaker information in neural activations revealed that different time intervals jointly encode the acoustic similarity of both phonetic and speaker categories. These findings provide evidence for a dynamic neural transformation of low-level speech features as they propagate along the auditory pathway, and form an empirical framework to study the representational changes in learning, attention, and speech disorders.SIGNIFICANCE STATEMENT We characterized the properties of evoked neural responses to phoneme instances in continuous speech. We show that each instance of a phoneme in continuous speech produces several observable neural responses at different times occurring as early as 50 ms and as late as 400 ms after the phoneme onset. Each temporal event explicitly encodes the acoustic similarity of phonemes, and linguistic and nonlinguistic information are best represented at different time intervals. Finally, we show a joint encoding of phonetic and speaker information, where the neural representation of speakers is dependent on phoneme category. These findings provide compelling new evidence for dynamic processing of speech sounds in the auditory pathway.

Hunger-Driven Motivational State Competition

Behavioral choice is ubiquitous in the animal kingdom and is central to goal-oriented behavior. Hypothalamic Agouti-related peptide (AgRP) neurons are critical regulators of appetite. Hungry animals, bombarded by multiple sensory stimuli, are known to modify their behavior during times of caloric need, rapidly adapting to a consistently changing environment. Utilizing ARCAgRP neurons as an entry point, we analyzed the hierarchical position of hunger related to rival drive states. Employing a battery ofbehavioral assays, we found that hunger significantly increases its capacity to suppress competing motivational systems, such as thirst, anxiety-related behavior, innate fear, and social interactions, often only when food is accessible. Furthermore, real-time monitoring of ARCAgRP activity revealed time-locked responses to conspecific investigation in addition to food presentation, further establishing that, even at the level of ARCAgRP neurons, choices are remarkablyflexible computations, integrating internal state, external factors, and anticipated yield. VIDEO ABSTRACT.

Tonotopic and Field-Specific Representation of Long-Lasting Sustained Activity in Rat Auditory Cortex.

Cortical information processing of the onset, offset, and continuous plateau of an acoustic stimulus should play an important role in acoustic object perception. To date, transient activities responding to the onset and offset of a sound have been well investigated and cortical subfields and topographic representation in these subfields, such as place code of sound frequency, have been well characterized. However, whether these cortical subfields with tonotopic representation are inherited in the sustained activities that follow transient activities and persist during the presentation of a long-lasting stimulus remains unknown, because sustained activities do not exhibit distinct, reproducible, and time-locked responses in their amplitude to be characterized by grand averaging. To address this gap in understanding, we attempted to decode sound information from densely mapped sustained activities in the rat auditory cortex using a sparse parameter estimation method called sparse logistic regression (SLR), and investigated whether and how these activities represent sound information. A microelectrode array with a grid of 10 × 10 recording sites within an area of 4.0 mm × 4.0 mm was implanted in the fourth layer of the auditory cortex in rats under isoflurane anesthesia. Sustained activities in response to long-lasting constant pure tones were recorded. SLR then was applied to discriminate the sound-induced band-specific power or phase-locking value from those of spontaneous activities. The highest decoding performance was achieved in the high-gamma band, indicating that cortical inhibitory interneurons may contribute to the sparse tonotopic representation in sustained activities by mediating synchronous activities. The estimated parameter in the SLR decoding revealed that the informative recording site had a characteristic frequency close to the test frequency. In addition, decoding of the four test frequencies demonstrated that the decoding performance of the SLR deteriorated when the test frequencies were close, supporting the hypothesis that the sustained activities were organized in a tonotopic manner. Finally, unlike transient activities, sustained activities were more informative in the belt than in the core region, indicating that higher-order auditory areas predominate over lower-order areas during sustained activities. Taken together, our results indicate that the auditory cortex processes sound information tonotopically and in a hierarchical manner.

How social is the chaser? Neural correlates of chasing perception in 9-month-old infants

We investigated the neural correlates of chasing perception in infancy to determine whether animated interactions are processed as social events. By using EEG and an ERP design with animations of simple geometric shapes, we examined whether the positive posterior (P400) component, previously found in response to social stimuli, as well as the attention related negative fronto-central component (Nc), differs when infants observed a chaser versus a non-chaser. In Study 1, the chaser was compared to an inanimate object. In Study 2, the chaser was compared to an animate but not chasing agent (randomly moving agent). Results demonstrate no difference in the Nc component, but statistically higher P400 amplitude when the chasing agent was compared to either an inanimate object or a random object. We also find a difference in the N290 component in both studies and in the P200 component in Study 2, when the chasing agent is compared to the randomly moving agent. The present studies demonstrate for the first time that infants’ process correlated motion such as chasing as a social interaction. The perception of the chasing agent elicits stronger time-locked responses, denoting a link between motion perception and social cognition.

Inattentional Deafness: Visual Load Leads to Time-Specific Suppression of Auditory Evoked Responses.

The present work clarifies the neural underpinning of inattentional deafness under high visual load. The findings of near-simultaneous load effects on both visual and auditory evoked responses suggest shared audiovisual processing capacity. Temporary depletion of shared capacity in perceptually demanding visual tasks leads to a momentary reduction in sensory processing of auditory stimuli, resulting in inattentional deafness. The dynamic "push-pull" pattern of load effects on visual and auditory processing furthers our understanding of both the neural mechanisms of attention and of cross-modal effects across visual and auditory processing. These results also offer an explanation for many previous failures to find cross-modal effects in experiments where the visual load effects may not have coincided directly with auditory sensory processing.

Electroencephalography during general anaesthesia differs between term-born and premature-born children

ObjectivesPremature birth is associated with a wide range of complications in later life, including structural and functional neurological abnormalities and altered pain sensitivity. We investigated whether during anaesthesia premature-born children display different patterns of background EEG activity and exhibit increased responses to nociceptive stimuli. MethodsWe examined background EEG and time-locked responses to clinical cannulation in 45 children (mean age (±SD) at study: 4.9(±3.0)years) under sevoflurane monoanaesthesia maintained at a steady-state end-tidal concentration of 2.5%. 15 were born prematurely (mean gestational age at birth: 29.2±3.9weeks) and 30 were age-matched term-born children. ResultsBackground levels of alpha and beta power were significantly lower in the premature-born children compared to term-born controls (p=0.048). Clinical cannulation evoked a significant increase in delta activity (p=0.032), which was not significantly different between the two groups (p=0.44). ConclusionsThe results indicate that whilst under anaesthesia premature-born children display different patterns of background brain activity compared to term-born children. SignificanceAs electrophysiological techniques are increasingly used by anaesthetists to gauge anaesthetic depth, differences in background levels of electrophysiological brain activity between premature and term-born children may be relevant when considering titration of anaesthetic dose.

Event related desynchronization: use as a neurophysiologic marker is restricted.

The present research aims to show that the occurrence of alpha blocking or event-related desynchronization (ERD) strongly depends on the amplitude and also on the phase angle of alpha activity at the stimulus onset. Simple visual stimulation was presented to 17 healthy subjects during EEG recording. An O2 electrode was used for analysis with a 32 channel EEG sampling system. We used a segmentation of raw data in order to obtain the evoked potential. Prestimulus and poststimulus activities were filtered in the alpha (8-13Hz) frequency band. Later, four different events (blocked, time-locked, phase-locked, and eliminated) were separately averaged. Phase-locked sweeps were determined by application of inter-trial coherence analysis. The evaluation of the data shows that "time-locked and phase-locked sweeps" were the dominating pattern and not "the blocked pattern", which occurred only when the prestimulus alpha was high. In the analyses of EEG-EP sweeps, only 22% of epochs showed (ERD). The ANOVA revealed significant differences between four different alpha responses (F(3,48)=11.175; p<0.001). Furthermore, alpha oscillations in time-locked responses were significantly higher than blocked (p<0.0001). The analyses clearly demonstrate that important precaution is needed when using the ERD as a cognitive or pathological marker.

Sensory Experience Restructures Thalamocortical Axons during Adulthood

The brain's capacity to rewire is thought to diminish with age. It is widely believed that development stabilizes the synapses from thalamus to cortex and that adult experience alters only synaptic connections between cortical neurons. Here we show that thalamocortical (TC) inputs themselves undergo massive plasticity in adults. We combined whole-cell recording from individual thalamocortical neurons in adult rats with a recently developed automatic tracing technique to reconstruct individual axonal trees. Whisker trimming substantially reduced thalamocortical axon length in barrel cortex but not the density of TC synapses along a fiber. Thus, sensory experience alters the total number of TC synapses. After trimming, sensory stimulation evoked more tightly time-locked responses among thalamorecipient layer 4 cortical neurons. These findings indicate that thalamocortical input itself remains plastic in adulthood, raising the possibility that the axons of other subcortical structures might also remain in flux throughout life.

Thalamic POm projections to the dorsolateral striatum of rats: potential pathway for mediating stimulus–response associations for sensorimotor habits

The dorsolateral part of the striatum (DLS) represents the initial stage for processing sensorimotor information in the basal ganglia. Although the DLS receives much of its input from the primary somatosensory (SI) cortex, peripheral somesthetic stimulation activates the DLS at latencies that are shorter than the response latencies recorded in the SI cortex. To identify the subcortical regions that transmit somesthetic information directly to the DLS, we deposited small quantities of retrograde tracers at DLS sites that displayed consistent time-locked responses to controlled whisker stimulation. The neurons that were retrogradely labeled by these injections were located mainly in the sensorimotor cortex and, to a lesser degree, in the amygdala and thalamus. Quantitative analysis of neuronal labeling in the thalamus indicated that the strongest thalamic input to the whisker-sensitive part of the DLS originates from the medial posterior nucleus (POm), a somesthetic-related region that receives inputs from the spinal trigeminal nucleus. Anterograde tracer injections in POm confirmed that this thalamic region projects to the DLS neuropil. In subsequent experiments, simultaneous recordings from POm and the DLS during whisker stimulation showed that POm consistently responds before the DLS. These results suggest that POm could transmit somesthetic information to the DLS, and this modality-specific thalamostriatal pathway may cooperate with the thalamostriatal projections that originate from the intralaminar nuclei.

Subthalamic deep brain stimulation increases pallidal firing rate and regularity

While high-frequency stimulation of the subthalamic nucleus (STN-HFS) is highly effective in the treatment of Parkinson's disease (PD), the mechanisms underlying its therapeutic action remain unclear. Here, we report changes of single-neuron pallidal activity during STN-HFS in a parkinsonian patient. STN-HFS increased firing rate in both segments of the pallidum. Neurons displayed time-locked responses to stimulation pulses, with an early excitation followed by inhibition and late excitation. Finally, pallidal neurons fired more regularly during STN-HFS. The time-locked responses and increased firing regularity may override abnormally patterned pallidal activity, and thereby significantly contribute to the clinical efficacy of STN-HFS in PD.

Direct Recordings of Pitch Responses from Human Auditory Cortex

SummaryPitch is a fundamental percept with a complex relationship to the associated sound structure [1]. Pitch perception requires brain representation of both the structure of the stimulus and the pitch that is perceived. We describe direct recordings of local field potentials from human auditory cortex made while subjects perceived the transition between noise and a noise with a regular repetitive structure in the time domain at the millisecond level called regular-interval noise (RIN) [2]. RIN is perceived to have a pitch when the rate is above the lower limit of pitch [3], at approximately 30 Hz. Sustained time-locked responses are observed to be related to the temporal regularity of the stimulus, commonly emphasized as a relevant stimulus feature in models of pitch perception (e.g., [1]). Sustained oscillatory responses are also demonstrated in the high gamma range (80–120 Hz). The regularity responses occur irrespective of whether the response is associated with pitch perception. In contrast, the oscillatory responses only occur for pitch. Both responses occur in primary auditory cortex and adjacent nonprimary areas. The research suggests that two types of pitch-related activity occur in humans in early auditory cortex: time-locked neural correlates of stimulus regularity and an oscillatory response related to the pitch percept.