Arousal Signals Research Articles

Video Quality Prediction: An Exploratory Study With Valence and Arousal Signals

Video Quality Prediction: An Exploratory Study With Valence and Arousal Signals

Evidence that pupil dilation and cardiac afferent signalling differentially impact the processing of emotional intensity and racial bias

Interoceptive cardiac arousal signals (e.g., from baroreceptor firing at ventricular systole compared to diastole) have been found to enhance perception of fearful versus neutral faces. They have also been found to amplify racially biased misidentification of tools as weapons when preceded by facial images of Black versus White individuals. Since pupil size is strongly coupled to arousal, we tested if experimental manipulation of pupil size influences fear processing in emotional judgement and racial bias tasks involving measurement of cardiac signals. In a sample of 22 non-clinical participants in an emotional intensity judgement task, pupil size did not affect emotional intensity ratings. Nor did it interact with differential effects of cardiac systole versus diastole on intensity judgements of fearful and neutral faces, replicated here. In a sample of 25 non-clinical participants in a weapons identification task, larger pupil size resulted in faster response times and lower accuracy when identifying tools and weapons. However, pupil size did not interact with weapon versus tool identification, race of prime, or cardiac timing. We nevertheless replicated the observed increase in racially biased misidentification of tools as weapons following Black face primes presented at cardiac systole. Together our findings indicate that pupil dilation does not directly influence the processing of fear cues or perceived threat (as in racial bias) yet affects task performance by decreasing response times and accuracy. These findings contrast with the established effect of cardiac arousal signals on threat processing and may help focus interventions to mitigate related decision errors in high-pressure occupations.

Memristive Circuit Design of Brain-Like Emotional Learning and Generation.

In this work, a bionic memristive circuit with the functions of emotional learning and generation is proposed, which can perform brain-like emotional learning and generation based on various types of input information. The proposed circuit is designed based on the brain emotional learning theory in the limbic system, which mainly includes three layers of design: 1) the bottom layer is the design of the basic unit modules, such as neuron and synapse; 2) the middle layer is the design of the functional modules related to emotional learning in the limbic system, such as the amygdala, thalamus, and so on; and 3) the top layer is the design of the overall circuit, which is used to realize the function of the emotional generation. A 2-D emotional space composed of valence and arousal signals is adopted. According to the above bottom-up circuit design method, the valence and arousal signals can be generated, respectively, by designing corresponding emotional learning circuits, so as to form continuous emotions. The volatile and nonvolatile memristors are mainly used to mimic the functions of the neuron and synapse at the bottom layer of the circuit to achieve the core emotional learning function of the middle layer, thereby constructing a brain-like information processing architecture to realize the function of the emotional generation in the top layer. The simulation results in PSPICE show that the proposed circuit can learn and generate emotions like humans. If the proposed circuit is applied to a humanoid robot platform through further research, the robot may have the ability of personalized emotional interaction with humans, so that it can be effectively used in emotional companionship and other aspects.

Multisensory integration of anticipated cardiac signals with visual targets affects their detection among multiple visual stimuli

Many studies have elucidated the multisensory processing of different exteroceptive signals (e.g., auditory-visual stimuli), but less is known about the multisensory integration of interoceptive signals with exteroceptive information. Here, we investigated the perceptual outcomes and electrophysiological brain mechanisms of cardio-visual integration by using participants’ electrocardiogram signals to control the color change of a visual target in dynamically changing displays. Reaction times increased when the target change coincided with strong cardiac signals concerning the state of cardiovascular arousal (i.e., presented at the end of ventricular systole), compared to when the target change occurred at a time when cardiac arousal was relatively low (i.e., presented at the end of ventricular diastole). Moreover, the concurrence of the target change and cardiac arousal signals modulated the event-related potentials and the beta power in an early period (~100 ms after stimulus onset), and decreased the N2pc and the beta lateralization in a later period (~200 ms after stimulus onset). Our results suggest that the multisensory integration of anticipated cardiac signals with a visual target negatively affects its detection among multiple visual stimuli, potentially by suppressing sensory processing and reducing attention toward the visual target. This finding highlights the role of cardiac information in visual processing and furthers our understanding of the brain dynamics underlying multisensory perception involving both interoception and exteroception.

Altered effective connectivity of thalamus with vigilance impairments after sleep deprivation.

The thalamus is an essential gating hub to relay brainstem ascending arousal signals to attention-related networks, including the frontal-parietal attention network and default mode network, which plays an important role in attentional maintenance. Research has proved that sleep loss leads to impairment of attentional performance by affecting neural connectivity between thalamic and attention-related cortical regions. However, the effective connectivity between thalamic and cortical areas in the resting state remains unclear after sleep deprivation. The present study aimed to investigate the effect of sleep deprivation on the effective connectivity between thalamic and cortical areas, and explored whether the alteration of the effective connectivity can predict vigilance impairment after sleep deprivation. We implemented resting-state functional magnetic resonance imaging with 31 participants under both normally-rested and sleep-deprivation conditions. The Granger causality analysis was used to investigate the alteration of effective connectivity between thalamic and cortical areas, and the psychomotor vigilance task was used to measure vigilance. Correlation analysis investigated the relationship between the alteration in effective connectivity and vigilance performance. Sleep deprivation significantly decreased the effective connectivity from the thalamus to the nodes in the default mode network, and significantly increased in the effective connectivity from the thalamus to the nodes in the frontal-parietal attention network. Critically, increased thalamus-parietal effective connectivity was correlated with decreased lapses. The findings indicated sleep deprivation induced a robust alteration of the communication from the sub-cortical to cortical regions. The alteration of thalamus-parietal effective connectivity was anti-correlated with sustained attentional impairment after sleep deprivation.

Pupil-linked Arousal Signals in the Midbrain Superior Colliculus.

The orienting response evoked by the appearance of a salient stimulus is modulated by arousal; however, neural underpinnings for the interplay between orienting and arousal are not well understood. The superior colliculus (SC), causally involved in multiple components of the orienting response including gaze and attention shifts, receives not only multisensory and cognitive inputs but also arousal-regulated inputs from various cortical and subcortical structures. To investigate the impact of moment-by-moment fluctuations in arousal on orienting saccade responses, we used microstimulation of the monkey SC to trigger saccade responses, and we used pupil size and velocity to index the level of arousal at stimulation onset because these measures correlate with changes in brain states and locus coeruleus activity. Saccades induced by SC microstimulation correlated with prestimulation pupil velocity, with higher pupil velocities on trials without evoked saccades than with evoked saccades. In contrast, prestimulation absolute pupil size did not correlate with saccade behavior. Moreover, pupil velocity correlated with evoked saccade latency and metrics. Together, our results demonstrated that small fluctuations in arousal, indexed by pupil velocity, can modulate the saccade response evoked by SC microstimulation in awake behaving monkeys.

Excited and aroused: The predictive importance of simple choice process metrics.

We conduct a lottery experiment to assess the predictive importance of simple choice process metrics (SCPMs) in forecasting risky 50/50 gambling decisions using different types of machine learning algorithms as well as traditional choice modeling approaches. The SCPMs are recorded during a fixed pre-decision phase and are derived from tracking subjects’ eye movements, pupil sizes, skin conductance, and cardiovascular and respiratory signals. Our study demonstrates that SCPMs provide relevant information for predicting gambling decisions, but we do not find forecasting accuracy to be substantially affected by adding SCPMs to standard choice data. Instead, our results show that forecasting accuracy highly depends on differences in subject-specific risk preferences and is largely driven by including information on lottery design variables. As a key result, we find evidence for dynamic changes in the predictive importance of psychophysiological responses that appear to be linked to habituation and resource-depletion effects. Subjects’ willingness to gamble and choice-revealing arousal signals both decrease as the experiment progresses. Moreover, our findings highlight the importance of accounting for previous lottery payoff characteristics when investigating the role of emotions and cognitive bias in repeated decision-making scenarios.

Coupling of pupil- and neuronal population dynamics reveals diverse influences of arousal on cortical processing.

Fluctuations in arousal, controlled by subcortical neuromodulatory systems, continuously shape cortical state, with profound consequences for information processing. Yet, how arousal signals influence cortical population activity in detail has so far only been characterized for a few selected brain regions. Traditional accounts conceptualize arousal as a homogeneous modulator of neural population activity across the cerebral cortex. Recent insights, however, point to a higher specificity of arousal effects on different components of neural activity and across cortical regions. Here, we provide a comprehensive account of the relationships between fluctuations in arousal and neuronal population activity across the human brain. Exploiting the established link between pupil size and central arousal systems, we performed concurrent magnetoencephalographic (MEG) and pupillographic recordings in a large number of participants, pooled across three laboratories. We found a cascade of effects relative to the peak timing of spontaneous pupil dilations: Decreases in low-frequency (2-8 Hz) activity in temporal and lateral frontal cortex, followed by increased high-frequency (>64 Hz) activity in mid-frontal regions, followed by monotonic and inverted U relationships with intermediate frequency-range activity (8-32 Hz) in occipito-parietal regions. Pupil-linked arousal also coincided with widespread changes in the structure of the aperiodic component of cortical population activity, indicative of changes in the excitation-inhibition balance in underlying microcircuits. Our results provide a novel basis for studying the arousal modulation of cognitive computations in cortical circuits.

Behavioral and physiological monitoring for awake neurovascular coupling experiments: a how-to guide.

.SignificanceFunctional brain imaging in awake animal models is a popular and powerful technique that allows the investigation of neurovascular coupling (NVC) under physiological conditions. However, ubiquitous facial and body motions (fidgeting) are prime drivers of spontaneous fluctuations in neural and hemodynamic signals. During periods without movement, animals can rapidly transition into sleep, and the hemodynamic signals tied to arousal state changes can be several times larger than sensory-evoked responses. Given the outsized influence of facial and body motions and arousal signals in neural and hemodynamic signals, it is imperative to detect and monitor these events in experiments with un-anesthetized animals.AimTo cover the importance of monitoring behavioral state in imaging experiments using un-anesthetized rodents, and describe how to incorporate detailed behavioral and physiological measurements in imaging experiments.ApproachWe review the effects of movements and sleep-related signals (heart rate, respiration rate, electromyography, intracranial pressure, whisking, and other body movements) on brain hemodynamics and electrophysiological signals, with a focus on head-fixed experimental setup. We summarize the measurement methods currently used in animal models for detection of those behaviors and arousal changes. We then provide a guide on how to incorporate this measurements with functional brain imaging and electrophysiology measurements.ResultsWe provide a how-to guide on monitoring and interpreting a variety of physiological signals and their applications to NVC experiments in awake behaving mice.ConclusionThis guide facilitates the application of neuroimaging in awake animal models and provides neuroscientists with a standard approach for monitoring behavior and other associated physiological parameters in head-fixed animals.

Memristive Circuit Design of Brain-Inspired Emotional Evolution Based on Theories of Internal Regulation and External Stimulation.

In this work, a bionic memristive circuit with functions of emotional evolution is proposed by mimicking the emotional circuit in limbic system, which can perform unconscious and conscious emotional evolutions by using theories of internal regulation and external stimulation respectively. Two kinds of memristive models, volatile and non-volatile, play key roles in the process of emotional evolution. That is, the internal regulation is mainly responsible for simulating the unconscious evolution process over time by using the forgetting effect of the volatile memristor. The external stimulation is mainly responsible for using the memristance plasticity of the non-volatile memristor to simulate the evolutionary learning behavior under the action of multi-modal inputs (such as visual, speech and text signals), so as to realize the conscious emotional evolution. A two-dimensional (2D) emotional state space consisted of valence and arousal signals is adopted, the evolution behaviors are performed on the basis of valence and arousal signals in the space, in order to achieve continuous emotional evolution and express the evolved emotions intuitively. Due to the use of memristors, the proposed circuit can realize in-memory computing, which fundamentally avoids the problem of storage wall and constructs a brain-inspired information processing architecture. The simulation results in PSPICE show that a nonlinear mapping relationship between inputs and outputs is constructed through the proposed circuit, which can carry out diversified emotional evolution based on the designed internal regulation and external stimulation evolution circuits.

The role of the arousal system in age-related differences in cortical functional network architecture.

A common finding in the aging literature is that of the brain's decreased within‐ and increased between‐network functional connectivity. However, it remains unclear what is causing this shift in network organization with age. Given the essential role of the ascending arousal system (ARAS) in cortical activation and previous findings of disrupted ARAS functioning with age, it is possible that age differences in ARAS functioning contribute to disrupted cortical connectivity. We test this possibility here using resting state fMRI data from over 500 individuals across the lifespan from the Cambridge Center for Aging and Neuroscience (Cam‐CAN) population‐based cohort. Our results show that ARAS‐cortical connectivity declines with age and, consistent with our expectations, significantly mediates some age‐related differences in connectivity within and between association networks (specifically, within the default mode and between the default mode and salience networks). Additionally, connectivity between the ARAS and association networks predicted cognitive performance across several tasks over and above the effects of age and connectivity within the cortical networks themselves. These findings suggest that age differences in cortical connectivity may be driven, at least in part, by altered arousal signals from the brainstem and that ARAS–cortical connectivity relates to cognitive performance with age.

Differentiating luminance, arousal, and cognitive signals on pupil size and microsaccades

Differentiating luminance, arousal, and cognitive signals on pupil size and microsaccades

066 Noradrenaline and acetylcholine inhibit sleep-promoting neurons of ventrolateral preoptic area through a local GABAergic circuit

Abstract Introduction The ventrolateral preoptic (VLPO) nucleus is a key area involved in the initiation and maintenance of sleep. During wakefulness, sleep-promoting galanin neurons in the VLPO are directly inhibited by arousal signals including noradrenaline and acetylcholine. We have found that while these neurotransmitters directly inhibit VLPO galanin neurons, they also activate GABAergic neurons in the VLPO that do not express galanin. We propose that when activated by monoaminergic and cholinergic inputs, these local VLPO GABAergic neurons provide an additional inhibition of the VLPO galanin sleep-promoting neurons. We tested this model in brain slices in mice. Methods We studied VLPO galanin neurons in mouse brain slices using patch-clamp recordings. We recorded from fluorescently labeled VLPO galanin neurons following the injection of a cre-dependent AAV encoding for mCherry, into the VLPO of Gal-cre mice. For the optogenetic studies we expressed channelrhodopsin-2 (ChR-2) in VLPO VGAT neurons and mCherry in galanin neurons by injecting a flp-dependent and a cre-dependent AAV encoding respectively for ChR2 and mCherry into the VLPO of VGAT-flp::Gal-cre mice. We photo-stimulated local GABAergic neurons and recorded from labeled VLPO galanin neurons. Noradrenaline, carbachol and receptor antagonists were bath-applied. Results Noradrenaline and carbachol inhibited VLPO galanin neurons by alpha-2 and muscarinic receptors and these effects were maintained in the presence of tetrodotoxin (TTX) indicating, as previously proposed, a direct inhibitory effect of noradrenaline and carbachol on VLPO galanin neurons. In addition, both noradrenaline and carbachol increased the frequency of spontaneous inhibitory post-synaptic currents (sIPSCs) of VLPO galanin neurons, suggesting an additional inhibitory action on VLPO galanin neurons. Finally, optogenetic stimulation of local VLPO GABAergic neurons produced short latency, TTX-resistant, opto-evoked IPSCs in VLPO galanin neurons. Both noradrenaline and carbachol increased the amplitude of these opto-evoked IPSCs by the activation of alpha-1 and muscarinic receptors. Conclusion Our results demonstrate that noradrenaline and acetylcholine inhibit VLPO galanin neurons directly and indirectly. Both noradrenaline and acetylcholine increase GABAergic afferent inputs to VLPO galanin neurons by activating local GABAergic neurons. We propose that during wakefulness this feedforward inhibition provides additional inhibition of VLPO galanin sleep-promoting neurons. Support (if any) NS091126 and HL149630

Pupil-linked arousal signals track the temporal organization of events in memory

Everyday life unfolds continuously, yet we tend to remember past experiences as discrete event sequences or episodes. Although this phenomenon has been well documented, the neuromechanisms that support the transformation of continuous experience into distinct and memorable episodes remain unknown. Here, we show that changes in context, or event boundaries, elicit a burst of autonomic arousal, as indexed by pupil dilation. Event boundaries also lead to the segmentation of adjacent episodes in later memory, evidenced by changes in memory for the temporal duration, order, and perceptual details of recent event sequences. These subjective and objective changes in temporal memory are also related to distinct temporal features of pupil dilations to boundaries as well as to the temporal stability of more prolonged pupil-linked arousal states. Collectively, our findings suggest that pupil measures reflect both stability and change in ongoing mental context representations, which in turn shape the temporal structure of memory.

Audio, Visual, and Electrodermal Arousal Signals as Predictors of Mental Fatigue Following Sustained Cognitive Work.

Lapses in vigilance and slowed reactions due to mental fatigue can increase risk of accidents and injuries and degrade performance. This paper describes a method for rapid, unobtrusive detection of mental fatigue based on changes in electrodermal arousal (EDA), and changes in neuromotor coordination derived from speaking. Twenty-nine Soldiers completed a 2-hour battery of cognitive tasks intended to induce fatigue. Behavioral markers derived from audio and video during speech were acquired before and after the 2hour cognitive load tasks, as was EDA. Exposure to cognitive load produced detectable increases in neuromotor variability in speech and facial measures after load and even after a recovery period. A Gaussian mixture model classifier with crossvalidation and fusion across speech, video, and EDA produced an accuracy of AUC=0.99 in detecting a change in cognitive fatigue relative to a personalized baseline.

Predicting the consequences of physical activity: An investigation into the relationship between anxiety sensitivity, interoceptive accuracy and action

The ability to predict the consequences of our actions is imperative for the everyday success of our interactions. From negotiating an uneven surface, to mounting an immune response, we continually infer the limits of our body. The current investigation considered the impact that the inferred consequences of action has on the placement of limits. We hypothesised that the performance of individuals in a novel, sprint task would reflect both their ability to accurately detect changes in bodily arousal (Interoceptive Accuracy) and the inferred consequences associated with heightened arousal signals (Anxiety Sensitivity). We found that individuals who demonstrated accuracy associated with physiological arousal changes, and who showed a heightened fear of the consequences of arousal symptoms, modified their actions by decreasing their power output (mean Watts•kg-1) in a sprint task (ΔR2 = 0.19; F(1,34) = 19.87); p<0.001). These findings provide a basis for understanding the varying actions taken as we encounter bodily perturbation.

INDIVIDUAL BALANCE OF DEFENSIVE AND APPETITIVE MOTIVATIONAL SYSTEMS OF THE BRAIN AS A LIKELY NEUROPHYSIOLOGICAL ENDOPHENOTYPE OF DEPRESSION IN THE METRIC OF COGNITIVE EVOKED POTENTIALS

The aim of the study was to investigate the characteristics of the individual balance of the activity of brain defensive and reinforcing systems in patients with major depressive disorder. Material and methods . In 41 patients with major depressive disorder and 32 healthy subjects, we investigated visual evoked potentials in the emotional Oddball paradigm in perception of high and low arousal motivational signals of reward and threat. Results and discussion . It was established that reduced amplitude of the neuronal response in the per ception of high arousal motivational signals of reward and, in a less degree, threat, is associated with an indicator of the clinical severity of depression. It supports the model of emotion context insensitivity in depression. However, a more pronounced reduce in the neuronal response to stimuli of reward may indicate a prevailing deficiency of the reinforcement system. Thus, the late positive potential magnitude of visual evoked potentials for high arousal motivational signals of reward and threat can be viewed as a promising objective neurobiological marker for monitoring the dynamics of the disturbed individual balance of the defensive and reinforcing brain systems in major depressive disorder patients which can become an important tool of personalized prevention and treatment strategy.

Encoding prediction signals during appetitive and aversive Pavlovian conditioning in the primate lateral hypothalamus.

The lateral hypothalamus (LH), which plays a role in homeostatic functions such as appetite regulation, is also linked to arousal and motivational behavior. However, little is known about how these components are encoded in the LH. Thus cynomolgus monkeys were conditioned with two distinct contexts, i.e., an appetitive context with available rewards and an aversive context with predicted air puffs. Different LH neuron groups encoded different degrees of expectation, predictability, and risks of rewards in a specific manner. A nearly equal number of one-third of the recorded LH neurons showed a positive or negative correlation between their response to visual conditioned stimuli (CS) that predicted the probabilistic delivery of rewards (0%, 50%, and 100%) and the associative values. For another one-third of recorded neurons, a nearly equal number showed a positive or negative correlation between their responses to rewards [appetitive unconditioned stimulus (US)] and reward predictability. Some neurons exhibited their highest or lowest trace-period responses in the 50% reward trials. These response modulations were represented independently and overlaid on a consistent excitatory or inhibitory response across the conditioning events. LH neurons also showed consistent responses in the aversive context. However, the responses to aversive conditioning events depending on the air puff value and predictability were less common. The multifaceted modulation of consistent activity related to outcome predictions may reflect motivational and arousal signals. Furthermore, it may underlie the role the LH plays in the integration and relay of signals to cortices for adaptive and goal-directed physiological and behavioral responses to environmental changes. NEW & NOTEWORTHY The lateral hypothalamus (LH) is implicated in motivational and arousal behavior; however, the detailed information carried by single LH neurons remains unclear. We demonstrate that primate LH neurons encode multiple combinations of signals concerning different degrees of expectation, appreciation, and uncertainty of rewards in consistent responses across conditioning events and between different contexts. This multifaceted modulation of activity may underlie the role of the LH as a critical node integrating motivational signals with arousal signals.

다중 심리-생체지표 기반의 신경망을 이용한 부정 감성 인식

다중 심리-생체지표 기반의 신경망을 이용한 부정 감성 인식

Long‐term video surveillance and automated analyses reveal arousal patterns in groups of hibernating bats

Abstract Understanding natural behaviours is essential to determining how animals deal with new threats (e.g. emerging diseases). However, natural behaviours of animals with cryptic lifestyles, like hibernating bats, are often poorly characterized. White‐nose syndrome (WNS) is an unprecedented disease threatening multiple species of hibernating bats, and pathogen‐induced changes to host behaviour may contribute to mortality. To better understand the behaviours of hibernating bats and how they might relate to WNS, we developed new ways of studying hibernation across entire seasons. We used thermal‐imaging video surveillance cameras to observe little brown bats (Myotis lucifugus) and Indiana bats (M. sodalis) in two caves over multiple winters. We developed new, sharable software to test for autocorrelation and periodicity of arousal signals in recorded video. We processed 740 days (17,760 hr) of video at a rate of &gt;1,000 hr of video imagery in less than 1 hr using a desktop computer with sufficient resolution to detect increases in arousals during midwinter in both species and clear signals of daily arousal periodicity in infected M. sodalis. Our unexpected finding of periodic synchronous group arousals in hibernating bats demonstrate the potential for video methods and suggest some bats may have innate behavioural strategies for coping with WNS. Surveillance video and accessible analysis software make it now practical to investigate long‐term behaviours of hibernating bats and other hard‐to‐study animals.