Cue-evoked Activity Research Articles

Orbitofrontal Cortex Mediates Sustained Basolateral Amygdala Encoding of Cued Reward-Seeking States.

Basolateral amygdala (BLA) neurons are engaged by emotionally salient stimuli. An area of increasing interest is how BLA dynamics relate to evolving reward-seeking behavior, especially under situations of uncertainty or ambiguity. Here, we recorded the activity of individual BLA neurons in male rats across the acquisition and extinction of conditioned reward seeking. We assessed ongoing neural dynamics in a task where long reward cue presentations preceded an unpredictable, variably time reward delivery. We found that, with training, BLA neurons discriminated the CS+ and CS- cues with sustained cue-evoked activity that correlated with behavior and terminated only after reward receipt. BLA neurons were bidirectionally modulated, with a majority showing prolonged inhibition during cued reward seeking. Strikingly, population-level analyses revealed that neurons showing cue-evoked inhibitions and those showing excitations similarly represented the CS+ and behavioral state. This sustained population code rapidly extinguished in parallel with conditioned behavior. We next assessed the contribution of the orbitofrontal cortex (OFC), a major reciprocal partner to the BLA. Inactivation of the OFC while simultaneously recording in the BLA revealed a blunting of sustained cue-evoked activity in the BLA that accompanied reduced reward seeking. Optogenetic disruption of BLA activity and OFC terminals in the BLA also reduced reward seeking. Our data indicate that the BLA represents reward-seeking states via sustained, bidirectional cue-driven neural encoding. This code is regulated by cortical input and is important for the maintenance of vigilant reward-seeking behavior.

Acquired alterations in nucleus accumbens responsiveness to a cocaine-paired discriminative stimulus preceding rats’ daily cocaine consumption

Resumption of drug taking is a primary focus for substance use disorder research and can be triggered by drug-associated environmental stimuli. The Nucleus Accumbens (NAc) is a key brain region which guides motivated behavior and is implicated in resumption. Yet, there remains a pressing need to characterize NAc neurons’ responsiveness to drug associated stimuli during withdrawal and abstinence. We recorded discriminative stimulus (DS) induced NAc activity via in vivo single-unit electrophysiology in rats that self-administered cocaine. Male and female rats implanted with a jugular catheter and a microwire array in NAc Core and Shell self-administered cocaine under control of a 30s auditory DS for 6 hours per session across 14 consecutive days. Rats acquired tone discrimination within 4 sessions. To exclude pharmacological effects of circulating cocaine from all neuronal analyses, we studied changes in DS-induced firing only for trials preceding the first infusion of cocaine in each of the 14 sessions, which were defined as “pre-drug trials.” NAc neuron responses were assessed prior to tone-evoked movement onset. Responsiveness to the DS tone was exhibited throughout all sessions by the NAc Core population, but only during Early sessions by the NAc Shell population. Both Core and Shell responded selectively to the DS, i.e., more strongly on drug taking trials, or Hits, than on Missed opportunities. These findings suggest that NAc Core and Shell play distinct roles in initiating cocaine seeking prior to daily cocaine consumption, and align with reports suggesting that as drug use becomes chronic, cue-evoked activity shifts from NAc Shell to NAc Core.

Recruitment and disruption of ventral pallidal cue encoding during alcohol seeking.

A critical area of inquiry in the neurobiology of alcohol abuse is the mechanism by which cues gain the ability to elicit alcohol use. Previously, we found that cue-evoked activity in rat ventral pallidum robustly encodes the value of sucrose cues trained under both Pavlovian and instrumental contingencies, despite a stronger relationship between cue-evoked activity and behavioral latency after instrumental training (Richard etal., 2018, Elife, 7, e33107). Here, we assessed: (a) ventral pallidal representations of Pavlovian versus instrumental cues trained with alcohol reward, and (b) the impact of non-associative alcohol exposure on ventral pallidal representations of sucrose cues. Decoding of cue identity based on ventral pallidum firing was blunted for the Pavlovian alcohol cue in comparison to both the instrumental cue trained with alcohol and either cue type trained with sucrose. Further, non-associative alcohol exposure had opposing effects on ventral pallidal encoding of sucrose cues trained on instrumental versus Pavlovian associations, enhancing decoding accuracy for an instrumental discriminative stimulus and reducing decoding accuracy for a Pavlovian conditioned stimulus. These findings suggest that alcohol exposure can drive biased engagement of specific reward-related signals in the ventral pallidum.

Sign Tracking and Goal Tracking Are Characterized by Distinct Patterns of Nucleus Accumbens Activity.

During Pavlovian conditioning, if a cue (e.g., lever extension) predicts reward delivery in a different location (e.g., a food magazine), some individuals will come to approach and interact with the cue, a behavior known as sign tracking (ST), and others will approach the site of reward, a behavior known as goal tracking (GT). In rats, the acquisition of ST versus GT behavior is associated with distinct profiles of dopamine release in the nucleus accumbens (NAc), but it is unknown whether it is associated with different patterns of accumbens neural activity. Therefore, we recorded from individual neurons in the NAc core during the acquisition, maintenance, and extinction of ST and GT behavior. Even though NAc dopamine is specifically important for the acquisition and expression of ST, we found that cue-evoked excitatory responses encode the vigor of both ST and GT behavior. In contrast, among sign trackers only, there was a prominent decrease in reward-related activity over the course of training, which may reflect the decreasing reward prediction error encoded by phasic dopamine. Finally, both behavior and cue-evoked activity were relatively resistant to extinction in sign trackers, as compared with goal trackers, although a subset of neurons in both groups retained their cue-evoked responses. Overall, the results point to the convergence of multiple forms of reward learning in the NAc.

Using Expectancy Theory to quantitatively dissociate the neural representation of motivation from its influential factors in the human brain: An fMRI study

Researchers have yet to apply a formal operationalized theory of motivation to neurobiology that would more accurately and precisely define neural activity underlying motivation. We overcome this challenge with the novel application of the Expectancy Theory of Motivation to human fMRI to identify brain activity that explicitly reflects motivation. Expectancy Theory quantitatively describes how individual constructs determine motivation by defining motivation force as the product of three variables: expectancy – belief that effort will better performance; instrumentality – belief that successful performance leads to particular outcome, and valence – outcome desirability. Here, we manipulated information conveyed by reward-predicting cues such that relative cue-evoked activity patterns could be statistically mapped to individual Expectancy Theory variables. The variable associated with activity in any voxel is only reported if it replicated between two groups of healthy participants. We found signals in midbrain, ventral striatum, sensorimotor cortex, and visual cortex that specifically map to motivation itself, rather than other factors. This is important because, for the first time, it empirically clarifies approach motivation neural signals during reward anticipation. It also highlights the effectiveness of the application of Expectancy Theory to neurobiology to more precisely and accurately probe motivation neural correlates than has been achievable previously.

Limbic-motor integration by neural excitations and inhibitions in the nucleus accumbens.

The nucleus accumbens (NAc) has often been described as a "limbic-motor interface," implying that the NAc integrates the value of expected rewards with the motor planning required to obtain them. However, there is little direct evidence that the signaling of individual NAc neurons combines information about predicted reward and behavioral response. We report that cue-evoked neural responses in the NAc form a likely physiological substrate for its limbic-motor integration function. Across task contexts, individual NAc neurons in behaving rats robustly encode the reward-predictive qualities of a cue, as well as the probability of behavioral response to the cue, as coexisting components of the neural signal. In addition, cue-evoked activity encodes spatial and locomotor aspects of the behavioral response, including proximity to a reward-associated target and the latency and speed of approach to the target. Notably, there are important limits to the ability of NAc neurons to integrate motivational information into behavior: in particular, updating of predicted reward value appears to occur on a relatively long timescale, since NAc neurons fail to discriminate between cues with reward associations that change frequently. Overall, these findings suggest that NAc cue-evoked signals, including inhibition of firing (as noted here for the first time), provide a mechanism for linking reward prediction and other motivationally relevant factors, such as spatial proximity, to the probability and vigor of a reward-seeking behavioral response.NEW & NOTEWORTHY The nucleus accumbens (NAc) is thought to link expected rewards and action planning, but evidence for this idea remains sparse. We show that, across contexts, both excitatory and inhibitory cue-evoked activity in the NAc jointly encode reward prediction and probability of behavioral responding to the cue, as well as spatial and locomotor properties of the response. Interestingly, although spatial information in the NAc is updated quickly, fine-grained updating of reward value occurs over a longer timescale.

Prefrontal neurons encode context-based response execution and inhibition in reward seeking and extinction

The prefrontal cortex (PFC) guides execution and inhibition of behavior based on contextual demands. In rodents, the dorsal/prelimbic (PL) medial PFC (mPFC) is frequently considered essential for execution of goal-directed behavior ("go") whereas ventral/infralimbic (IL) mPFC is thought to control behavioral suppression ("stop"). This dichotomy is commonly seen for fear-related behaviors, and for some behaviors related to cocaine seeking. Overall, however, data for reward-directed behaviors are ambiguous, and few recordings of PL/IL activity have been performed to demonstrate single-neuron correlates. We recorded neuronal activity in PL and IL during discriminative stimulus driven sucrose seeking followed by multiple days of extinction of the reward-predicting stimulus. Contrary to a generalized PL-go/IL-stop hypothesis, we found cue-evoked activity in PL and IL during reward seeking and extinction. Upon analyzing this activity based on resultant behavior (lever press or withhold), we found that neurons in both areas encoded contextually appropriate behavioral initiation (during reward seeking) and withholding (during extinction), where context was dictated by response-outcome contingencies. Our results demonstrate that PL and IL signal contextual information for regulation of behavior, irrespective of whether that involves initiation or suppression of behavioral responses, rather than topographically encoding go vs. stop behaviors. The use of context to optimize behavior likely plays an important role in maximizing utility-promoting exertion of activity when behaviors are rewarded and conservation of energy when not.

Altered basolateral amygdala encoding in an animal model of schizophrenia.

It has been proposed that schizophrenia results, in part, from the inappropriate or spurious attribution of salience to cues in the environment. We have recently reported neural correlates of salience in the basolateral amygdala (ABL) of rats during learning in an odor-guided discrimination task. Here we tested whether this dopamine-dependent salience signal is altered in rats with neonatal ventral hippocampal lesions (NVHLs), a rodent model of schizophrenia. We found that ABL signals related to violations in reward prediction were only mildly affected by NVHL; however, neurons in rats with NVHLs showed significantly stronger selectivity during odor sampling, particularly for the more salient large-reward cue. The elevated cue-evoked activity in NVHL rats was correlated with heightened orienting behavior and also with changes in firing to the shifts in reward, suggesting that it reflected abnormal signaling of the large reward-predicting cue's salience. These results are broadly consistent with the proposal that schizophrenics suffer from enhanced signaling of salience.

Central role for the insular cortex in mediating conditioned responses to anticipatory cues.

Reward-related circuits are fundamental for initiating feeding on the basis of food-predicting cues, whereas gustatory circuits are believed to be involved in the evaluation of food during consumption. However, accumulating evidence challenges such a rigid separation. The insular cortex (IC), an area largely studied in rodents for its role in taste processing, is involved in representing anticipatory cues. Although IC responses to anticipatory cues are well established, the role of IC cue-related activity in mediating feeding behaviors is poorly understood. Here, we examined the involvement of the IC in the expression of cue-triggered food approach in mice trained with a Pavlovian conditioning paradigm. We observed a significant change in neuronal firing during presentation of the cue. Pharmacological silencing of the IC inhibited food port approach. Such a behavior could be recapitulated by temporally selective inactivation during the cue. These findings represent the first evidence, to our knowledge, that cue-evoked neuronal activity in the mouse IC modulates behavioral output, and demonstrate a causal link between cue responses and feeding behaviors.

Ageing diminishes the modulation of human brain responses to visual food cues by meal ingestion.

Rates of obesity are greatest in middle age. Obesity is associated with altered activity of brain networks sensing food-related stimuli and internal signals of energy balance, which modulate eating behaviour. The impact of healthy mid-life ageing on these processes has not been characterised. We therefore aimed to investigate changes in brain responses to food cues, and the modulatory effect of meal ingestion on such evoked neural activity, from young adulthood to middle age. Twenty-four healthy, right-handed subjects, aged 19.5-52.6 years, were studied on separate days after an overnight fast, randomly receiving 50 ml water or 554 kcal mixed meal before functional brain magnetic resonance imaging while viewing visual food cues. Across the group, meal ingestion reduced food cue-evoked activity of amygdala, putamen, insula and thalamus, and increased activity in precuneus and bilateral parietal cortex. Corrected for body mass index, ageing was associated with decreasing food cue-evoked activation of right dorsolateral prefrontal cortex (DLPFC) and precuneus, and increasing activation of left ventrolateral prefrontal cortex (VLPFC), bilateral temporal lobe and posterior cingulate in the fasted state. Ageing was also positively associated with the difference in food cue-evoked activation between fed and fasted states in the right DLPFC, bilateral amygdala and striatum, and negatively associated with that of the left orbitofrontal cortex and VLPFC, superior frontal gyrus, left middle and temporal gyri, posterior cingulate and precuneus. There was an overall tendency towards decreasing modulatory effects of prior meal ingestion on food cue-evoked regional brain activity with increasing age. Healthy ageing to middle age is associated with diminishing sensitivity to meal ingestion of visual food cue-evoked activity in brain regions that represent the salience of food and direct food-associated behaviour. Reduced satiety sensing may have a role in the greater risk of obesity in middle age.

A Network State Linking Motivation and Action in the Nucleus Accumbens

In this issue of Neuron, McGinty etal. (2013) report that the activity of cue-responsive neurons in the rat nucleus accumbens predicts the vigor of the subsequent approach movement. The characterization of this network state between motivation and action lends novel mechanistic insight to a spectrum of cue-elicited behaviors.

Deficits in attentional control: cholinergic mechanisms and circuitry-based treatment approaches.

The cognitive control of attention involves maintaining task rules in working memory (or "online"), monitoring reward and error rates, filtering distractors, and suppressing prepotent, and competitive responses. Weak attentional control increases distractibility and causes attentional lapses, impulsivity, and attentional fatigue. Levels of tonic cholinergic activity (changes over tens of seconds or minutes) modulate cortical circuitry as a function of the demands on cognitive control. Increased cholinergic modulation enhances the representation of cues, by augmenting cue-evoked activity in thalamic glutamatergic afferents, thereby increasing the rate of detection. Such cholinergic modulation is mediated primarily via α4β2* nicotinic acetylcholine receptors. Animal experiments and clinical trials in adult patients with ADHD indicate that attentional symptoms and disorders may benefit from drugs that stimulate this receptor. Tonic cholinergic modulation of cue-evoked glutamatergic transients in prefrontal regions is an essential component of the brain's executive circuitry. This circuitry model guides the development of treatments of deficits in attentional control.

Ventral Striatal Neurons Encode the Value of the Chosen Action in Rats Deciding between Differently Delayed or Sized Rewards

The ventral striatum (VS) is thought to serve as a gateway whereby associative information from the amygdala and prefrontal regions can influence motor output to guide behavior. If VS mediates this "limbic-motor" interface, then one might expect neural correlates in VS to reflect this information. Specifically, neural activity should reflect the integration of motivational value with subsequent behavior. To test this prediction, we recorded from single units in VS while rats performed a choice task in which different odor cues indicated that reward was available on the left or on the right. The value of reward associated with a left or rightward movement was manipulated in separate blocks of trials by either varying the delay preceding reward delivery or by changing reward size. Rats' behavior was influenced by the value of the expected reward and the response required to obtain it, and activity in the majority of cue-responsive VS neurons reflected the integration of these two variables. Unlike similar cue-evoked activity reported previously in dopamine neurons, these correlates were only observed if the directional response was subsequently executed. Furthermore, activity was correlated with the speed at which the rats' executed the response. These results are consistent with the notion that VS serves to integrate information about the value of an expected reward with motor output during decision making.

Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards

The dopamine system is thought to be involved in making decisions about reward. Here we recorded from the ventral tegmental area in rats learning to choose between differently delayed and sized rewards. As expected, the activity of many putative dopamine neurons reflected reward prediction errors, changing when the value of the reward increased or decreased unexpectedly. During learning, neural responses to reward in these neurons waned and responses to cues that predicted reward emerged. Notably, this cue-evoked activity varied with size and delay. Moreover, when rats were given a choice between two differently valued outcomes, the activity of the neurons initially reflected the more valuable option, even when it was not subsequently selected.

Preparatory activity in visual cortex indexes distractor suppression during covert spatial orienting.

The deployment of spatial attention induces retinotopically specific increases in neural activity that occur even before a target stimulus is presented. Although this preparatory activity is thought to prime the attended regions, thereby improving perception and recognition, it is not yet clear whether this activity is a manifestation of signal enhancement at the attended locations or suppression of interference from distracting stimuli (or both). We investigated the functional role of these preparatory shifts by isolating a distractor suppression component of selection. Behavioral data have shown that manipulating the probability that visual distractors will appear modulates distractor suppression without concurrent changes in signal enhancement. In 2 experiments, functional magnetic resonance imaging revealed increased cue-evoked activity in retinotopically specific regions of visual cortex when increased distractor suppression was elicited by a high probability of distractors. This finding directly links cue-evoked preparatory activity in visual cortex with a distractor suppression component of visual selective attention.

Persistent Cue-Evoked Activity of Accumbens Neurons after Prolonged Abstinence from Self-Administered Cocaine

Persistent neural processing of information regarding drug-predictive environmental stimuli may be involved in motivating drug abusers to engage in drug seeking after abstinence. The addictive effects of various drugs depend on the mesocorticolimbic dopamine system innervating the nucleus accumbens. We used single-unit recording in rats to test whether accumbens neurons exhibit responses to a discriminative stimulus (SD) tone previously paired with cocaine availability during cocaine self-administration. Presentation of the tone after 3-4 weeks of abstinence resulted in a cue-induced relapse of drug seeking under extinction conditions. Accumbens neurons did not exhibit tone-evoked activity before cocaine self-administration training but exhibited significant SD tone-evoked activity during extinction. Under extinction conditions, shell neurons exhibited significantly greater activity evoked by the SD tone than that evoked by a neutral tone (i.e., never paired with reinforcement). In contrast, core neurons responded indiscriminately to presentations of the SD tone or the neutral tone. Accumbens shell neurons exhibited significantly greater SD tone-evoked activity than did accumbens core neurons. Although the onset of SD tone-evoked activity occurred well before the earliest movements commenced (150 msec), this activity often persisted beyond the onset of tone-evoked movements. These results indicate that accumbens shell neurons exhibit persistent processing of information regarding reward-related stimuli after prolonged drug abstinence. Moreover, the accumbens shell appears to be involved in discriminating the motivational value of reward-related associative stimuli, whereas the accumbens core does not.