Phasic Dopamine Signaling Research Articles

Dopamine-mediated formation of a memory module in the nucleus accumbens for goal-directed navigation.

Spatial memories guide navigation efficiently toward desired destinations. However, the neuronal and circuit mechanisms underlying the encoding of goal locations and its translation into goal-directed navigation remain unclear. Here we demonstrate that mice rapidly form a spatial memory of a shelter during shelter experiences, guiding escape behavior toward the goal location-a shelter-when under threat. Dopaminergic neurons in the ventral tegmental area and their projection to the nucleus accumbens (NAc) encode safety signals associated with the shelter. Optogenetically induced phasic dopamine signals are sufficient to create a place memory that directs escape navigation. Converging dopaminergic and hippocampal glutamatergic inputs to the NAc mediate the formation of a goal-related memory within a subpopulation of NAc neurons during shelter experiences. Artificial co-activation of this goal-related NAc ensemble with neurons in the dorsal periaqueductal gray was sufficient to trigger memory-guided, rather than random, escape behavior. These findings provide causal evidence of cognitive circuit modules linking memory with goal-directed action.

Orphan receptor-GPR52 inverse agonist efficacy in ameliorating chronic stress-related deficits in reward motivation and phasic accumbal dopamine activity in mice

Reward processing dysfunctions e.g., anhedonia, apathy, are common in stress-related neuropsychiatric disorders including depression and schizophrenia, and there are currently no established therapies. One potential therapeutic approach is restoration of reward anticipation during appetitive behavior, deficits in which co-occur with attenuated nucleus accumbens (NAc) activity, possibly due to NAc inhibition of mesolimbic dopamine (DA) signaling. Targeting NAc regulation of ventral tegmental area (VTA) DA neuron responsiveness to reward cues could involve either the direct or indirect—via ventral pallidium (VP)—pathways. One candidate is the orphan G protein-coupled receptor GPR52, expressed by DA receptor 2 NAc neurons that project to VP. In mouse brain-slice preparations, GPR52 inverse agonist (GPR52-IA) attenuated evoked inhibitory postsynaptic currents at NAc-VP neurons, which could disinhibit VTA DA neurons. A mouse model in which chronic social stress leads to reduced reward learning and effortful motivation was applied to investigate GPR52-IA behavioral effects. Control and chronically stressed mice underwent a discriminative learning test of tone-appetitive behavior-sucrose reinforcement: stress reduced appetitive responding and discriminative learning, and these anticipatory behaviors were dose-dependently reinstated by GPR52-IA. The same mice then underwent an effortful motivation test of operant behavior-tone-sucrose reinforcement: stress reduced effortful motivation and GPR52-IA dose-dependently restored it. In a new cohort, GRABDA-sensor fibre photometry was used to measure NAc DA activity during the motivation test: in stressed mice, reduced motivation co-occurred with attenuated NAc DA activity specifically to the tone that signaled reinforcement of effortful behavior, and GPR52-IA ameliorated both deficits. These findings: (1) Demonstrate preclinical efficacy of GPR52 inverse agonism for stress-related deficits in reward anticipation during appetitive behavior. (2) Suggest that GPR52-dependent disinhibition of the NAc-VP-VTA-NAc circuit, leading to increased phasic NAc DA signaling of earned incentive stimuli, could account for these clinically relevant effects.

Phasic dopamine signals are reduced in the spontaneously hypertensive rat and increased by methylphenidate.

The spontaneously hypertensive rat (SHR) is a selectively bred animal strain that is frequently used to model attention-deficit hyperactivity disorder (ADHD) because of certain genetically determined behavioural characteristics. To test the hypothesis that the characteristically altered response to positive reinforcement in SHRs may be due to altered phasic dopamine response to reward, we measured phasic dopamine signals in the SHRs and Sprague Dawley (SD) rats using in vivo fast-scan cyclic voltammetry. The effects of the dopamine reuptake inhibitor, methylphenidate, on these signals were also studied. Phasic dopamine signals during the pairing of a sensory cue with electrical stimulation of midbrain dopamine neurons were significantly smaller in the SHRs than in the SD rats. Over repeated pairings, the dopamine response to the sensory cue increased, whereas the response to the electrical stimulation of dopamine neurons decreased, similarly in both strains. However, the final amplitude of the response to the sensory cue after pairing was significantly smaller in SHRs than in the SD rats. Methylphenidate increased responses to sensory cues to a significantly greater extent in the SHRs than in the SD rats, due largely to differences in the low dose effect. At a higher dose, methylphenidate increased responses to sensory cues and electrical stimulation similarly in SHRs and SD rats. The smaller dopamine responses may explain the reduced salience of reward-predicting cues previously reported in the SHR, whereas the action of methylphenidate on the cue response suggests a potential mechanism for the therapeutic effects of low-dose methylphenidate in ADHD.

Adaptor protein-3 produces synaptic vesicles that release phasic dopamine

The burst firing of midbrain dopamine neurons releases a phasic dopamine signal that mediates reinforcement learning. At many synapses, however, high firing rates deplete synaptic vesicles (SVs), resulting in synaptic depression that limits release. What accounts for the increased release of dopamine by stimulation at high frequency? We find that adaptor protein-3 (AP-3) and its coat protein VPS41 promote axonal dopamine release by targeting vesicular monoamine transporter VMAT2 to the axon rather than dendrites. AP-3 and VPS41 also produce SVs that respond preferentially to high-frequency stimulation, independent of their role in axonal polarity. In addition, conditional inactivation of VPS41 in dopamine neurons impairs reinforcement learning, and this involves a defect in the frequency dependence of release rather than the amount of dopamine released. Thus, AP-3 and VPS41 promote the axonal polarity of dopamine release but enable learning by producing a distinct population of SVs tuned specifically to high firing frequency that confers the phasic release of dopamine.

Homeostatic Reinforcement Theory Accounts for Sodium Appetitive State- and Taste-Dependent Dopamine Responding

Seeking and consuming nutrients is essential to survival and the maintenance of life. Dynamic and volatile environments require that animals learn complex behavioral strategies to obtain the necessary nutritive substances. While this has been classically viewed in terms of homeostatic regulation, recent theoretical work proposed that such strategies result from reinforcement learning processes. This theory proposed that phasic dopamine (DA) signals play a key role in signaling potentially need-fulfilling outcomes. To examine links between homeostatic and reinforcement learning processes, we focus on sodium appetite as sodium depletion triggers state- and taste-dependent changes in behavior and DA signaling evoked by sodium-related stimuli. We find that both the behavior and the dynamics of DA signaling underlying sodium appetite can be accounted for by a homeostatically regulated reinforcement learning framework (HRRL). We first optimized HRRL-based agents to sodium-seeking behavior measured in rodents. Agents successfully reproduced the state and the taste dependence of behavioral responding for sodium as well as for lithium and potassium salts. We then showed that these same agents account for the regulation of DA signals evoked by sodium tastants in a taste- and state-dependent manner. Our models quantitatively describe how DA signals evoked by sodium decrease with satiety and increase with deprivation. Lastly, our HRRL agents assigned equal preference for sodium versus the lithium containing salts, accounting for similar behavioral and neurophysiological observations in rodents. We propose that animals use orosensory signals as predictors of the internal impact of the consumed good and our results pose clear targets for future experiments. In sum, this work suggests that appetite-driven behavior may be driven by reinforcement learning mechanisms that are dynamically tuned by homeostatic need.

Computational reinforcement learning, reward (and punishment), and dopamine in psychiatric disorders.

In the DSM-5, psychiatric diagnoses are made based on self-reported symptoms and clinician-identified signs. Though helpful in choosing potential interventions based on the available regimens, this conceptualization of psychiatric diseases can limit basic science investigation into their underlying causes. The reward prediction error (RPE) hypothesis of dopamine neuron function posits that phasic dopamine signals encode the difference between the rewards a person expects and experiences. The computational framework from which this hypothesis was derived, temporal difference reinforcement learning (TDRL), is largely focused on reward processing rather than punishment learning. Many psychiatric disorders are characterized by aberrant behaviors, expectations, reward processing, and hypothesized dopaminergic signaling, but also characterized by suffering and the inability to change one's behavior despite negative consequences. In this review, we provide an overview of the RPE theory of phasic dopamine neuron activity and review the gains that have been made through the use of computational reinforcement learning theory as a framework for understanding changes in reward processing. The relative dearth of explicit accounts of punishment learning in computational reinforcement learning theory and its application in neuroscience is highlighted as a significant gap in current computational psychiatric research. Four disorders comprise the main focus of this review: two disorders of traditionally hypothesized hyperdopaminergic function, addiction and schizophrenia, followed by two disorders of traditionally hypothesized hypodopaminergic function, depression and post-traumatic stress disorder (PTSD). Insights gained from a reward processing based reinforcement learning framework about underlying dopaminergic mechanisms and the role of punishment learning (when available) are explored in each disorder. Concluding remarks focus on the future directions required to characterize neuropsychiatric disorders with a hypothesized cause of underlying dopaminergic transmission.

Dopamine errors drive excitatory and inhibitory components of backward conditioning in an outcome-specific manner

For over two decades, phasic activity in midbrain dopamine neurons was considered synonymous with the prediction error in temporal-difference reinforcement learning.1-4 Central to this proposal is the notion that reward-predictive stimuli become endowed with the scalar value of predicted rewards. When these cues are subsequently encountered, their predictive value is compared to the value of the actual reward received, allowing for the calculation of prediction errors.5,6 Phasic firing of dopamine neurons was proposed to reflect this computation,1,2 facilitating the backpropagation of value from the predicted reward to the reward-predictive stimulus, thus reducing future prediction errors. There are two critical assumptions of this proposal: (1) that dopamine errors can only facilitate learning about scalar value and not more complex features of predicted rewards, and (2) that the dopamine signal can only be involved in anticipatory cue-reward learning in which cues or actions precede rewards. Recent work7-15 has challenged the first assumption, demonstrating that phasic dopamine signals across species are involved in learning about more complex features of the predicted outcomes, in a manner that transcends this value computation. Here, we tested the validity of the second assumption. Specifically, we examined whether phasic midbrain dopamine activity would be necessary for backward conditioning-when a neutral cue reliably follows a rewarding outcome.16-20 Using a specific Pavlovian-to-instrumental transfer (PIT) procedure,21-23 we show rats learn both excitatory and inhibitory components of a backward association, and that this association entails knowledge of the specific identity of the reward and cue. We demonstrate that brief optogenetic inhibition of VTADA neurons timed to the transition between the reward and cue reduces both of these components of backward conditioning. These findings suggest VTADA neurons are capable of facilitating associations between contiguously occurring events, regardless of the content of those events. We conclude that these data may be in line with suggestions that the VTADA error acts as a universal teaching signal. This may provide insight into why dopamine function has been implicated in myriad psychological disorders that are characterized by very distinct reinforcement-learning deficits.

Selective Optogenetic Dopamine Terminal Stimulation Reveals Role of GABAergic Signaling in Individual Differences in Dopamine Release

An estimated 70.5% of Americans aged 12 or older report having used an illicit substance at least once, while about 10‐20% of those individuals ultimately develop a substance use disorder (SUD). These data highlight substantial individual variability in the risk of developing SUD following initial drug use. Identifying markers of increased risk provides a significant opportunity to identify at‐risk populations and to aid in the prevention of the development of SUD. In preclinical rodent models, locomotor response to a novel environment predicts drug use vulnerability. Rodents that demonstrate higher locomotor response to an inescapable novel environment (high responders; HR) acquire self‐administration (SA) of drugs more rapidly and at lower doses compared to low responders (LR). Striatal dopamine (DA) signaling is critical for the acquisition of drug SA and tonic/phasic firing patterns of DA neurons encode information about salient environmental stimuli and rewards. HR rats show increased phasic DA signaling to reward‐predictive cues compared to LR rats. Dopamine release dynamics are tightly controlled by local modulation within the nucleus accumbens (NAc), including by nicotinic acetylcholine receptors (nAChRs), but the mechanisms by which this local modulation may contribute to differential DA release is not fully understood. Our lab has previously shown that locomotor response to a novel environment predicts nAChR modulation of phasic DA signals in the NAc. Specifically, desensitization or blockade of α6β2‐containing (α6β2*) nAChRs within the NAc was found to augment phasic DA signals in brain slices of HR rats, and reduce phasic DA signals in LR rats. However, these studies utilized non‐specific electrical stimulation to record DA release. In the present study, we used ex vivo fast‐scan cyclic voltammetry with an optogenetic approach to selectively stimulate DA neuron terminals or cholinergic interneurons (CINs) within the NAc to examine the specific contributions of acetylcholine (ACh) to the overall DA response in HR and LR rats. We find that, contrary to previous results with electrical stimulation, selective DA phasic stimulation results in lower DA release in HRs compared to LRs, while blockade of α6β2* nAChRs using light stimulation results in higher DA release in HRs. This suggests that additional circuitry is likely involved in differential DA signaling within the NAc. Given the tonic activity of CINs and presence of nAChRs on GABA interneurons, we next used pharmacological manipulations to examine the possibility of GABA signaling contributing to individual differences in DA release. Here, we find that antagonism of GABA receptors blocks the previously seen differential effects of α6β2* nAChR antagonism on DA release, suggesting that GABA interneurons do play a critical role in differential DA signaling in HRs versus LRs. In sum, these data help form a clearer understanding of the mechanisms underlying individual differences in DA signaling, which may be a primary driver of differences in sensitivity to the reinforcing effects of drugs of abuse. Investigating these mechanisms allows us to better identify behavioral and neurochemical markers of SUD vulnerability in humans and to ultimately stimulate development of individualized and effective treatments.

The role of state uncertainty in the dynamics of dopamine

Reinforcement learning models of the basal ganglia map the phasic dopamine signal to reward prediction errors (RPEs). Conventional models assert that, when a stimulus predicts a reward with fixed delay, dopamine activity during the delay should converge to baseline through learning. However, recent studies have found that dopamine ramps up before reward in certain conditions even after learning, thus challenging the conventional models. In this work, we show that sensory feedback causes an unbiased learner to produce RPE ramps. Our model predicts that when feedback gradually decreases during a trial, dopamine activity should resemble a "bump," whose ramp-up phase should, furthermore, be greater than that of conditions where the feedback stays high. We trained mice on a virtual navigation task with varying brightness, and both predictions were empirically observed. In sum, our theoretical and experimental results reconcile the seemingly conflicting data on dopamine behaviors under the RPE hypothesis.

Effects of methamphetamine-induced neurotoxicity on striatal long-term potentiation

RationaleMethamphetamine (METH) exposure is associated with damage to central monoamine systems, particularly dopamine signaling. Rodent models of such damage have revealed a decrease in the amplitude of phasic dopamine signals and significant striatal dysfunction, including changes in the molecular, system, and behavioral functions of the striatum. Dopamine signaling through D1 receptors promotes corticostriatal long-term potentiation (LTP), a critical substrate of these striatal functions.ObjectivesTherefore, the purpose of this study was to determine if METH-induced dopamine neurotoxicity would impair D1 receptor-dependent striatal LTP in mice.MethodsMice were treated with a METH binge regimen (4 × 10 mg/kg d,l-methamphetamine, s.c.) that recapitulates all of the known METH-induced neurotoxic effects observed in humans, including dopamine toxicity. Three weeks later, acute brain slices containing either the dorsomedial striatum (DMS) or dorsolateral striatum (DLS) were prepared, and plasticity was assessed using white matter, high-frequency stimulation (HFS), and striatal extracellular electrophysiology.ResultsUnder these conditions, LTP was induced in brain slices containing the DMS from saline-pretreated mice, but not mice with METH-induced neurotoxicity. Furthermore, the LTP observed in DMS slices from saline-pretreated mice was blocked by the dopamine D1 receptor antagonist SCH23390, indicating that this LTP is dopamine D1 receptor-dependent. Finally, acute in vivo treatment of METH-pretreated mice with bupropion (50 mg/kg, i.p.) promoted LTP in DMS slices.ConclusionsTogether, these studies demonstrate that METH-induced neurotoxicity impairs dopamine D1 receptor-dependent LTP within the DMS and that the FDA-approved drug bupropion restores induction of striatal LTP in mice with METH-induced dopamine neurotoxicity.

The critical balance between dopamine D2 receptor and RGS for the sensitive detection of a transient decay in dopamine signal.

In behavioral learning, reward-related events are encoded into phasic dopamine (DA) signals in the brain. In particular, unexpected reward omission leads to a phasic decrease in DA (DA dip) in the striatum, which triggers long-term potentiation (LTP) in DA D2 receptor (D2R)-expressing spiny-projection neurons (D2 SPNs). While this LTP is required for reward discrimination, it is unclear how such a short DA-dip signal (0.5–2 s) is transferred through intracellular signaling to the coincidence detector, adenylate cyclase (AC). In the present study, we built a computational model of D2 signaling to determine conditions for the DA-dip detection. The DA dip can be detected only if the basal DA signal sufficiently inhibits AC, and the DA-dip signal sufficiently disinhibits AC. We found that those two requirements were simultaneously satisfied only if two key molecules, D2R and regulators of G protein signaling (RGS) were balanced within a certain range; this balance has indeed been observed in experimental studies. We also found that high level of RGS was required for the detection of a 0.5-s short DA dip, and the analytical solutions for these requirements confirmed their universality. The imbalance between D2R and RGS is associated with schizophrenia and DYT1 dystonia, both of which are accompanied by abnormal striatal LTP. Our simulations suggest that D2 SPNs in patients with schizophrenia and DYT1 dystonia cannot detect short DA dips. We finally discussed that such psychiatric and movement disorders can be understood in terms of the imbalance between D2R and RGS.

Diazepam attenuates the effects of cocaine on locomotion, 50-kHz ultrasonic vocalizations and phasic dopamine in the nucleus accumbens of rats.

Currently, there is no effective drug to treat cocaine-use disorder, which affects millions of people worldwide. Benzodiazepines are potential therapeutic candidates, as microdialysis and voltammetry studies have shown that they can decrease dopamine concentrations in the nucleus accumbens of rodents and block the increase in dopamine levels and appetitive 50-kHz ultrasonic vocalizations (USVs) induced by amphetamine in rats. Here, we tested whether administration of 2.5-mg·kg-1 diazepam (i.p.) in adult male rats could block the effects of 20-mg·kg-1 cocaine (i.p.) on electrically evoked phasic dopamine signals in the nucleus accumbens measured by fast-scan cyclic voltammetry, as well as 50-kHz USV and locomotor activity. Cocaine injection increased evoked dopamine signals up to threefold within 5 min, and the increase was significantly higher than baseline for at least 75 min. The injection of diazepam, 5 min after cocaine, attenuated the cocaine effect by nearly 50%, and this attenuation was maintained for at least 40 min. Behaviourally, cocaine increased the number of appetitive 50-kHz calls by about 12-fold. Diazepam significantly blocked this effect for the entire duration of the session. Also, cocaine-treated rats were more active than controls and diazepam significantly attenuated cocaine-induced locomotion, by up to 50%. These results suggest that the neurochemical and psychostimulant effects of cocaine can be mitigated by diazepam. This article is part of a themed issue on Building Bridges in Neuropharmacology. To view the other articles in this section visit http://onlinelibrary.wiley.com/doi/10.1111/bph.v179.8/issuetoc.

Response to Novelty Predicts α7 Nicotinic Receptor and Voltage‐Gated Calcium Channel Modulation of Dopamine Release

An estimated 70.5% of Americans aged 12 or older report having used an illicit substance at least once, while about 10-20% of those individuals ultimately develop a substance use disorder (SUD). These data highlight substantial individual variability in the risk of developing SUD following initial drug use. Identifying markers of increased risk provides a significant opportunity to identify at-risk populations and to aid in the prevention of the development of SUD. In preclinical rodent models, locomotor response to a novel environment predicts drug use vulnerability. Rodents that demonstrate higher locomotor response to an inescapable novel environment (high responders; HR) acquire self-administration (SA) of drugs more rapidly and stably compared to low responders (LR). Striatal dopamine (DA) signaling is critical for the acquisition of drug SA and tonic/phasic firing patterns of DA neurons encode information about salient environmental stimuli and rewards. HR rats show increased phasic DA signaling to reward-predictive cues compared to LR rats. Dopamine release dynamics are tightly controlled by local modulation within the nucleus accumbens (NAc), including through glutamatergic signaling and modulation by nicotinic acetylcholine receptors (nAChRs), but the mechanisms by which this local modulation may contribute to differential DA release is not fully understood. Our lab has previously shown that locomotor response to a novel environment predicts nAChR modulation of phasic DA signals in the NAc. Specifically, desensitization or blockade of α6β2-containing nAChRs within the NAc was found to augment phasic DA signals in brain slices of HR rats, and reduce phasic DA signals in LR rats. However, other nAChR subtypes may also contribute to individual differences in DA signaling, including α7 nAChRs localized to striatal glutamate terminals. In the present study, we used ex vivo fast-scan cyclic voltammetry to examine how antagonism of α7 nAChRs impacts DA release across a range of stimulation frequencies in the NAc of HR and LR animals and examine what mechanisms may be mediating this effect. We find that modulation of DA release by α7 nAChRs can be predicted by response to novelty at phasic-like stimulations. Given the role that nAChRs play in calcium (Ca2+) entry into the cell, we additionally tested the possibility that differential Ca2+ utilization is one mechanism underlying differential DA modulation by nAChRs and utilized pharmacological manipulations to test possible voltage-gated Ca2+ channel (VGCC) subtype-specific effects. Here, we demonstrate that lowered Ca2+ concentration unmasks a diverging DA release profile between HRs and LRs at phasic-like stimulation frequencies and find that P/Q-type VGCCs appear to drive these individual differences in Ca2+ utilization. In sum, these data help form a more coherent understanding of the mechanisms underlying individual differences in vulnerability. Investigating these mechanisms allows us to better identify behavioral and neurochemical markers of substance abuse risk in humans and to ultimately stimulate development of more individualized and effective treatments.

Time‐of‐Day Variation in Learning, Reward‐Associated Behaviors, and Rapid Dopamine Release

Research has shown that circadian rhythms in physiology and behavior play a role in a number of psychiatric disorders, like depression and substance use disorder (SUD). For example, time-of-day variation has been observed in craving for nicotine, heroin, and cocaine in abstinent individuals. However, we have yet to fully delineate how these rhythms mediate variations in motivated behavior, learning, and reward seeking. This is critical as aberrant motivation and learning are hallmarks in these disorders. Additionally, the mesolimbic dopamine (DA) system is implicated in the neurobiology of motivation and learning, and research has shown time-of-day variations in DA tone. Less work has focused on rapid DA signals that are critical for motivation and learning. Thus, the purpose of this study was to examine time-of-day variations in incentive motivational properties of reward-associated cues and learning and the degree to which the magnitude of mesolimbic DA release in the nucleus accumbens (NAc) corresponded to dynamic shifts in motivation and learning across time-of-day. Our central hypothesis is that there are critical times within the day that confer increased sensitivity to reward-associated cues, which are mediated by time-of-day variations in the magnitude of phasic DA signaling. Initially, we examined the magnitude of NAc DA signaling to stimulations that mimic both tonic and phasic firing of mesolimbic DA neurons in rats. We used ex vivo fast scan cyclic voltammetry (FSCV) at four different time points across the 12:12 light/dark cycle. Our data demonstrate robust time-of-day differences in DA release magnitude following stimulations that model both phasic (≥20 Hz) and tonic (5 Hz) firing. Given that the phasic/tonic ratio of DA release magnitude was greatest midway through the dark cycle and lowest midway through the light cycle, we examined whether behavioral paradigms sensitive to DA release magnitude would fluctuate consistently with these DA oscillations. We therefore utilized Pavlovian paradigms in rodents to measure incentive motivational aspects and conditioned approach towards a reward-associated cue, during midway through the light cycle and midway through the dark cycle. Furthermore, since DA release and motivated behavior is modulated by striatal cholinergic interneuron (CIN) activity via nicotinic receptors (nAChRs) located on DA axons, we examined whether both DA release and incentive motivation was altered following nicotine exposure. To unmask the circuitry underlying these variations, we utilized ex vivo optogentics. We found a robust increase in DA release magnitude without the contribution of CIN activity midway through the dark cycle. In contrast, DA release was significantly higher in DA release magnitude modulated by CIN activity midway through the light cycle. Lastly, we are currently using in vivo optogenetics to mediate the magnitude of DA release during Pavlovian paradigms at times throughout the light cycles. Collectively, our data suggest that rats midway through their dark cycle exhibit increased sensitivity to reward-associated cues, which may be mediated by rapid DA release that is modulated by oscillations in CIN activity throughout the day.

Thirst recruits phasic dopamine signaling through subfornical organ neurons

Thirst is a highly potent drive that motivates organisms to seek out and consume balance-restoring stimuli. The detection of dehydration is well understood and involves signals of peripheral origin and the sampling of internal milieu by first order homeostatic neurons within the lamina terminalis-particularly glutamatergic neurons of the subfornical organ expressing CaMKIIa (SFOCaMKIIa). However, it remains unknown whether mesolimbic dopamine pathways that are critical for motivation and reinforcement integrate information from these "early" dehydration signals. We used in vivo fiber photometry in the ventral tegmental area and measured phasic dopamine responses to a water-predictive cue. Thirst, but not hunger, potentiated the phasic dopamine response to the water cue. In euvolemic rats, the dipsogenic hormone angiotensin II, but not the orexigenic hormone ghrelin, potentiated the dopamine response similarly to that observed in water-deprived rats. Chemogenetic manipulations of SFOCaMKIIa revealed bidirectional control of phasic dopamine signaling during cued water reward. Taking advantage of within-subject designs, we found predictive relationships between changes in cue-evoked dopamine response and changes in behavioral responses-supporting a role for dopamine in motivation induced by homeostatic need. Collectively, we reveal a putative mechanism for the invigoration of goal-directed behavior: internal milieu communicates to first order, need state-selective circuits to potentiate the mesolimbic dopamine system's response to cues predictive of restorative stimuli.

Dopamine signals as temporal difference errors: recent advances.

In the brain, dopamine is thought to drive reward-based learning by signaling temporal difference reward prediction errors (TD errors), a 'teaching signal' used to train computers. Recent studies using optogenetic manipulations have provided multiple pieces of evidence supporting that phasic dopamine signals function as TD errors. Furthermore, novel experimental results have indicated that when the current state of the environment is uncertain, dopamine neurons compute TD errors using 'belief states' or a probability distribution over potential states. It remains unclear how belief states are computed but emerging evidence suggests involvement of the prefrontal cortex and the hippocampus. These results refine our understanding of the role of dopamine in learning and the algorithms by which dopamine functions in the brain.

A systems-neuroscience model of phasic dopamine.

We describe a neurobiologically informed computational model of phasic dopamine signaling to account for a wide range of findings, including many considered inconsistent with the simple reward prediction error (RPE) formalism. The central feature of this PVLV framework is a distinction between a primary value (PV) system for anticipating primary rewards (Unconditioned Stimuli [USs]), and a learned value (LV) system for learning about stimuli associated with such rewards (CSs). The LV system represents the amygdala, which drives phasic bursting in midbrain dopamine areas, while the PV system represents the ventral striatum, which drives shunting inhibition of dopamine for expected USs (via direct inhibitory projections) and phasic pausing for expected USs (via the lateral habenula). Our model accounts for data supporting the separability of these systems, including individual differences in CS-based (sign-tracking) versus US-based learning (goal-tracking). Both systems use competing opponent-processing pathways representing evidence for and against specific USs, which can explain data dissociating the processes involved in acquisition versus extinction conditioning. Further, opponent processing proved critical in accounting for the full range of conditioned inhibition phenomena, and the closely related paradigm of second-order conditioning. Finally, we show how additional separable pathways representing aversive USs, largely mirroring those for appetitive USs, also have important differences from the positive valence case, allowing the model to account for several important phenomena in aversive conditioning. Overall, accounting for all of these phenomena strongly constrains the model, thus providing a well-validated framework for understanding phasic dopamine signaling. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Metabolic state and value-based decision-making in acute and recovered female patients with anorexia nervosa

Patients with anorexia nervosa forgo eating despite emaciation and severe health consequences. Such dysfunctional decision-making might be explained by an excessive level of self-control, alterations in homeostatic and hedonic regulation, or an interplay between these processes. We aimed to understand value-based decision-making in anorexia nervosa and its association with the gut hormone ghrelin. Besides its homeostatic function, ghrelin has been implicated in the hedonic regulation of appetite and reward via the modulation of phasic dopamine signalling. In a cross-sectional design, we studied acutely underweight (n = 94) and recovered (n = 37) patients with anorexia nervosa of the restrictive subtype, as well as healthy control participants (n = 119). We assessed plasma concentrations of desacyl ghrelin and parameters of delay discounting, probability discounting for gains and losses, and loss aversion. Recovered patients displayed higher risk aversion for gains, but we observed no group differences for the remaining decision-making parameters. Desacyl ghrelin was higher in acutely underweight and recovered participants with anorexia nervosa relative to healthy controls. Moreover, we found a significant group × desacyl ghrelin interaction in delay discounting, indicating that in contrast to healthy controls, acutely underweight patients with anorexia nervosa who had high desacyl ghrelin concentrations preferably chose the delayed reward option. We probed decision-making using monetary rewards, but patients with anorexia nervosa may react differently to disorder-relevant stimuli. Furthermore, in contrast to acyl ghrelin, the functions of desacyl ghrelin are unclear. Therefore, the interpretation of the results is preliminary. The propensity for risk aversion as found in recovered patients with anorexia nervosa could help them successfully complete therapy, or it could reflect sequelae of the disorder. Conversely, ghrelin findings might be related to a mechanism contributing to disease maintenance; that is, in acutely underweight anorexia nervosa, a hungry state may facilitate the ability to forgo an immediate reward to achieve a (dysfunctional) long-term goal.

A pain-induced tonic hypodopaminergic state augments phasic dopamine release in the nucleus accumbens

Diseases and disorders such as Parkinson disease, schizophrenia, and chronic pain are characterized by altered mesolimbic dopaminergic neurotransmission. Dopamine release in the nucleus accumbens influences behavior through both tonic and phasic signaling. Tonic dopamine levels are hypothesized to inversely regulate phasic signals through dopamine D2 receptor feedback inhibition. We tested this hypothesis directly in the context of ongoing pain. Tonic and phasic dopamine signals were measured using fast-scan controlled-adsorption voltammetry and fast-scan cyclic voltammetry, respectively, in the nucleus accumbens shell of male rats with standardized levels of anesthesia. Application of capsaicin to the cornea produced a transient decrease in tonic dopamine levels. During the pain-induced hypodopaminergic state, electrically evoked phasic dopamine release was significantly increased when compared to baseline, evoked phasic release. A second application of capsaicin to the same eye had a lessened effect on tonic dopamine suggesting desensitization of TRPV1 channels in that eye. Capsaicin treatment in the alternate cornea, however, again produced coincident decreased dopaminergic tone and increased phasic dopamine release. These findings occurred independently of stimulus lateralization relative to the hemisphere of dopamine measurement. Our data show that (1) the mesolimbic dopamine circuit reliably encodes acute noxious stimuli; (2) ongoing pain produces decreases in dopaminergic tone; and (3) pain-induced decreases in tonic dopamine correspond to augmented evoked phasic dopamine release. Enhanced phasic dopamine neurotransmission resulting from salient stimuli may contribute to increased impulsivity and cognitive deficits often observed in conditions associated with decreased dopaminergic tone, including Parkinson disease and chronic pain.

Sucrose consumption alters steroid and dopamine signalling in the female rat brain.

Sucrose consumption is associated with type 2 diabetes, cardiovascular disease, and cognitive deficits. Sucrose intake during pregnancy might have particularly prominent effects on metabolic, endocrine, and neural physiology. It remains unclear how consumption of sucrose affects parous females, especially in brain circuits that mediate food consumption and reward processing. Here, we examine whether a human-relevant level of sucrose before, during, and after pregnancy (17-18 weeks total) influences metabolic and neuroendocrine physiology in female rats. Females were fed either a control diet or a macronutrient-matched, isocaloric sucrose diet (25% of kcal from sucrose). Metabolically, sucrose impairs glucose tolerance, increases liver lipids, and increases a marker of adipose inflammation, but has no effect on body weight or overall visceral adiposity. Sucrose also decreases corticosterone levels in serum but not in the brain. Sucrose increases progesterone levels in serum and in the brain and increases the brain:serum ratio of progesterone in the mesocorticolimbic system and hypothalamus. These data suggest a dysregulation of systemic and local steroid signalling. Moreover, sucrose decreases tyrosine hydroxylase (TH), a catecholamine-synthetic enzyme, in the medial prefrontal cortex. Finally, sucrose consumption alters the expression pattern of FOSB, a marker of phasic dopamine signalling, in the nucleus accumbens. Overall, chronic consumption of sucrose at a human-relevant level alters metabolism, steroid levels, and brain dopamine signalling in a female rat model.