Phasic Dopamine Signaling Research Articles

Frequent ice cream consumption is associated with reduced striatal response to receipt of an ice cream–based milkshake

Weight gain leads to reduced reward-region responsivity to energy-dense food receipt, and consumption of an energy-dense diet compared with an isocaloric, low-energy-density diet leads to reduced dopamine receptors. Furthermore, phasic dopamine signaling to palatable food receipt decreases after repeated intake of that food, which collectively suggests that frequent intake of an energy-dense food may reduce striatal response to receipt of that food. We tested the hypothesis that frequent ice cream consumption would be associated with reduced activation in reward-related brain regions (eg, striatum) in response to receipt of an ice cream-based milkshake and examined the influence of adipose tissue and the specificity of this relation. Healthy-weight adolescents (n = 151) underwent fMRI during receipt of a milkshake and during receipt of a tasteless solution. Percentage body fat, reported food intake, and food craving and liking were assessed. Milkshake receipt robustly activated the striatal regions, yet frequent ice cream consumption was associated with a reduced response to milkshake receipt in these reward-related brain regions. Percentage body fat, total energy intake, percentage of energy from fat and sugar, and intake of other energy-dense foods were not related to the neural response to milkshake receipt. Our results provide novel evidence that frequent consumption of ice cream, independent of body fat, is related to a reduction in reward-region responsivity in humans, paralleling the tolerance observed in drug addiction. Data also imply that intake of a particular energy-dense food results in attenuated reward-region responsivity specifically to that food, which suggests that sensory aspects of eating and reward learning may drive the specificity.

Phasic Mesolimbic Dopamine Signaling Precedes and Predicts Performance of a Self-Initiated Action Sequence Task

Sequential reward-seeking actions are readily learned despite the temporal gap between the earliest (distal) action in the sequence and the reward delivery. Fast dopamine signaling is hypothesized to mediate this form of learning by reporting errors in reward prediction. However, such a role for dopamine release in voluntarily initiated action sequences remains to be demonstrated. Using fast-scan cyclic voltammetry, we monitored phasic mesolimbic dopamine release, in real time, as rats performed a self-initiated sequence of lever presses to earn sucrose rewards. Before testing, rats received either 0 (n = 11), 5 (n = 11), or 10 (n = 8) days of action sequence training. For rats acquiring the action sequence task at test, dopamine release was strongly elicited by response-contingent (but unexpected) rewards. With learning, a significant elevation in dopamine release preceded performance of the proximal action and subsequently came to precede the distal action. This predistal dopamine release response was also observed in rats previously trained on the action sequence task, and the amplitude of this signal predicted the latency with which rats completed the action sequence. Importantly, the dopamine response to contingent reward delivery was not observed in rats given extensive pretraining. Pharmacological analysis confirmed that task performance was dopamine-dependent. These data suggest that phasic mesolimbic dopamine release mediates the influence that rewards exert over the performance of self-paced, sequentially-organized behavior and sheds light on how dopamine signaling abnormalities may contribute to disorders of behavioral control.

The Role of Dopamine in the Context of Aversive Stimuli with Particular Reference to Acoustically Signaled Avoidance Learning

Learning from punishment is a powerful means for behavioral adaptation with high relevance for various mechanisms of self-protection. Several studies have explored the contribution of released dopamine (DA) or responses of DA neurons on reward seeking using rewards such as food, water, and sex. Phasic DA signals evoked by rewards or conditioned reward predictors are well documented, as are modulations of these signals by such parameters as reward magnitude, probability, and deviation of actually occurring from expected rewards. Less attention has been paid to DA neuron firing and DA release in response to aversive stimuli, and the prediction and avoidance of punishment. In this review, we first focus on DA changes in response to aversive stimuli as measured by microdialysis and voltammetry followed by the change in electrophysiological signatures by aversive stimuli and fearful events. We subsequently focus on the role of DA and effect of DA manipulations on signaled avoidance learning, which consists of learning the significance of a warning cue through Pavlovian associations and the execution of an instrumental avoidance response. We present a coherent framework utilizing the data on microdialysis, voltammetry, electrophysiological recording, electrical brain stimulation, and behavioral analysis. We end by outlining current gaps in the literature and proposing future directions aimed at incorporating technical and conceptual progress to understand the involvement of reward circuit on punishment based decisions.

Encoding of Aversion by Dopamine and the Nucleus Accumbens

Adaptive motivated behavior requires rapid discrimination between beneficial and harmful stimuli. Such discrimination leads to the generation of either an approach or rejection response, as appropriate, and enables organisms to maximize reward and minimize punishment. Classically, the nucleus accumbens (NAc) and the dopamine projection to it are considered an integral part of the brain’s reward circuit, i.e., they direct approach and consumption behaviors and underlie positive reinforcement. This reward-centered framing ignores important evidence about the role of this system in encoding aversive events. One reason for bias toward reward is the difficulty in designing experiments in which animals repeatedly experience punishments; another is the challenge in dissociating the response to an aversive stimulus itself from the reward/relief experienced when an aversive stimulus is terminated. Here, we review studies that employ techniques with sufficient time resolution to measure responses in ventral tegmental area and NAc to aversive stimuli as they are delivered. We also present novel findings showing that the same stimulus – intra-oral infusion of sucrose – has differing effects on NAc shell dopamine release depending on the prior experience. Here, for some rats, sucrose was rendered aversive by explicitly pairing it with malaise in a conditioned taste aversion paradigm. Thereafter, sucrose infusions led to a suppression of dopamine with a similar magnitude and time course to intra-oral infusions of a bitter quinine solution. The results are discussed in the context of regional differences in dopamine signaling and the implications of a pause in phasic dopamine release within the NAc shell. Together with our data, the emerging literature suggests an important role for differential phasic dopamine signaling in aversion vs. reward.

A Role for Phasic Dopamine Neuron Firing in Habit Learning

In this issue of Neuron, Wang etal. (2011) show that mice with dopamine neuron-specific NMDAR1 deletion have attenuated phasic dopamine neuron firing and a deficit in habit learning. These findings indicate that brain regions sensitive to phasic dopamine signals may underlie habit learning.

Primary food reward and reward-predictive stimuli evoke different patterns of phasic dopamine signaling throughout the striatum.

Phasic changes in dopamine activity play a critical role in learning and goal-directed behavior. Unpredicted reward and reward-predictive cues evoke phasic increases in the firing rate of the majority of midbrain dopamine neurons--results that predict uniformly broadcast increases in dopamine concentration throughout the striatum. However, measurement of dopamine concentration changes during reward has cast doubt on this prediction. We systematically measured phasic changes in dopamine in four striatal subregions [nucleus accumbens shell and core (Core), dorsomedial (DMS) and dorsolateral striatum] in response to stimuli known to activate a majority of dopamine neurons. We used fast-scan cyclic voltammetry in awake and behaving rats, which measures changes in dopamine on a similar timescale to the electrophysiological recordings that established a relationship between phasic dopamine activity and reward. Unlike the responses of midbrain dopamine neurons, unpredicted food reward and reward-predictive cues evoked a phasic increase in dopamine that was subregion specific. In rats with limited experience, unpredicted food reward evoked an increase exclusively in the Core. In rats trained on a discriminative stimulus paradigm, both unpredicted reward and reward-predictive cues evoked robust phasic dopamine in the Core and DMS. Thus, phasic dopamine release in select target structures is dynamic and dependent on context and experience. Because the four subregions assayed receive different inputs and have differential projection targets, the regional selectivity of phasic changes in dopamine has important implications for information flow through the striatum and plasticity that underlies learning and goal-directed behavior.

Withdrawal from Chronic Nicotine Exposure Alters Dopamine Signaling Dynamics in the Nucleus Accumbens

Unaided attempts to quit smoking commonly fail during the first 2 weeks of the nicotine withdrawal syndrome. Alterations in dopamine (DA) signaling correlate with withdrawal from chronic nicotine exposure, but those changes have not been well-characterized. Mice were administered nicotine in their drinking water for 4 or 12 weeks. Then nicotine was withheld for 1 to 10 days while DA signaling was characterized with in vivo microdialysis or fast-scan cyclic voltammetry. Upon withdrawal of nicotine, the basal DA concentration in the nucleus accumbens decreased as measured by microdialysis. The length of time that the low basal DA state lasted depended on the length of the chronic nicotine treatment. Microdialysis indicated that acute re-exposure to nicotine during withdrawal temporarily reversed this hypodopaminergic state. Voltammetry measurements supported the microdialysis results by showing that nicotine withdrawal decreased tonic and phasic DA release. The basal DA concentration and tonic DA signals, however, were disproportionately lower than the phasic DA signals. Therefore, the phasic/tonic DA signaling ratio was increased during the withdrawal period. The relative increase in the sensitivity of DA release to phasic stimulation suggests an increase in the signal-to-noise relationship of DA signaling during the withdrawal period. Therefore, the DA signal produced by acute nicotine re-exposure produces a DA response that might reinforce relapse to drug use (i.e., smoking). Because the basal DA concentration is low during withdrawal, therapies aimed at elevating the background DA signal represent a reasonable treatment strategy for nicotine-dependent individuals attempting to quit.

S.09.02 Cross-frequency coupling and phase synchronization link nucleus accumbens and medial frontal cortex

Obsessive-compulsive disorder (OCD) is a psychiatric disorder affecting 1−3% of the population. Although several brain regions have been implicated in the pathophysiology of OCD, including the orbitofrontal cortex, the striatum and the dopaminergic and serotonergic systems, the ways in which these neural systems interact to produce obsessions and compulsions in patients is currently unknown. Work in the signal attenuation rat model of OCD found that lesions to the orbitofrontal cortex decrease striatal serotonin and dopamine content and increase compulsive leverpressing, and that this increase is blocked by intra-striatal administration of a selective serotonin reuptake inhibitor [1]. Lesions to the subthalamic nucleus similarly decrease striatal serotonin and dopamine and increase compulsive lever-pressing [2]. Consistent with these findings, high frequency stimulation of the subthalamic nucleus, which exerts an anti-compulsive effect in OCD patients and in the signal attenuation model, increases dopamine content in the striatum. Taken together, these results suggest that alterations in striatal serotonin and/or dopamine underlie compulsive behaviors. This conclusion adds to previous findings on the effects of dopamine D1 and D2 agonists and antagonists on compulsive lever-pressing, which led to the hypothesis that hypersensitivity of D1 receptors underlies compulsive lever-pressing [3]. Combined with computational models of reinforcement learning in which phasic dopamine signals play a central role, and with recent findings of altered dopamine signal following orbitofrontal lesions, these results suggest that abnormal dopamine signals may be the final common pathway in the production of compulsive behaviors.

Ghrelin increases phasic dopamine signals evoked by food reward

Ghrelin increases phasic dopamine signals evoked by food reward

Phasic dopamine signaling evoked by unexpected food reward differs with respect to striatal subregion and preference

Phasic dopamine signaling evoked by unexpected food reward differs with respect to striatal subregion and preference

Expected value and prediction error abnormalities in depression and schizophrenia

The dopamine system has been linked to anhedonia in depression and both the positive and negative symptoms of schizophrenia, but it remains unclear how dopamine dysfunction could mechanistically relate to observed symptoms. There is considerable evidence that phasic dopamine signals encode prediction error (differences between expected and actual outcomes), with reinforcement learning theories being based on prediction error-mediated learning of associations. It has been hypothesized that abnormal encoding of neural prediction error signals could underlie anhedonia in depression and negative symptoms in schizophrenia by disrupting learning and blunting the salience of rewarding events, and contribute to psychotic symptoms by promoting aberrant perceptions and the formation of delusions. To test this, we used model based functional magnetic resonance imaging and an instrumental reward-learning task to investigate the neural correlates of prediction errors and expected-reward values in patients with depression (n=15), patients with schizophrenia (n=14) and healthy controls (n=17). Both patient groups exhibited abnormalities in neural prediction errors, but the spatial pattern of abnormality differed, with the degree of abnormality correlating with syndrome severity. Specifically, reduced prediction errors in the striatum and midbrain were found in depression, with the extent of signal reduction in the bilateral caudate, nucleus accumbens and midbrain correlating with increased anhedonia severity. In schizophrenia, reduced prediction error signals were observed in the caudate, thalamus, insula and amygdala-hippocampal complex, with a trend for reduced prediction errors in the midbrain, and the degree of blunting in the encoding of prediction errors in the insula, amygdala-hippocampal complex and midbrain correlating with increased severity of psychotic symptoms. Schizophrenia was also associated with disruption in the encoding of expected-reward values in the bilateral amygdala-hippocampal complex and parahippocampal gyrus, with the degree of disruption correlating with psychotic symptom severity. Neural signal abnormalities did not correlate with negative symptom severity in schizophrenia. These findings support the suggestion that a disruption in the encoding of prediction error signals contributes to anhedonia symptoms in depression. In schizophrenia, the findings support the postulate of an abnormality in error-dependent updating of inferences and beliefs driving psychotic symptoms. Phasic dopamine abnormalities in depression and schizophrenia are suggested by our observation of prediction error abnormalities in dopamine-rich brain areas, given the evidence for dopamine encoding prediction errors. The findings are consistent with proposals that psychiatric syndromes reflect different disorders of neural valuation and incentive salience formation, which helps bridge the gap between biological and phenomenological levels of understanding.

A Neurocomputational Model of Dopamine and Prefrontal–Striatal Interactions during Multicue Category Learning by Parkinson Patients

Most existing models of dopamine and learning in Parkinson disease (PD) focus on simulating the role of basal ganglia dopamine in reinforcement learning. Much data argue, however, for a critical role for prefrontal cortex (PFC) dopamine in stimulus selection in attentional learning. Here, we present a new computational model that simulates performance in multicue category learning, such as the "weather prediction" task. The model addresses how PD and dopamine medications affect stimulus selection processes, which mediate reinforcement learning. In this model, PFC dopamine is key for attentional learning, whereas basal ganglia dopamine, consistent with other models, is key for reinforcement and motor learning. The model assumes that competitive dynamics among PFC neurons is the neural mechanism underlying stimulus selection with limited attentional resources, whereas competitive dynamics among striatal neurons is the neural mechanism underlying action selection. According to our model, PD is associated with decreased phasic and tonic dopamine levels in both PFC and basal ganglia. We assume that dopamine medications increase dopamine levels in both the basal ganglia and PFC, which, in turn, increase tonic dopamine levels but decrease the magnitude of phasic dopamine signaling in these brain structures. Increase of tonic dopamine levels in the simulated PFC enhances attentional shifting performance. The model provides a mechanistic account for several phenomena, including (a) medicated PD patients are more impaired at multicue probabilistic category learning than unmedicated patients and (b) medicated PD patients opt out of reversal when there are alternative and redundant cue dimensions.

Inhibition of dopamine uptake by D2 antagonists: an in vivo study

D(2)-like antagonists potentiate dopamine release. They also inhibit dopamine uptake by a mechanism yet to be clarified. Here, we monitored dopamine uptake in the striatum of anesthetized mice. The dopamine overflow was evoked by brief electrical stimulation of the medial forebrain bundle (four pulses at 100 Hz) and was monitored with carbon fiber electrodes combined with continuous amperometry. The decay phase of evoked overflows reflects dopamine half-life, which entirely depends on uptake. The D(2)-like antagonists haloperidol and eticlopride enhanced the half-life by 45% and 48%, respectively, a moderate effect as compared to the uptake blocker nomifensine (528%). Both D(2)-like antagonists did not affect dopamine uptake in mice lacking D(2) receptors. Inhibition of tonic dopamine release by gamma-butyrolactone did not mimic the enhancing effect of D(2) antagonists on dopamine half-life. However, prolonged stimulation boosted dopamine uptake and this effect was not observed after haloperidol treatment or in mice lacking D(2) receptors. Therefore, dopamine uptake is accelerated in conditions of excessive D(2) stimulation but not finely tuned in resting conditions. Inhibition of dopamine uptake by D(2) antagonists synergizes with the potentiation of dopamine release to strongly alter the phasic dopamine signaling.

Hypocretin 1/orexin A in the ventral tegmental area enhances dopamine responses to cocaine and promotes cocaine self-administration

Recent evidence indicates that the hypocretin/orexin system participates in the regulation of reinforcement and addiction processes. For example, manipulations that decrease hypocretin neurotransmission result in disruptions of neurochemical and behavioral responses to cocaine. To further assess the relationship between the hypocretin system and cocaine reinforcement, the current studies used microdialysis and in vivo voltammetry to examine the effects of hypocretin 1 on cocaine-induced enhancement of dopamine signaling in the nucleus accumbens core. Fixed ratio, discrete trials, and progressive ratio self-administration procedures were also used to assess whether hypocretin 1 promotes cocaine self-administration behavior. Infusions of hypocretin 1 into the ventral tegmental area increased the effects of cocaine on tonic and phasic dopamine signaling and increased the motivation to self-administer cocaine on the discrete trials and progressive ratio schedules. Together with previous observations demonstrating that a hypocretin 1 receptor antagonist disrupts dopamine signaling and reduces self-administration of cocaine, the current observations further indicate that the hypocretin system participates in reinforcement processes likely through modulation of the mesolimbic dopamine system.

Focus on the positive: Computational simulations implicate asymmetrical reward prediction error signals in childhood attention-deficit/hyperactivity disorder

A number of hypotheses have suggested that the principal neurological dysfunction responsible for the behavioural symptoms associated with Attention-Deficit/Hyperactive Disorder (ADHD) is likely rooted in abnormal phasic signals coded by the firing rate of midbrain dopamine neurons. We present a formal investigation of the impact atypical phasic dopamine signals have on behaviour by applying a T D ( λ ) reinforcement learning model to simulations of operant conditioning tasks that have been argued to quantify the hyperactive, inattentive and impulsive behaviour associated with ADHD. The results presented here suggest that asymmetrically effective dopamine signals encoded by a punctate increase or decrease in dopamine levels provide the best account for the behaviour of children with ADHD as well as an animal model of ADHD, the spontaneously hypertensive rat (SHR). The biological sources of this asymmetry are considered, as are other computational models of ADHD.

Pharmacological Modulation of the Gating Properties of Small Conductance Ca2+-Activated K+ Channels Alters the Firing Pattern of Dopamine Neurons In Vivo

Dopamine (DA) neurons are autonomous pacemakers that occasionally fire bursts of action potentials, discharge patterns thought to reflect tonic and phasic DA signaling, respectively. Pacemaker activity depends on the concerted and cyclic interplay between intrinsic ion channels with small conductance Ca(2+)-activated K(+) (SK) channels playing an important role. Bursting activity is synaptically initiated but neither the transmitters nor the specific ion conductances involved have been definitively identified. Physiological and pharmacological regulation of SK channel Ca(2+) sensitivity has recently been demonstrated and could represent a powerful means of modulating the expression of tonic/phasic signaling in DA neurons in vivo. To test this premise, we characterized the effects of intravenous administration of the novel positive and negative SK channel modulators NS309 and NS8593, respectively, on the spontaneous activity of substantia nigra pars compacta DA neurons in anesthetized C57BL/6 mice. NS309, dose-dependently decreased DA cell firing rate, increased the proportion of regular firing cells, and eventually stopped spontaneous firing. By contrast, systemic administration of the negative SK channel modulator NS8593 increased firing rate and shifted the pattern toward increased irregularity/bursting; an effect similar to local application of the pore blocking peptide apamin. The altered firing patterns resulting from inhibiting SK currents persisted independently of changes in firing rates induced by administration of DA autoreceptor agonists/antagonists. We conclude that pharmacological modulation of SK channel Ca(2+)-sensitivity represents a powerful mechanism for switching DA neuron firing activity between tonic and phasic signaling modalities in vivo.

Absence of NMDA receptors in dopamine neurons attenuates dopamine release but not conditioned approach during Pavlovian conditioning

During Pavlovian conditioning, phasic dopamine (DA) responses emerge to reward-predictive stimuli as the subject learns to anticipate reward delivery. This observation has led to the hypothesis that phasic dopamine signaling is important for learning. To assess the ability of mice to develop anticipatory behavior and to characterize the contribution of dopamine, we used a food-reinforced Pavlovian conditioning paradigm. As mice learned the cue-reward association, they increased their head entries to the food receptacle in a pattern that was consistent with conditioned anticipatory behavior. D1-receptor knockout (D1R-KO) mice had impaired acquisition, and systemic administration of a D1R antagonist blocked both the acquisition and expression of conditioned approach in wild-type mice. To assess the specific contribution of phasic dopamine transmission, we tested mice lacking NMDA-type glutamate receptors (NMDARs) exclusively in dopamine neurons (NR1-KO mice). Surprisingly, NR1-KO mice learned at the same rate as their littermate controls. To evaluate the contribution of NMDARs to phasic dopamine release in this paradigm, we performed fast-scan cyclic voltammetry in the nucleus accumbens of awake mice. Despite having significantly attenuated phasic dopamine release following reward delivery, KO mice developed cue-evoked dopamine release at the same rate as controls. We conclude that NMDARs in dopamine neurons enhance but are not critical for phasic dopamine release to behaviorally relevant stimuli; furthermore, their contribution to phasic dopamine signaling is not necessary for the development of cue-evoked dopamine or anticipatory activity in a D1R-dependent Pavlovian conditioning paradigm.

Dopamine Release in the Prefrontal Cortex and Striatum: Temporal and Behavioural Aspects

Dopamine (DA) neurons originating in the substantia nigra and ventral tegmental area project to a variety of forebrain structures thereby forming a complex neuromodulatory system that is essential for numerous motor, cognitive and motivational processes. DA neurons can operate in distinct temporal modes, i. e. they display responses across varying timescales including fast phasic changes of DA release on a seconds time scale and slower phasic changes in a minutes to hour range. Furthermore, tonic levels of DA provide a DA receptor 'tone'. Here we briefly highlight findings indicating that temporally distinct responses of DA neurons in the prefrontal cortex and striatum are related to different kinds of information and may serve dissociable behavioural functions. Furthermore we consider how DA neuronal activity and temporarily distinct patterns of DA release are regulated and summarize some relevant findings on the basic neuroanatomy of ascending DA systems. A better understanding of the specific functions of phasic and tonic DA signals will be critical for determining the role of DA in behaviour in detail.

Depressive-like effects of the kappa opioid receptor agonist salvinorin A are associated with decreased phasic dopamine release in the nucleus accumbens

Kappa opioid receptors (KORs) have been implicated in depressive-like states associated with chronic administration of drugs of abuse and stress. Although KOR agonists decrease dopamine in the nucleus accumbens (NAc), KOR modulation of phasic dopamine release in the core and shell subregions of the NAc-which have distinct roles in reward processing-remains poorly understood. Studies were designed to examine whether the time course of effects of KOR activation on phasic dopamine release in the NAc core or shell are similar to effects on motivated behavior. The effect of systemic administration of the KOR agonist salvinorin A (salvA)-at a dose (2.0 mg/kg) previously determined to have depressive-like effects-was measured on electrically evoked phasic dopamine release in the NAc core or shell of awake and behaving rats using fast scan cyclic voltammetry. In parallel, the effects of salvA on intracranial self-stimulation (ICSS) and sucrose-reinforced responding were assessed. For comparison, a threshold dose of salvA (0.25 mg/kg) was also tested. The active, but not threshold, dose of salvA significantly decreased phasic dopamine release without affecting dopamine reuptake in the NAc core and shell. SalvA increased ICSS thresholds and significantly lowered breakpoint on the progressive ratio schedule, indicating a decrease in motivation. The time course of the KOR-mediated decrease in dopamine in the core was qualitatively similar to the effects on motivated behavior. These data suggest that the effects of KOR activation on motivation are due, in part, to inhibition of phasic dopamine signaling in the NAc core.

Effects of dopamine medication on sequence learning with stochastic feedback in Parkinson's disease.

A growing body of evidence suggests that the midbrain dopamine system plays a key role in reinforcement learning and disruption of the midbrain dopamine system in Parkinson's disease (PD) may lead to deficits on tasks that require learning from feedback. We examined how changes in dopamine levels (“ON” and “OFF” their dopamine medication) affect sequence learning from stochastic positive and negative feedback using Bayesian reinforcement learning models. We found deficits in sequence learning in patients with PD when they were “ON” and “OFF” medication relative to healthy controls, but smaller differences between patients “OFF” and “ON”. The deficits were mainly due to decreased learning from positive feedback, although across all participant groups learning was more strongly associated with positive than negative feedback in our task. The learning in our task is likely mediated by the relatively depleted dorsal striatum and not the relatively intact ventral striatum. Therefore, the changes we see in our task may be due to a strong loss of phasic dopamine signals in the dorsal striatum in PD.