Dopamine Neuron Firing Research Articles

VTA dopamine neurons are hyperexcitable in 3xTg-AD mice due to casein kinase 2-dependent SK channel dysfunction

Alzheimer’s disease (AD) patients exhibit neuropsychiatric symptoms that extend beyond classical cognitive deficits, suggesting involvement of subcortical areas. Here, we investigated the role of midbrain dopamine (DA) neurons in AD using the amyloid + tau-driven 3xTg-AD mouse model. We found deficits in reward-based operant learning in AD mice, suggesting possible VTA DA neuron dysregulation. Physiological assessment revealed hyperexcitability and disrupted firing in DA neurons caused by reduced activity of small-conductance calcium-activated potassium (SK) channels. RNA sequencing from contents of single patch-clamped DA neurons (Patch-seq) identified up-regulation of the SK channel modulator casein kinase 2 (CK2), which we corroborated by immunohistochemical protein analysis. Pharmacological inhibition of CK2 restored SK channel activity and normal firing patterns in 3xTg-AD mice. These findings identify a mechanism of ion channel dysregulation in VTA DA neurons that could contribute to behavioral abnormalities in AD, paving the way for novel treatment strategies.

Functional Adaptation in the Brain Habenulo-Mesencephalic Pathway During Cannabinoid Withdrawal.

The mesolimbic reward system originating from dopamine neurons in the ventral tegmental area (VTA) of the midbrain shows a profound reduction in function during cannabinoid withdrawal. This condition may underlie aversive states that lead to compulsive drug seeking and relapse. The lateral habenula (LHb) exerts negative control over the VTA via the GABA rostromedial tegmental nucleus (RMTg), representing a potential convergence point for drug-induced opponent processes. We hypothesized that the LHb-RMTg pathway might be causally involved in the hypodopaminergic state during cannabinoid withdrawal. To induce Δ9-tetrahydrocannabinol (THC) dependence, adult male Sprague-Dawley rats were treated with THC (15 mg/kg, i.p.) twice daily for 6.5-7 days. Administration of the cannabinoid antagonist rimonabant (5 mg/kg, i.p.) precipitated a robust behavioral withdrawal syndrome, while abrupt THC suspension caused milder signs of abstinence. Extracellular single unit recordings confirmed a marked decrease in the discharge frequency and burst firing of VTA dopamine neurons during THC withdrawal. The duration of RMTg-evoked inhibition was longer in THC withdrawn rats. Additionally, the spontaneous activity of RMTg neurons and of LHb neurons was strongly depressed during cannabinoid withdrawal. These findings support the hypothesis that functional changes in the habenulo-mesencephalic circuit are implicated in the mechanisms underlying substance use disorders.

Expectancy-related changes in firing of dopamine neurons depend on hippocampus

The orbitofrontal cortex (OFC) and hippocampus (HC) both contribute to the cognitive maps that support flexible behavior. Previously, we used the dopamine neurons to measure the functional role of OFC. We recorded midbrain dopamine neurons as rats performed an odor-based choice task, in which expected rewards were manipulated across blocks. We found that ipsilateral OFC lesions degraded dopaminergic prediction errors, consistent with reduced resolution of the task states. Here we have repeated this experiment in male rats with ipsilateral HC lesions. The results show HC also shapes the task states, however unlike OFC, which provides information local to the trial, the HC is necessary for estimating upper-level hidden states that distinguish blocks. The results contrast the roles of the OFC and HC in cognitive mapping and suggest that the dopamine neurons access rich information from distributed regions regarding the environment’s structure, potentially enabling this teaching signal to support complex behaviors.

Receptor and metabolic insights on the ability of caffeine to prevent alcohol-induced stimulation of mesolimbic dopamine transmission

The consumption of alcohol and caffeine affects the lives of billions of individuals worldwide. Although recent evidence indicates that caffeine impairs the reinforcing properties of alcohol, a characterization of its effects on alcohol-stimulated mesolimbic dopamine (DA) function was lacking. Acting as the pro-drug of salsolinol, alcohol excites DA neurons in the posterior ventral tegmental area (pVTA) and increases DA release in the nucleus accumbens shell (AcbSh). Here we show that caffeine, via antagonistic activity on A2A adenosine receptors (A2AR), prevents alcohol-dependent activation of mesolimbic DA function as assessed, in-vivo, by brain microdialysis of AcbSh DA and, in-vitro, by electrophysiological recordings of pVTA DA neuronal firing. Accordingly, while the A1R antagonist DPCPX fails to prevent the effects of alcohol on DA function, both caffeine and the A2AR antagonist SCH 58261 prevent alcohol-dependent pVTA generation of salsolinol and increase in AcbSh DA in-vivo, as well as alcohol-dependent excitation of pVTA DA neurons in-vitro. However, caffeine also prevents direct salsolinol- and morphine-stimulated DA function, suggesting that it can exert these inhibitory effects also independently from affecting alcohol-induced salsolinol formation or bioavailability. Finally, untargeted metabolomics of the pVTA showcases that caffeine antagonizes alcohol-mediated effects on molecules (e.g. phosphatidylcholines, fatty amides, carnitines) involved in lipid signaling and energy metabolism, which could represent an additional salsolinol-independent mechanism of caffeine in impairing alcohol-mediated stimulation of mesolimbic DA transmission. In conclusion, the outcomes of this study strengthen the potential of caffeine, as well as of A2AR antagonists, for future development of preventive/therapeutic strategies for alcohol use disorder.

Role of ventral tegmental area dopamine neurons in fear memory retention in post-traumatic stress disorder model rats

Ventral tegmental area (VTA) dopamine (DA) neurons have been found to substantially associate with post-traumatic stress disorder (PTSD) pathology, however, whether and how these DA neurons affect fear memory management in PTSD individuals remains largely unknown. In this study, we utilized auditory conditioned foot-shock to evaluate the fear memory retrieval and retention characteristics in a single prolonged stress-induced PTSD rat model. We employed chemogenetic technology to specifically activate VTA DA neurons to examine the freezing behaviors responding to the conditioned stimuli. In vivo extracellular electrophysiological analyses were used to identify VTA DA neuronal firing alterations due to the chemogenetic activation. The results demonstrated that PTSD model rats showed comparable fear memory retrieval (Day 2 after the conditioned foot-shock), but significant enhancements in fear memory retention (Day 8 after the conditioned foot-shock), compared to normal control rats. Chemogenetic activation of VTA DA neurons markedly diminished the retention of fear memory in PTSD model rats, which appeared concomitantly with increases in the firing activities of the DA neurons. These findings revealed that PTSD induced the persistence of fear memory, which could be attenuated by activation of VTA DA neurons. It is presumed that VTA dopaminergic signals may serve as a prospective option for PTSD treatment.

D2-like dopamine receptors blockade within the dentate gyrus shows a greater effect on stress-induced analgesia in the tail-flick test compared to D1-like dopamine receptors.

Acute stress, as a protective mechanism to respond to an aversive stimulus, can often be accompanied by suppressing pain perception via promoting consistent burst firing of dopamine neurons. Besides, sensitive and advanced research techniques led to the recognition of the mesohippocampal dopaminergic terminals, particularly in the hippocampal dentate gyrus (DG). Moreover, previous studies have shown that dopamine receptors within the hippocampal DG play a critical role in induced antinociceptive responses by forced swim stress (FSS) in the presence of inflammatory pain. Since different pain states can trigger various mechanisms and transmitter systems, the present experiments aimed to investigate whether dopaminergic receptors within the DG have the same role in the presence of acute thermal pain. Ninety-seven adult male albino Wistar rats underwent stereotaxic surgery, and a stainless steel guide cannula was unilaterally implanted 1 mm above the DG. Different doses of SCH23390 or sulpiride as D1- and D2-like dopamine receptor antagonists were microinjected into the DG 5-10 min before exposure to FSS, and 5 min after FSS exposure, the tail-flick test evaluated the effect of stress on the nociceptive response at the time-set intervals. The results demonstrated that exposure to FSS could significantly increase the acute pain perception threshold, while intra-DG administration of SCH23390 and sulpiride reduced the antinociceptive effect of FSS in the tail-flick test. Additionally, it seems the D2-like dopamine receptor within the DG plays a more prominent role in FSS-induced analgesia in the acute pain model.

Dopamine Release in the Nucleus Accumbens Core Encodes the General Excitatory Components of Learning.

Dopamine release in the nucleus accumbens core (NAcC) is generally considered to be a proxy for phasic firing of the ventral tegmental area dopamine (VTADA) neurons. Thus, dopamine release in NAcC is hypothesized to reflect a unitary role in reward prediction error signaling. However, recent studies reveal more diverse roles of dopamine neurons, which support an emerging idea that dopamine regulates learning differently in distinct circuits. To understand whether the NAcC might regulate a unique component of learning, we recorded dopamine release in NAcC while male rats performed a backward conditioning task where a reward is followed by a neutral cue. We used this task because we can delineate different components of learning, which include sensory-specific inhibitory and general excitatory components. Furthermore, we have shown that VTADA neurons are necessary for both the specific and general components of backward associations. Here, we found that dopamine release in NAcC increased to the reward across learning while reducing to the cue that followed as it became more expected. This mirrors the dopamine prediction error signal seen during forward conditioning and cannot be accounted for temporal-difference reinforcement learning. Subsequent tests allowed us to dissociate these learning components and revealed that dopamine release in NAcC reflects the general excitatory component of backward associations, but not their sensory-specific component. These results emphasize the importance of examining distinct functions of different dopamine projections in reinforcement learning.

Impact of Unitary Synaptic Inhibition on Spike Timing in Ventral Tegmental Area Dopamine Neurons.

Midbrain dopamine neurons receive convergent synaptic input from multiple brain areas, which perturbs rhythmic pacemaking to produce the complex firing patterns observed in vivo. This study investigated the impact of single and multiple inhibitory inputs on ventral tegmental area (VTA) dopamine neuron firing in mice of both sexes using novel experimental measurements and modeling. We first measured unitary inhibitory postsynaptic currents produced by single axons using both minimal electrical stimulation and minimal optical stimulation of rostromedial tegmental nucleus and ventral pallidum afferents. We next determined the phase resetting curve, the reversal potential for GABAA receptor-mediated inhibitory postsynaptic currents (IPSCs), and the average interspike membrane potential trajectory during pacemaking. We combined these data in a phase oscillator model of a VTA dopamine neuron, simulating the effects of unitary inhibitory postsynaptic conductances (uIPSGs) on spike timing and rate. The effect of a uIPSG on spike timing was predicted to vary according to its timing within the interspike interval or phase. Simulations were performed to predict the pause duration resulting from the synchronous arrival of multiple uIPSGs and the changes in firing rate and regularity produced by asynchronous uIPSGs. The model data suggest that asynchronous inhibition is more effective than synchronous inhibition, because it tends to hold the neuron at membrane potentials well positive to the IPSC reversal potential. Our results indicate that small fluctuations in the inhibitory synaptic input arriving from the many afferents to each dopamine neuron are sufficient to produce highly variable firing patterns, including pauses that have been implicated in reinforcement.

Oral pre- and early postnatal cannabis exposure disinhibits ventral tegmental area dopamine neuron activity but does not influence cocaine preference in offspring in mice.

Cannabis consumption has increased from 1.5% to 2.5% in Canada between 2012 and 2019. Clinical studies have indicated effects of prenatal cannabis exposure on birth weight, substance use, and neurodevelopmental disorders, but are confounded by several difficult to control variables. Animal models allow for examination of the mechanism of cannabis-induced changes in neurodevelopment and behavior, while controlling dose and timing. Several animal models of prenatal cannabis exposure exist which provide varying levels of construct validity, control of dose, and exposure to maternal stress. Using a voluntary oral consumption model, mouse dams received 5 mg/kg Δ9-tetrahydrocannabinol (THC) whole cannabis oil in peanut butter daily from gestational day 1 (GD1) to postnatal day 10 (PD10). At GD1, GD18, PD1, PD10, and PD15, maternal plasma was collected; pup brains were collected from GD18 onward. Pup brains had higher levels of THC and cannabidiol at each time point, each of which persisted in maternal plasma and pup brains past the end of treatment (PD15). Male and female adolescent offspring were examined for changes to ventral tegmental area (VTA) dopamine neuron activity and cocaine-seeking behavior. Prenatal and early postnatal (GD1-PD10) cannabis-exposed male, but not female mice had decreased gamma-aminobutyric acid (GABAergic) input, depolarized resting membrane potential, and increased spontaneous firing of VTA dopamine neurons. Cannabis-exposed offspring showed faster decay of N-methyl-D-aspartate (NMDA) currents in both sexes. However, no differences in cocaine-seeking behavior were noted. These data characterize a voluntary prenatal cannabis exposure model and demonstrates VTA dopamine neuronal activity is disinhibited in offspring.

Receptor and metabolic insights on the ability of caffeine to prevent alcohol-induced stimulation of mesolimbic dopamine transmission.

The consumption of alcohol and caffeine affects the lives of billions of individuals worldwide. Although recent evidence indicates that caffeine impairs the reinforcing properties of alcohol, a characterization of its effects on alcohol-stimulated mesolimbic dopamine (DA) function was lacking. Acting as the pro-drug of salsolinol, alcohol excites DA neurons in the posterior ventral tegmental area (pVTA) and increases DA release in the nucleus accumbens shell (AcbSh). Here we show that caffeine, via antagonistic activity on A2A adenosine receptors (A2AR), prevents alcohol-dependent activation of mesolimbic DA function as assessed, in-vivo, by brain microdialysis of AcbSh DA and, in-vitro, by electrophysiological recordings of pVTA DA neuronal firing. Accordingly, while the A1R antagonist DPCPX fails to prevent the effects of alcohol on DA function, both caffeine and the A2AR antagonist SCH 58261 prevent alcohol-dependent pVTA generation of salsolinol and increase in AcbSh DA in-vivo, as well as alcohol-dependent excitation of pVTA DA neurons in-vitro. However, caffeine also prevents direct salsolinol- and morphine-stimulated DA function, suggesting that it can exert these inhibitory effects also independently from affecting alcohol-induced salsolinol formation or bioavailability. Finally, untargeted metabolomics of the pVTA showcases that caffeine antagonizes alcohol-mediated effects on molecules (e.g. phosphatidylcholines, fatty amides, carnitines) involved in lipid signaling and energy metabolism, which could represent an additional salsolinol-independent mechanism of caffeine in impairing alcohol-mediated stimulation of mesolimbic DA transmission. In conclusion, the outcomes of this study strengthen the potential of caffeine, as well as of A2AR antagonists, for future development of preventive/therapeutic strategies for alcohol use disorder.

AST-001 Improves Social Deficits and Restores Dopamine Neuron Activity in a Mouse Model of Autism.

Autism spectrum disorder (ASD) is a complex neurodevelopmental disorder characterized by impaired social communication and social interaction, restricted and repetitive behavior, and interests. The core symptoms of ASD are associated with deficits in mesocorticolimbic dopamine pathways that project from the ventral tegmental area (VTA) to the nucleus accumbens (NAc) and medial prefrontal cortex (mPFC). AST-001 is an investigational product currently in a phase 3 clinical trial for treating the core symptoms of ASD, with L-serine as the API (active pharmaceutical ingredient). Because the causes of ASD are extremely heterogeneous, a single genetic ASD model cannot represent all autism models. In this paper, we used the VPA-exposed model, which is more general and widely used than a single genetic model, but this is also one of the animal models of autism. Herein, we conducted experiments to demonstrate the efficacy of AST-001 as L-Serine that alters the regulation of the firing rate in dopamine neurons by inhibiting small conductance Ca2+-activated K+ channels (SK channels). Through these actions, AST-001 improved sociability and social novelty by rescuing the intrinsic excitabilities of dopamine neurons in VPA-exposed ASD mouse models that showed ASD-related behavioral abnormalities. It is thought that this effect of improving social deficits in VPA-exposed ASD mouse models is due to AST-001 normalizing aberrant SK channel activities that slowed VTA dopamine neuron firing. Overall, these findings suggest that AST-001 may be a potential therapeutic agent for ASD patients, and that its mechanism of action may involve the regulation of dopamine neuron activity and the improvement of social interaction.

Leaky lessons learned: Efflux prone dopamine transporter variant reveals sex and circuit specific contributions of D2 receptor signalling to neuropsychiatric disease.

Aberrant dopamine (DA) signalling has been implicated in various neuropsychiatric disorders, including attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder (ASD), schizophrenia, bipolar disorder (BPD) and addiction. The availability of extracellular DA is sculpted by the exocytotic release of vesicular DA and subsequent transporter-mediated clearance, rendering the presynaptic DA transporter (DAT) a crucial regulator of DA neurotransmission. D2-type DA autoreceptors (D2ARs) regulate multiple aspects of DA homeostasis, including (i) DA synthesis, (ii) vesicular release, (iii) DA neuron firing and (iv) the surface expression of DAT and DAT-mediated DA clearance. The DAT Val559 variant, identified in boys with ADHD or ASD, as well as in a girl with BPD, supports anomalous DA efflux (ADE), which we have shown drives tonic activation of D2ARs. Through ex vivo and in vivo studies of the DAT Val559 variant using transgenic knock-in mice, we have uncovered a circuit and sex-specific capacity of D2ARs to regulate DAT, which consequently disrupts DA signalling and behaviour differently in males and females. Our studies reveal the ability of the construct-valid DAT Val559 model to elucidate endogenous mechanisms that support DA signalling, findings that may be of translational and/or therapeutic importance.

Mesolimbic Neural Response Dynamics Predict Future Individual Alcohol Drinking in Mice

BackgroundIndividual variability in response to rewarding stimuli is a striking but understudied phenomenon. The mesolimbic dopamine system is critical in encoding the reinforcing properties of both natural reward and alcohol; however, how innate or baseline differences in the response dynamics of this circuit define individual behavior and shape future vulnerability to alcohol remain unknown. MethodsUsing naturalistic behavioral assays, a voluntary alcohol drinking paradigm, in vivo fiber photometry, in vivo electrophysiology, and chemogenetics, we investigated how differences in mesolimbic neural circuit activity contribute to the individual variability seen in reward processing and, by proxy, alcohol drinking. ResultsWe first characterized heterogeneous behavioral and neural responses to natural reward and defined how these baseline responses predicted future individual alcohol-drinking phenotypes in male mice. We then determined spontaneous ventral tegmental area dopamine neuron firing profiles associated with responses to natural reward that predicted alcohol drinking. Using a dual chemogenetic approach, we mimicked specific mesolimbic dopamine neuron firing activity before or during voluntary alcohol drinking to link unique neurophysiological profiles to individual phenotype. We show that hyperdopaminergic individuals exhibit a lower neuronal response to both natural reward and alcohol that predicts lower levels of alcohol consumption in the future. ConclusionsThese findings reveal unique, circuit-specific neural signatures that predict future individual vulnerability or resistance to alcohol and expand the current knowledge base on how some individuals are able to titrate their alcohol consumption whereas others go on to engage in unhealthy alcohol-drinking behaviors.

Quantitative and qualitative sex difference in habenula-induced inhibition of midbrain dopamine neurons in the rat.

Clinically relevant sex differences have been noted in a number of affective, behavioral, cognitive, and neurological health disorders. Midbrain dopamine neurons are implicated in several of these same disorders and consequently are under investigation for their potential role in the manifestation of these sex differences. The lateral habenula exerts significant inhibitory control over dopamine neuronal firing, yet little is known about sex differences in this particular neurocircuit. We performed in vivo, single unit, extracellular recordings of dopamine neurons in female and male anesthetized rats in response to single pulse stimulation of the lateral habenula. In addition, we assessed baseline firing properties of lateral habenula neurons and, by immunochemical means, assessed the distribution of estrogen receptor alpha cells in the lateral habenula. Habenula-induced inhibition of dopamine neuronal firing is reduced in female rats relative to male rats. In addition, male rats had a higher prevalence of rebound excitation. Furthermore, the firing pattern of lateral habenula neurons was less variable in female rats, and female rats had a higher density of estrogen receptor alpha positive cells in the lateral habenula. We found that the dopamine neuronal response to habenular stimulation is both qualitatively and quantitatively different in female and male rats. These novel findings together with reports in the contemporary literature lead us to posit that the sex difference in dopamine inhibition seen here relate to differential firing properties of lateral habenula neurons resulting from the presence of sex hormones. Further work is needed to test this hypothesis, which may have implications for understanding the etiology of several mental health disorders including depression, schizophrenia, and addiction.

Wistar Kyoto rats exhibit decreased serotonin neuronal firing and increased norepinephrine burst activity but dampened hippocampal α2-adrenoceptor sensitivity.

Wistar Kyoto (WKY) rats manifest abnormalities in the function of monoamine receptors and transporters, as well as levels of these neurotransmitters in the brain. The present study assessed alterations in the firing activity of serotonin (5-hydroxytryptamine [5-HT]), norepinephrine (NE), and dopamine (DA) neurons, as well as the activity of 5-HT and NE receptors and transporters in the hippocampus. In vivo electrophysiological recordings were conducted in male WKY and Wistar rats. Extracellular single-unit recordings of 5-HT, NE, and DA neurons were performed. Recordings of pyramidal neurons were conducted in the medial prefrontal cortex (mPFC) and the hippocampus, where direct application of 5-HT and NE by iontophoresis was also carried out. The mean firing rate of 5-HT neurons was significantly decreased in WKY compared to Wistar rats. The burst activity of NE neurons was significantly increased in WKY, while their mean firing activity was not changed. There was no alteration in the firing, burst, and population activity of DA neurons in WKY animals. In the hippocampus, a decrease in sensitivity of α2-adrenoceptors, but not 5-HT receptors, was observed. There was, however, no change in the activity of 5-HT and NE transporters. The firing activity of mPFC pyramidal neurons was similar in WKY versus Wistar rats. In WKY rats, there was a decrease in the firing activity of 5-HT neurons. There was also an enhanced burst activity of NE neurons, accompanied by a reduction in sensitivity of the α2-adrenoceptor in the hippocampus, inferring a decrease in NE transmission.

Adaptor protein-3 produces synaptic vesicles that release phasic dopamine

The burst firing of midbrain dopamine neurons releases a phasic dopamine signal that mediates reinforcement learning. At many synapses, however, high firing rates deplete synaptic vesicles (SVs), resulting in synaptic depression that limits release. What accounts for the increased release of dopamine by stimulation at high frequency? We find that adaptor protein-3 (AP-3) and its coat protein VPS41 promote axonal dopamine release by targeting vesicular monoamine transporter VMAT2 to the axon rather than dendrites. AP-3 and VPS41 also produce SVs that respond preferentially to high-frequency stimulation, independent of their role in axonal polarity. In addition, conditional inactivation of VPS41 in dopamine neurons impairs reinforcement learning, and this involves a defect in the frequency dependence of release rather than the amount of dopamine released. Thus, AP-3 and VPS41 promote the axonal polarity of dopamine release but enable learning by producing a distinct population of SVs tuned specifically to high firing frequency that confers the phasic release of dopamine.

Striatal Dopamine Signals and Reward Learning.

We are constantly bombarded by sensory information and constantly making decisions on how to act. In order to optimally adapt behavior, we must judge which sequences of sensory inputs and actions lead to successful outcomes in specific circumstances. Neuronal circuits of the basal ganglia have been strongly implicated in action selection, as well as the learning and execution of goal-directed behaviors, with accumulating evidence supporting the hypothesis that midbrain dopamine neurons might encode a reward signal useful for learning. Here, we review evidence suggesting that midbrain dopaminergic neurons signal reward prediction error, driving synaptic plasticity in the striatum underlying learning. We focus on phasic increases in action potential firing of midbrain dopamine neurons in response to unexpected rewards. These dopamine neurons prominently innervate the dorsal and ventral striatum. In the striatum, the released dopamine binds to dopamine receptors, where it regulates the plasticity of glutamatergic synapses. The increase of striatal dopamine accompanying an unexpected reward activates dopamine type 1 receptors (D1Rs) initiating a signaling cascade that promotes long-term potentiation of recently active glutamatergic input onto striatonigral neurons. Sensorimotor-evoked glutamatergic input, which is active immediately before reward delivery will thus be strengthened onto neurons in the striatum expressing D1Rs. In turn, these neurons cause disinhibition of brainstem motor centers and disinhibition of the motor thalamus, thus promoting motor output to reinforce rewarded stimulus-action outcomes. Although many details of the hypothesis need further investigation, altogether, it seems likely that dopamine signals in the striatum might underlie important aspects of goal-directed reward-based learning.

Olive oil-derived endocannabinoid-like mediators inhibit palatable food-induced reward and obesity

N-oleoylglycine (OlGly), a lipid derived from the basic component of olive oil, oleic acid, and N-oleoylalanine (OlAla) are endocannabinoid-like mediators. We report that OlGly and OlAla, by activating the peroxisome proliferator-activated receptor alpha (PPARα), reduce the rewarding properties of a highly palatable food, dopamine neuron firing in the ventral tegmental area, and the obesogenic effect of a high-fat diet rich in lard (HFD-L). An isocaloric olive oil HFD (HFD-O) reduced body weight gain compared to the HFD-L, in a manner reversed by PPARα antagonism, and enhanced brain and intestinal OlGly levels and gut microbial diversity. OlGly or OlAla treatment of HFD-L mice resulted in gut microbiota taxonomic changes partly similar to those induced by HFD-O. We suggest that OlGly and OlAla control body weight by counteracting highly palatable food overconsumption, and possibly rebalancing the gut microbiota, and provide a potential new mechanism of action for the obeso-preventive effects of olive oil-rich diets.

Enhancing reinforcement learning models by including direct and indirect pathways improves performance on striatal dependent tasks.

A major advance in understanding learning behavior stems from experiments showing that reward learning requires dopamine inputs to striatal neurons and arises from synaptic plasticity of cortico-striatal synapses. Numerous reinforcement learning models mimic this dopamine-dependent synaptic plasticity by using the reward prediction error, which resembles dopamine neuron firing, to learn the best action in response to a set of cues. Though these models can explain many facets of behavior, reproducing some types of goal-directed behavior, such as renewal and reversal, require additional model components. Here we present a reinforcement learning model, TD2Q, which better corresponds to the basal ganglia with two Q matrices, one representing direct pathway neurons (G) and another representing indirect pathway neurons (N). Unlike previous two-Q architectures, a novel and critical aspect of TD2Q is to update the G and N matrices utilizing the temporal difference reward prediction error. A best action is selected for N and G using a softmax with a reward-dependent adaptive exploration parameter, and then differences are resolved using a second selection step applied to the two action probabilities. The model is tested on a range of multi-step tasks including extinction, renewal, discrimination; switching reward probability learning; and sequence learning. Simulations show that TD2Q produces behaviors similar to rodents in choice and sequence learning tasks, and that use of the temporal difference reward prediction error is required to learn multi-step tasks. Blocking the update rule on the N matrix blocks discrimination learning, as observed experimentally. Performance in the sequence learning task is dramatically improved with two matrices. These results suggest that including additional aspects of basal ganglia physiology can improve the performance of reinforcement learning models, better reproduce animal behaviors, and provide insight as to the role of direct- and indirect-pathway striatal neurons.

Temporal scaling of dopamine neuron firing and dopamine release by distinct ion channels shape behavior.

Dopamine is broadly implicated in reinforcement learning, but how patterns of dopamine activity are generated is poorly resolved. Here, we demonstrate that two ion channels, Kv4.3 and BKCa1.1, regulate the pattern of dopamine neuron firing and dopamine release on different time scales to influence separate phases of reinforced behavior in mice. Inactivation of Kv4.3 in VTA dopamine neurons increases ex vivo pacemaker activity and excitability that is associated with increased in vivo firing rate and ramping dynamics before lever press in a learned instrumental paradigm. Loss of Kv4.3 enhances performance of the learned response and facilitates extinction. In contrast, loss of BKCa1.1 increases burst firing and phasic dopamine release that enhances learning of an instrumental response and enhances extinction burst lever pressing in early extinction that is associated with a greater change in activity between reinforced and unreinforced actions. These data demonstrate that disruption of intrinsic regulators of neuronal activity differentially affects dopamine dynamics during reinforcement and extinction learning.