Pavlovian Conditioned Responses Research Articles

The behavioral origins of phylogenic responses and ontogenic habits.

An examination of innate behavior and its possible origins suggests parallels with the formation of habitual behavior. Inflexible but adaptive responses-innate reflexive behavior, Pavlovian conditioned responses, and operant habits-may have evolved from variable behavior in phylogeny and ontogeny. This form of "plasticity-first" scientific narrative was unpopular post-Darwin but has recently gained credibility in evolutionary biology. The present article seeks to identify originating events and contingencies contributing to such inflexible but adaptive behavior at both phylogenic and ontogenic levels of selection. In ontogeny, the development of inflexible performance (i.e., habit) from variable operant behavior is reminiscent of the genetic accommodation of initially variable phylogenic traits. The effects characteristic of habit (e.g., unresponsiveness to reinforcer devaluation) are explicable as the result of a conflict between behaviors at distinct levels of selection. The present interpretation validates the practice of seeking hard analogies between evolutionary biology and operant behavior. Finding such parallels implies the validity of a claim that organismal behavior, both innate and learned, is a product of selection by consequences. A complete and coherent account of organismal behavior may ultimately focus on functional selective histories in much the same way evolutionary biology does with its subject matter.

Sex-biased effects of outcome devaluation by sensory-specific satiety on Pavlovian-conditioned behavior.

Goal-directed behavior relies on accurate mental representations of the value of expected outcomes. Disruptions to this process are a central feature of several neuropsychiatric disorders, including addiction. Goal-directed behavior is most frequently studied using instrumental paradigms paired with outcome devaluation, but cue-evoked behaviors in Pavlovian settings can also be goal-directed and therefore sensitive to changes in outcome value. Emerging literature suggests that male and female rats may differ in the degree to which their Pavlovian-conditioned responses are goal-directed, but interpretation of these findings is complicated by the tendency of female and male rats to engage in distinct types of Pavlovian responses when trained with localizable cues. Here, we used outcome devaluation via sensory-specific satiety to assess the behavioral responses in male and female Long Evans rats trained to respond to an auditory CS (conditioned stimulus) in a Pavlovian-conditioning paradigm. We found that satiety-induced devaluation led to a decrease in behavioral responding to the reward-predictive CS, with males showing an effect on both port entry latency and probability and females showing an effect only on port entry probability. Overall, our results suggest that outcome devaluation affects Pavlovian-conditioned responses in both male and female rats, but that females may be less sensitive to outcome devaluation.

Blocking μ-opioid receptors attenuates reinstatement of responding to an alcohol-predictive conditioned stimulus through actions in the ventral hippocampus.

The µ-opioid system is involved in the reinstatement of responding that is immediately evoked by alcohol-predictive cues. The extent of its involvement in reinstatement observed in a new model that evaluates the delayed effects of re-exposure to alcohol, however, is unclear. The current study investigated the role of µ-opioid receptors (MORs) in the delayed reinstatement of an extinguished, Pavlovian conditioned response that was evoked 24 h after alcohol re-exposure. Female and male Long-Evans rats received Pavlovian conditioning in which a conditioned stimulus (CS) was paired with the delivery of an appetitive unconditioned stimulus (US; Experiments 1, 2, 4: 15% v/v alcohol; Experiment 3: 10% w/v sucrose) that was delivered into a fluid port for oral intake. During subsequent extinction sessions, the CS was presented as before but without the US. Next, the US was delivered but without the CS. A reinstatement test was conducted 24 h later, during which the CS was presented in the absence of the US. Silencing MORs via systemic naltrexone (0.3 or 1.0 mg/kg) attenuated reinstatement of port entries elicited by an alcohol-CS, but not those elicited by a sucrose-CS. Finally, blocking MORs in the ventral hippocampus via bilateral microinfusion of D-Phe-Cys-Tyr-D-Trp-Arg-Thr-Pen-Thr-NH2 (CTAP; 2.5 or 5.0 µg/hemisphere) prevented reinstatement of port alcohol-CS port entries. These data show that MORs are involved in the delayed reinstatement of a Pavlovian conditioned response in an alcohol-specific manner. Importantly, these data illustrate, for the first time, that MORs in the ventral hippocampus are necessary for responding to an alcohol-predictive cue.

Optogenetic activation of basolateral amygdala-to-nucleus accumbens core neurons promotes Pavlovian approach responses but not instrumental pursuit of reward cues

Reward-associated conditioned stimuli (CSs) can acquire predictive value, evoking conditioned approach behaviours that prepare animals to engage with forthcoming rewards. Such CSs can also acquire conditioned reinforcing value, becoming attractive and pursued. Through their conditioned effects, CSs can promote adaptive (e.g., locating food) but also maladaptive behaviours (e.g., drug use). Basolateral amygdala neurons projecting to the nucleus accumbens core (BLA→NAc core neurons) mediate the response to appetitive CSs, but the extent to which this involves effects on the predictive and/or conditioned reinforcing properties of CSs is unclear. Thus, we examined the effects of optogenetic stimulation of BLA→NAc core neurons on i) CS-triggered approach to the site of reward delivery, a Pavlovian conditioned approach response and ii) the instrumental pursuit of a CS, a measure of conditioned reinforcement. Water-restricted, adult male rats learned that a light-tone compound cue (the CS) predicts water delivery into a receptacle. Pairing optogenetic stimulation of BLA→NAc core neurons with CS presentation potentiated CS-triggered water receptacle visits. This suggests that activity in BLA→NAc core neurons promotes Pavlovian goal-approach behaviour. Next, rats could lever press for CS presentations, without water delivery. Optogenetic stimulation of BLA→NAc core neurons either during instrumental test sessions or during prior CS-water conditioning did not influence lever responding for the CS. This suggests that activity in BLA→NAc core neurons does not influence the instrumental pursuit of a water-paired CS. We conclude that activation of BLA→NAc core neurons promotes cue-induced control over behaviour by increasing conditioned goal-approach responses, without affecting the operant pursuit of reward cues.

The positive valence system, adaptive behaviour and the origins of reward.

Although the hey-day of motivation as an area of study is long past, the issues with which motivational theorists grappled have not grown less important: i.e. the development of deterministic explanations for the particular tuning of the nervous system to specific changes in the internal and external environment and the organisation of adaptive behavioural responses to those changes. Here, we briefly elaborate these issues in describing the structure and function of the 'positive valence system'. We describe the origins of adaptive behaviour in an ascending arousal system, sensitive to peripheral regulatory changes, that modulates and activates various central motivational states. Associations between these motivational states and sensory inputs underlie evaluative conditioning and generate the representation of the 'unconditioned' stimuli fundamental to Pavlovian conditioning. As a consequence, associations with these stimuli can generate Pavlovian conditioned responses through the motivational control of stimulus event associations with sensory and affective components of the valence system to elicit conditioned orienting, consummatory and preparatory responses, particularly the affective responses reflecting Pavlovian excitation and inhibition, arousal and reinforcement, the latter used to control the formation of habits. These affective processes also provoke emotional responses, allowing the externalisation of positive valence in hedonic experience to generate the goal or reward values that mediate goal-directed action. Together these processes form the positive valence system, ensure the maintenance of adaptive behaviour and, through the association of sensory events and emotional responses through consummatory experience, provide the origins of reward.

β2* nicotinic acetylcholine receptor subtypes mediate nicotine-induced enhancement of Pavlovian conditioned responding to an alcohol cue.

Nicotine enhances Pavlovian conditioned responses to reward-associated cues. We investigated through which nicotinic acetylcholine receptor (nAChR) subtypes nicotine acts to produce this behavioral effect to an alcohol-associated cue. Male Long-Evans rats with freely available food and water were first accustomed to drinking 15% ethanol in their home cages using an intermittent access, two-bottle choice procedure. Then the rats were given 15 Pavlovian conditioning sessions in which a 15-s audiovisual conditioned stimulus (CS) predicted the delivery of 0.2 ml of ethanol, the unconditioned stimulus (US). Each session contained 12 CS-US trials. A control group received explicitly unpaired presentations of the CS and US. We measured Pavlovian conditioned approach to the site of US delivery during presentations of the CS, accounting for pre-CS baseline activity. Before each conditioning session, rats were injected subcutaneously with nicotine (0.4 mg/kg) or saline (1 ml/kg). During nAChR antagonist test sessions, rats were first injected systemically with the β2*-selective nAChR antagonist dihydro-beta-erythroidine (DHβE; 3 mg/kg) or the α7-selective nAChR antagonist methyllycaconitine (MLA; 6 mg/kg), followed by their assigned nicotine or saline injection before assessing their conditioned response to the alcohol-associated cue. Consistent with previous reports, nicotine enhanced the Pavlovian conditioned response to the alcohol-paired cue. DHβE attenuated this enhancement, whereas MLA did not. These results suggest that nicotine acts via β2*, but not α7, nAChRs to amplify Pavlovian conditioned responding to an alcohol cue. These findings contribute to a growing literature that identifies nAChRs as potential targets for pharmacological treatment of co-morbid alcohol and tobacco use disorders.

Binary Semantic Classification Using Cortical Activation with Pavlovian-Conditioned Vestibular Responses in Healthy and Locked-In Individuals.

To develop a more reliable brain–computer interface (BCI) for patients in the completely locked-in state (CLIS), here we propose a Pavlovian conditioning paradigm using galvanic vestibular stimulation (GVS), which can induce a strong sensation of equilibrium distortion in individuals. We hypothesized that associating two different sensations caused by two-directional GVS with the thoughts of “yes” and “no” by individuals would enable us to emphasize the differences in brain activity associated with the thoughts of yes and no and hence help us better distinguish the two from electroencephalography (EEG). We tested this hypothesis with 11 healthy and 1 CLIS participant. Our results showed that, first, conditioning of GVS with the thoughts of yes and no is possible. And second, the classification of whether an individual is thinking “yes” or “no” is significantly improved after the conditioning, even in the absence of subsequent GVS stimulations. We observed average classification accuracy of 73.0% over 11 healthy individuals and 85.3% with the CLIS patient. These results suggest the establishment of GVS-based Pavlovian conditioning and its usability as a noninvasive BCI.

Effects of ad libitum feeding and prefeeding on operant responding in sign- and goal-tracking rats

Sign-tracking and goal-tracking are behavioral tendencies in which Pavlovian conditioned responses are directed either toward the cue for an unconditioned stimulus (sign-tracking) or toward the location of an unconditioned stimulus delivery (goal-tracking). The current study examined operant response rates in sign- (n = 7) and goal-tracking (n = 11) Wistar rats under a restricted feeding schedule, ad libitum access to food, and reinforcer devaluation by prefeeding either the same or a different flavored pellet reinforcer. Only goal-tracking subjects significantly decreased their response rates after reinforcer devaluation by prefeeding, and only when the flavor used in prefeeding matched the reinforcer flavor. Both groups of subjects decreased responding under ad libitum food access compared to a 16-h food restriction schedule, but this effect size was larger in goal-tracking rats. These results extend recent findings that sign-trackers are more likely than goal-trackers to continue conditioned responding after unconditioned stimulus devaluation during operant conditioning.

Individual variation in the vigor and form of Pavlovian conditioned responses: Analysis of a model system

Pavlovian conditioning results in individual variation in the vigor and form of acquired behaviors. Here, we describe a general-process model of associative learning (HeiDI; How excitation and inhibition determine ideo-motion) that provides an analysis for such variation together with a range of other important group-level phenomena. The model takes as its starting point the idea that pairings of a conditioned stimulus (CS) and an unconditioned stimulus (US) result in the formation of reciprocal associations between their central representations. The asymptotic values of these associations and the rate at which these are reached are held to be influenced by the perceived salience of the CS (αCS) and US (βUS). Importantly, whether this associative knowledge is exhibited in behavior that reflects the properties of the CS (e.g., sign-tracking) or US (e.g., goal-tracking) is also influenced by the relative values of αCS and βUS. In this way, HeiDI provides an analysis for both quantitative and qualitative individual differences generated by Pavlovian conditioning procedures.

Individual differences in blink rate modulate the effect of instrumental control on subsequent Pavlovian responding

RationalePavlovian conditioned responses to cues that signal threat are rapidly acquired and tend to persist over time. However, recent research suggests that the ability to actively avoid or exert control over an anticipated threat can diminish the subsequent expression of Pavlovian responses. Studies in animal models suggest that active avoidance behavior and its consequences may be mediated by dopaminergic function. In the present study, we sought to replicate the finding that active control over threat can attenuate subsequent Pavlovian responding in humans and conducted exploratory analyses testing whether individual differences in blink rate, a putative index of dopaminergic function, might modulate this effect.MethodsParticipants underwent Pavlovian aversive conditioning, followed immediately by one of two conditions. In the active avoidance condition, participants had the opportunity to actively prevent the occurrence of an anticipated shock, whereas in a yoked extinction condition, participants passively observed the cessation of shocks, but with no ability to influence their occurrence. The following day, the conditioned stimuli were presented without shock, but both groups of participants had no opportunity to employ active instrumental responses. Blink rate was measured throughout the task, and skin conductance responses served as our index of Pavlovian conditioned responding.ResultsConsistent with our previous findings, we observed that the group that could actively avoid the shock on day 1 exhibited attenuated recovery of Pavlovian conditioned responses. Further, we found that individuals in the active avoidance group with higher blink rates exhibited a more robust attenuation of spontaneous recovery.ConclusionThis finding suggests that individual variation in dopaminergic function may modulate the efficacy with which active avoidance strategies can attenuate reactive Pavlovian responses.

Prescription opioid misusing chronic pain patients exhibit dysregulated context-dependent associations: Investigating associative learning in addiction with the cue-primed reactivity task

BackgroundAssociative learning undergirds the development of addiction, such that drug-related cues serve as conditioned stimuli to elicit drug-seeking responses. Plausibly, among opioid misusing chronic pain patients, pain-related information may serve as a conditioned stimulus to magnify opioid cue-elicited autonomic and craving responses through a process of second-order conditioning. MethodsWe utilized a novel psychophysiological probe of pain-opioid conditioned associations, the Cue-Primed Reactivity (CPR) task. In this task, participants were presented with images as primes (200 ms) and cues (6000 ms) in pairs organized in four task blocks: “control-opioid,” “pain-opioid,” “control-pain,” and “opioid-pain.” Opioid-treated chronic pain patients (N = 30) recruited from an Army base in the Western United States were classified as opioid misusers (n = 17) or non-misusers (n = 13) via a validated cutpoint on the Prescription Drug Use Questionnaire (PDUQ; Compton et al., 2008). Opioid misuse status was examined as a predictor of HRV, craving, and mood responses on the CPR task. ResultsHRV increased to a greater extent during the pain-opioid block compared to the control-opioid block for non-misusers compared to misusers (p = .003, η2partial = 0.27). In contrast, craving increased to a greater extent from baseline to the pain-opioid block for misusers than for non-misusers (p = .03, η2partial = .16). ConclusionsFindings suggest that opioid-treated chronic pain patients exhibit Pavlovian conditioned responses to opioid cues strengthened by an associative learning process of second-order conditioning when primed by pain-related images. This pain-opioid contingency appears to become disrupted among individuals who engage in opioid misuse, such that opioid-related stimuli elicit motivational responses irrespective of pain-related contextual stimuli.

Long-lasting contribution of dopamine in the nucleus accumbens core, but not dorsal lateral striatum, to sign-tracking.

The attribution of incentive salience to reward-paired cues is dependent on dopamine release in the nucleus accumbens core (NAcC). These dopamine signals conform to traditional reward-prediction error signals and have been shown to diminish with time. Here we examined whether the diminishing dopamine signal in the NAcC has functional implications for the expression of sign-tracking, a Pavlovian conditioned response indicative of the attribution of incentive salience to reward-paired cues. Food-restricted male Sprague Dawley rats were trained in a Pavlovian paradigm in which an insertable lever predicted delivery of food reward in a nearby food cup. After 7 or 14 training sessions, rats received infusions of saline, the dopamine antagonist flupenthixol, or the GABA agonists baclofen and muscimol into the NAcC or the dorsal lateral striatum (DLS). Dopamine antagonism within the NAcC attenuated sign-tracking, whereas reversible inactivation did not affect sign-tracking but increased non-specific food cup checking behaviors. Neither drug in the DLS affected sign-tracking behavior. Critically, extended training did not alter these effects. Although extended experience with an incentive stimulus may reduce cue-evoked dopamine in the NAcC, this does not remove the dependence on dopamine in this region to promote Pavlovian cue approach nor result in the recruitment of dorsal lateral striatal systems for this behavior. These data support the notion that dopamine within the mesoaccumbal system, but not the nigrostriatal system, contributes critically to incentive motivational processes independent of the length of training.

Can cleanerfish overcome temptation? A selective role for dopamine influence on cooperative-based decision making

Evidence suggests that animals are selected to make accurate choices and prioritize goals within the constraints of a given social environment to maximize fitness. These decisions are mostly based on complex processes in which value is linked to reward and cues may carry variable incentive salience. However, the level in which the incentive elicited by a cue is able to shift individual choices should differ between individuals and neurophysiological states. Here we used a notorious cooperative cleanerfish species Labroides dimidiatus to probe for differences in the incentive motivational valences given to food cues and then tested for the role of the dopaminergic system in the appraisal of such cues. We found that cleaners differed in Pavlovian conditioned approach behavioural responses to reward-associated stimuli: while the majority were fast to engage physically with the cue plate that indicated future reward delivery (sign trackers), only a few took significantly more time to respond (goal trackers). But amongst those that were considering the sole cue attractive, we discovered that the dopaminergic blockage decreased their initial propensity to approach and touch the cue plate. Our results show that dopamine disruption contributes to shifting the attribution of motivational incentive from the predictive cue towards the actual reward and provides key insight into the physiological framework of cooperative-based decision making.

Context specificity of both acquisition and extinction of a Pavlovian conditioned response

It is widely held that the extinction of a conditioned response is more context specific than its initial acquisition. One proposed explanation is that context serves to disambiguate the meaning of a stimulus. Using a procedure that equated the learning histories of the contexts, we show that the memory of an appetitive Pavlovian association can be highly context specific despite being unambiguous. This result is inconsistent with predictions of the Rescorla–Wagner model of learning but in line with configural accounts of contextual control of behavior. We propose an explanatory model in which context serves to modulate the gain of associative strength and which expands upon the configural idea of unitary representations of context and conditioned stimuli.

Activation of orexin/hypocretin neurons is associated with individual differences in cued fear extinction

Identifying the neurobiological mechanisms that underlie differential sensitivity to stress is critical for understanding the development and expression of stress-induced disorders, such as post-traumatic stress disorder (PTSD). Preclinical studies have suggested that rodents display different phenotypes associated with extinction of Pavlovian conditioned fear responses, with some rodent populations being resistant to extinction. An emerging literature also suggests a role for orexins in the consolidation processes associated with fear learning and extinction. To examine the possibility that the orexin system might be involved in individual differences in fear extinction, we used a Pavlovian conditioning paradigm in outbred Long-Evans rats. Rats showed significant variability in the extinction of cue-conditioned freezing and extinction recall, and animals were divided into groups based on their extinction profiles based on a median split of percent freezing behavior during repeated exposure to the conditioned cue. Animals resistant to extinction (high freezers) showed more freezing during repeated cue presentations during the within trial and between trial extinction sessions compared with the group showing significant extinction (low freezers), although there were no differences between these groups in freezing upon return to the conditioned context or during the conditioning session. Following the extinction recall session, activation of orexin neurons was determined using dual label immunohistochemistry for cFos in orexin positive neurons in the hypothalamus. Individual differences in the extinction of cue conditioned fear were associated with differential activation of hypothalamic orexin neurons. Animals showing poor extinction of cue-induced freezing (high freezers) had significantly greater percentage of orexin neurons with Fos in the medial hypothalamus than animals displaying significant extinction and good extinction recall (low freezers). Further, the freezing during extinction learning was positively correlated with the percentage of activated orexin neurons in both the lateral and medial hypothalamic regions. No differences in the overall density of orexin neurons or Fos activation were seen between extinction phenotypes. Although correlative, our results support other studies implicating a role of the orexinergic system in regulating extinction of conditioned responses to threat.

Intranasal Dopamine Reduces In Vivo [(123)I]FP-CIT Binding to Striatal Dopamine Transporter: Correlation with Behavioral Changes and Evidence for Pavlovian Conditioned Dopamine Response.

Purpose: Dopamine (DA), which does not cross the blood-brain barrier, has central and behavioral effects when administered via the nasal route. Neither the mechanisms of central action of intranasal dopamine (IN-DA), nor its mechanisms of diffusion and transport into the brain are well understood. We here examined whether IN-DA application influences dopamine transporter (DAT) binding in the dorsal striatum and assessed the extent of binding in relation to motor and exploratory behaviors. We hypothesized that, based on the finding of increased extracellular DA in the striatum induced by application of IN-DA, binding of [123I]FP-CIT to the DAT should be decreased due to competition at the receptor.Methods: Rats were administered 3 mg/kg IN-DA and vehicle (VEH), with IN-DA injection either preceding or following VEH. Then motor and exploratory behaviors (traveled distance, velocity, center time, sitting, rearing, head-shoulder motility, grooming) were assessed for 30 min in an open field prior to administration of [123I]FP-CIT. DAT binding after IN-DA and VEH was measured with small animal SPECT 2 h following administration of the radioligand.Results: (1) After IN-DA application, striatal DAT binding was significantly lower as compared to VEH, indicating that the nasally delivered DA had central action and increased DA levels comparable to that found previously with L-DOPA administration; and (2) DAT binding in response to intranasal VEH was lower when IN-DA application preceded VEH treatment. This finding is suggestive of Pavlovian conditioning of DA at the level of the DAT, since the DA treatment modified (decreased) the binding in response to the subsequent VEH treatment. VEH treatment also reduced motor and exploratory behaviors more when applied before, as compared to when it followed IN-DA application, also indicative of behavioral Pavlovian conditioning akin to that found upon application of various psychostimulant drugs.Conclusions: The results: (a) demonstrate a direct central action of intranasally applied DA on the DAT in the dorsal striatum, indicating enhanced DA availability; and (b) provide first evidence of a Pavlovian conditioned DA response at the DAT. The latter results have relevance to understanding neurochemical mechanisms that underlie placebo action in the treatment of Parkinsonian patients.

Examining the role of dopamine D2 and D3 receptors in Pavlovian conditioned approach behaviors

Elucidating the neurobiological mechanisms underlying individual differences in the extent to which reward cues acquire the ability to act as incentive stimuli may contribute to the development of successful treatments for addiction and related disorders. We used the sign-tracker/goal-tracker animal model to examine the role of dopamine D2 and D3 receptors in the propensity to attribute incentive salience to reward cues. Following Pavlovian training, wherein a discrete lever-cue was paired with food reward, rats were classified as sign- or goal-trackers based on the resultant conditioned response. We examined the effects of D2/D3 agonists, 7-OH-DPAT (0.01–0.32mg/kg) or pramipexole (0.032–0.32mg/kg), the D2/D3 antagonist raclopride (0.1mg/kg), and the selective D3 antagonist, SB-277011A (6 or 24mg/kg), on the expression of sign- and goal-tracking conditioned responses. The lever-cue acquired predictive value and elicited a conditioned response for sign- and goal-trackers, but only for sign-trackers did it also acquire incentive value. Following administration of either 7-OH-DPAT, pramipexole, or raclopride, the performance of the previously acquired conditioned response was attenuated for both sign- and goal-trackers. For sign-trackers, the D2/D3 agonist, 7-OH-DPAT, also attenuated the conditioned reinforcing properties of the lever-cue. The selective D3 antagonist did not affect either conditioned response. Alterations in D2/D3 receptor signaling, but not D3 signaling alone, transiently attenuate a previously acquired Pavlovian conditioned response, regardless of whether the response is a result of incentive motivational processes. These findings suggest activity at the dopamine D2 receptor is critical for a reward cue to maintain either its incentive or predictive qualities.

MAM (E17) rodent developmental model of neuropsychiatric disease: disruptions in learning and dysregulation of nucleus accumbens dopamine release, but spared executive function.

Gestational day 17 methylazoxymethanol (MAM) treatment has been shown to reproduce, in rodents, some of the alterations in cortical and mesolimbic circuitries thought to contribute to schizophrenia. We characterized the behavior of MAM animals in tasks dependent on these circuitries to see what behavioral aspects of schizophrenia the model captures. We then characterized the integrity of mesolimbic dopamine neurotransmission in a subset of animals used in the behavioral experiments. MAM animals' capacity for working memory, attention, and resilience to distraction was tested with two different paradigms. Cue-reward learning and motivation were assayed with Pavlovian conditioned approach. Measurements of electrically stimulated phasic and tonic DA release in the nucleus accumbens with fast-scan cyclic voltammetry were obtained from the same animals used in the Pavlovian task. MAM animals' basic attentional capacities were intact. MAM animals took longer to acquire the working memory task, but once learned, performed at the same level as shams. MAM animals were also slower to develop a Pavlovian conditioned response, but otherwise no different from controls. These same animals showed alterations in terminal DA release that were unmasked by an amphetamine challenge. The predominant behavioral-cognitive feature of the MAM model is a learning impairment that is evident in acquisition of executive function tasks as well as basic Pavlovian associations. MAM animals also have dysregulated terminal DA release, and this may contribute to observed behavioral differences. The MAM model captures some functional impairments of schizophrenia, particularly those related to acquisition of goal-directed behavior.

Compromised NMDA/Glutamate Receptor Expression in Dopaminergic Neurons Impairs Instrumental Learning, But Not Pavlovian Goal Tracking or Sign Tracking

Two theories regarding the role for dopamine neurons in learning include the concepts that their activity serves as a (1) mechanism that confers incentive salience onto rewards and associated cues and/or (2) contingency teaching signal reflecting reward prediction error. While both theories are provocative, the causal role for dopamine cell activity in either mechanism remains controversial. In this study mice that either fully or partially lacked NMDARs in dopamine neurons exclusively, as well as appropriate controls, were evaluated for reward-related learning; this experimental design allowed for a test of the premise that NMDA/glutamate receptor (NMDAR)-mediated mechanisms in dopamine neurons, including NMDA-dependent regulation of phasic discharge activity of these cells, modulate either the instrumental learning processes or the likelihood of pavlovian cues to become highly motivating incentive stimuli that directly attract behavior. Loss of NMDARs in dopamine neurons did not significantly affect baseline dopamine utilization in the striatum, novelty evoked locomotor behavior, or consumption of a freely available, palatable food solution. On the other hand, animals lacking NMDARs in dopamine cells exhibited a selective reduction in reinforced lever responses that emerged over the course of instrumental learning. Loss of receptor expression did not, however, influence the likelihood of an animal acquiring a pavlovian conditional response associated with attribution of incentive salience to reward-paired cues (sign tracking). These data support the view that reductions in NMDAR signaling in dopamine neurons affect instrumental reward-related learning but do not lend support to hypotheses that suggest that the behavioral significance of this signaling includes incentive salience attribution.

A Procedure to Observe Context-induced Renewal of Pavlovian-conditioned Alcohol-seeking Behavior in Rats

Environmental contexts in which drugs of abuse are consumed can trigger craving, a subjective Pavlovian-conditioned response that can facilitate drug-seeking behavior and prompt relapse in abstinent drug users. We have developed a procedure to study the behavioral and neural processes that mediate the impact of context on alcohol-seeking behavior in rats. Following acclimation to the taste and pharmacological effects of 15% ethanol in the home cage, male Long-Evans rats receive Pavlovian discrimination training (PDT) in conditioning chambers. In each daily (Mon-Fri) PDT session, 16 trials each of two different 10 sec auditory conditioned stimuli occur. During one stimulus, the CS+, 0.2 ml of 15% ethanol is delivered into a fluid port for oral consumption. The second stimulus, the CS-, is not paired with ethanol. Across sessions, entries into the fluid port during the CS+ increase, whereas entries during the CS- stabilize at a lower level, indicating that a predictive association between the CS+ and ethanol is acquired. During PDT each chamber is equipped with a specific configuration of visual, olfactory and tactile contextual stimuli. Following PDT, extinction training is conducted in the same chamber that is now equipped with a different configuration of contextual stimuli. The CS+ and CS- are presented as before, but ethanol is withheld, which causes a gradual decline in port entries during the CS+. At test, rats are placed back into the PDT context and presented with the CS+ and CS- as before, but without ethanol. This manipulation triggers a robust and selective increase in the number of port entries made during the alcohol predictive CS+, with no change in responding during the CS-. This effect, referred to as context-induced renewal, illustrates the powerful capacity of contexts associated with alcohol consumption to stimulate alcohol-seeking behavior in response to Pavlovian alcohol cues.