Pavlovian Conditioned Approach Procedure Research Articles

Nicotinic and muscarinic acetylcholine receptor antagonism dose-dependently decreases sign- but not goal-tracking behavior in male rats.

Acetylcholinergic antagonists have shown some promise in reducing addiction-related behaviors in both preclinical and clinical studies. However, the psychological mechanisms by which these drugs are able to affect addictive behavior remain unclear. A particular key process for the development of addiction is the attribution of incentive salience to reward-related cues, which can be specifically measured in animals using a Pavlovian conditioned approach procedure. When confronted with a lever that predicts food delivery, some rats engage with the lever directly (i.e., they sign track), indicating attribution of incentive-motivational properties to the lever itself. In contrast, others treat the lever as a predictive cue and approach the location of impending food delivery (i.e., they goal track), without treating the lever itself as a reward. We tested whether systemic antagonism of the either nicotinic or muscarinic acetylcholine receptors would selectively affect sign- or goal-tracking behavior, indicating a selective effect on incentive salience attribution. A total of 98 male Sprague Dawley rats were either given the muscarinic antagonist scopolamine (100, 50, or 10µg/kg i.p.) or the nicotinic antagonist mecamylamine (0.3, 1.0, or 3mg/kg i.p.) before being trained on a Pavlovian conditioned approach procedure. Scopolamine dose-dependently decreased sign tracking behavior and increased goal-tracking behavior. Mecamylamine reduced sign-tracking but did not affect goal-tracking behavior. Antagonism of either muscarinic or nicotinic acetylcholine receptors can reduce incentive sign-tracking behavior in male rats. This effect appears to be specifically due to a reduction in incentive salience attribution since goal-tracking either increased or was not affected by these manipulations.

Sign-tracking behavior is difficult to extinguish and resistant to multiple cognitive enhancers.

The attribution of incentive-motivational value to drug-related cues underlies relapse and craving in drug addiction. One method of addiction treatment, cue-exposure therapy, utilizes repeated presentations of drug-related cues in the absence of drug (i.e., extinction learning); however, its efficacy has been limited due to an incomplete understanding of extinction and relapse processes after cues have been imbued with incentive-motivational value. To investigate this, we used a Pavlovian conditioned approach procedure to screen for rats that attribute incentive-motivational value to reward-related cues (sign-trackers; STs) or those that do not (goal-trackers; GTs). In Experiment 1, rats underwent Pavlovian extinction followed by reinstatement and spontaneous recovery tests. For comparison, a separate group of rats underwent PCA training followed by operant conditioning, extinction, and tests of reinstatement and spontaneous recovery. In Experiment 2, three cognitive enhancers (sodium butyrate, D-cycloserine, and fibroblast growth factor 2) were administered following extinction training to facilitate extinction learning. STs but not GTs displayed enduring resistance to Pavlovian, but not operant, extinction and were more susceptible to spontaneous recovery. In addition, none of the cognitive enhancers tested affected extinction learning. These results expand our understanding of extinction learning by demonstrating that there is individual variation in extinction and relapse processes and highlight potential difficulties in applying extinction-based therapies to drug addiction treatment in the clinic.

Single prolonged stress decreases sign-tracking and cue-induced reinstatement of cocaine-seeking

Exposure to prolonged, uncontrollable stress reduces reward-seeking behavior, resulting in anhedonia in neuropsychiatric disorders, such as posttraumatic stress disorder. However, it is unclear to what degree stressed subjects lose interest in rewards themselves or in reward-related cues that instigate reward-seeking behavior. In the present study, we investigated the effects of single prolonged stress (SPS) on cue-directed behavior in two different procedures: Pavlovian conditioned approach (PCA) and cue-induced reinstatement of cocaine-seeking. In Experiment 1, rats were exposed to SPS and tested for the acquisition of sign-tracking (cue-directed) and goal-tracking (reward-directed) behaviors during a PCA procedure. In Experiment 2, rats were exposed to SPS and tested for the expression of sign- and goal-tracking as well as cue-induced reinstatement of cocaine-seeking. Because dopaminergic activity in the nucleus accumbens is known to play a central role in many cue-directed behaviors, including both sign-tracking and cue-induced reinstatement, Experiment 3 used in vivo microdialysis to measure the effect of SPS on baseline and evoked dopamine levels in the nucleus accumbens. SPS decreased sign-tracking and increased goal-tracking during the acquisition of PCA behavior without affecting reward consumption. In addition, SPS decreased cue-induced reinstatement without affecting cocaine self-administration. Finally, SPS decreased evoked but not baseline levels of dopamine in the nucleus accumbens. These results suggest that SPS decreases the motivational, but not consummatory, aspects of reward-seeking behavior, which may result from long-term, SPS-induced reductions in dopamine release in the nucleus accumbens.

The role of glutamate signaling in incentive salience: second-by-second glutamate recordings in awake Sprague-Dawley rats.

The attribution of incentive salience to reward-predictive stimuli has been shown to be associated with substance abuse-like behavior such as increased drug taking. Evidence suggests that glutamate neurotransmission and sequential N-methyl-D-aspartate (NMDA) activation are involved in the attribution of incentive salience. Here, we further explore the role of second-by-second glutamate neurotransmission in the attribution of incentive salience to reward-predictive stimuli by measuring sign-tracking behavior during a Pavlovian conditioned approach procedure using ceramic-based microelectrode arrays configured for sensitive measures of extracellular glutamate in awake behaving Sprague-Dawley rats. Specifically, we show that there is an increase in extracellular glutamate levels in the prelimbic cortex (PrL) and the nucleus accumbens core (NAcC) during sign-tracking behavior to a food-predictive conditioned stimulus (CS+) compared to the presentation of a non-predictive conditioned stimulus (CS-). Furthermore, the results indicate greater increases in extracellular glutamate levels in the PrL compared to NAcC in response to the CS+, including differences in glutamate release and signal decay. Taken together, the present research suggests that there is differential glutamate signaling in the NAcC and PrL during sign-tracking behavior to a food-predictive CS+.

Individual differences in incentive salience attribution are not related to suboptimal choice in rats

Previous research has shown great variation in the extent to which individual rats attribute incentive salience to stimuli that are predictors of reinforcement. When using the Pavlovian Conditioned Approach procedure, in which a discrete stimulus is presented contingently before the delivery of reinforcement, the attribution of incentive salience is demonstrated by sign-tracking behavior (responses directed toward the stimulus predictor of reinforcement), while an absence of this attribution is reflected by goal-tracking behavior (responses directed toward the source of reinforcement). It has been reported that sign-tracking subjects have a higher tendency to perform some maladaptive behaviors than goal-tracking subjects, and that in non-classified rats, increasing the incentive salience of the stimuli promotes suboptimal choice in the “suboptimal choice procedure”. In this task, subjects are presented with two alternatives, one of them better in terms of the information provided by the discriminative stimuli, but worse in terms of probability of reinforcement (suboptimal alternative). Integrating these ideas, we hypothesized that sign-trackers would behave suboptimally, in contrast to goal-trackers. In the present study, 45 rats were classified according to their performance in the Pavlovian Conditioned Approach procedure and subjects with extreme values (sign-trackers, and goal-trackers) were evaluated in the suboptimal choice procedure. Both groups were found to behave optimally, with no differences between them. The difference between groups in capacity of attribution of incentive salience was preserved during the entire experiment, suggesting that this variable is not related to choice performance in the suboptimal choice procedure.

NMDA receptor blockade specifically impedes the acquisition of incentive salience attribution

Glutamatergic signaling plays an important role in learning and memory. Using Pavlovian conditioned approach procedures, the mechanisms that drive stimulus-reward learning and memory have been investigated. However, there are instances where reward-predictive stimuli can function beyond being solely predictive and can be attributed with “motivational value” or incentive salience. Using a Pavlovian conditioned approach procedure consisting of two different but equally predictive stimuli (lever vs. tone) we investigated the role NMDA receptor function has in the attribution of incentive salience. The results revealed that the administration of MK-801, an NMDA receptor antagonist, during acquisition of Pavlovian conditioned approach promoted goal-tracking to a lever stimulus, while control animals learned to sign-track. Moreover, within the same animals, the use of a tone stimulus elicited goal-tracking responses that were unaffected by MK-801 pretreatments. Furthermore, a lever CS that elicited sign-tracking served as a more robust conditioned reinforcer than a tone CS that elicited goal-tracking or a lever CS that elicited goal-tracking via MK-801 pretreatments. Collectively, these results demonstrate that NMDA receptor antagonism can alter the stimulus-reward relationship learned and prevent the attribution of incentive salience, rather than impede general learning.

Thalamic mast cell activity is associated with sign-tracking behavior in rats

Mast cells are resident immune cells in the thalamus that can degranulate and release hundreds of signaling molecules (i.e., monoamines, growth factors, and cytokines) both basally and in response to environmental stimuli. Interestingly, mast cell numbers in the brain show immense individual variation in both rodents and humans. We used a Pavlovian conditioned approach (PCA) procedure to examine whether mast cells are associated with individual variation in the attribution of incentive-motivational value to reward-related cues. During the PCA procedure, a lever response-independently predicts the delivery of a food pellet into a magazine, and over training sessions three conditioned responses (CRs) develop: sign-tracking (lever-directed CRs), goal-tracking (magazine-directed CRs), and an intermediate response (both CRs). In Experiment 1, we measured thalamic mast cell number/activation using toluidine blue and demonstrated that sign-trackers have increased degranulated (activated) but not granulated (inactive) mast cells. In Experiment 2, we infused the mast cell inhibitor, cromolyn (200µg/rat; i.c.v.), immediately before five daily PCA training sessions and demonstrated that mast cell inhibition selectively impairs the acquisition of sign-tracking behavior. Taken together, these results demonstrate that thalamic mast cells contribute to the attribution of incentive-motivational value to reward-related cues and suggest that mast cell inhibition may be a novel target for addiction treatment.

Subanesthetic ketamine decreases the incentive-motivational value of reward-related cues.

The attribution of incentive-motivational value to reward-related cues contributes to cue-induced craving and relapse in addicted patients. Recently, it was demonstrated that subanesthetic ketamine increases motivation to quit and decreases cue-induced craving in cocaine-dependent individuals. Although the underlying mechanism of this effect is currently unknown, one possibility is that subanesthetic ketamine decreases the incentive-motivational value of reward-related cues. In the present study, we used a Pavlovian conditioned approach procedure to identify sign-trackers, rats that attribute incentive-motivational value to reward-related cues, and goal-trackers, rats that assign only predictive value to reward-related cues. This model is of interest because sign-trackers are more vulnerable to cue-induced reinstatement of drug-seeking behavior and will persist in this drug-seeking behavior despite adverse consequences. We tested the effect of subanesthetic ketamine on the expression of Pavlovian conditioned approach behavior and the conditioned reinforcing properties of a reward-related cue in sign- and goal-trackers. We found that subanesthetic ketamine decreased sign-tracking and increased goal-tracking behavior in sign-trackers, though it had no effect on conditioned reinforcement. These results suggest that subanesthetic ketamine may be a promising pharmacotherapy for addiction that acts by decreasing the incentive-motivational value of reward-related cues.

Toward isolating the role of dopamine in the acquisition of incentive salience attribution

Stimulus-reward learning has been heavily linked to the reward-prediction error learning hypothesis and dopaminergic function. However, some evidence suggests dopaminergic function may not strictly underlie reward-prediction error learning, but may be specific to incentive salience attribution. Utilizing a Pavlovian conditioned approach procedure consisting of two stimuli that were equally reward-predictive (both undergoing reward-prediction error learning) but functionally distinct in regard to incentive salience (levers that elicited sign-tracking and tones that elicited goal-tracking), we tested the differential role of D1 and D2 dopamine receptors and nucleus accumbens dopamine in the acquisition of sign- and goal-tracking behavior and their associated conditioned reinforcing value within individuals. Overall, the results revealed that both D1 and D2 inhibition disrupted performance of sign- and goal-tracking. However, D1 inhibition specifically prevented the acquisition of sign-tracking to a lever, instead promoting goal-tracking and decreasing its conditioned reinforcing value, while neither D1 nor D2 signaling was required for goal-tracking in response to a tone. Likewise, nucleus accumbens dopaminergic lesions disrupted acquisition of sign-tracking to a lever, while leaving goal-tracking in response to a tone unaffected. Collectively, these results are the first evidence of an intraindividual dissociation of dopaminergic function in incentive salience attribution from reward-prediction error learning, indicating that incentive salience, reward-prediction error, and their associated dopaminergic signaling exist within individuals and are stimulus-specific. Thus, individual differences in incentive salience attribution may be reflective of a differential balance in dopaminergic function that may bias toward the attribution of incentive salience, relative to reward-prediction error learning only.

Individual variation in the motivational properties of a nicotine cue: sign-trackers vs. goal-trackers.

Individuals vary in the extent to which they attribute incentive salience to reward cues. Discrete food and drug (cocaine and opioid) cues become more attractive, eliciting approach toward them, and more "wanted," in that they serve as more effective conditioned reinforcers, in some rats (sign-trackers, STs), than in others (goal-trackers, GTs). We asked whether there is similar variation in the extent to which a cue associated with a drug from another class, nicotine, acquires incentive motivational properties. First, a Pavlovian conditioned approach procedure was used to identify rats that attribute incentive salience to a food cue (i.e., STs and GTs). We then measured the extent to which a cue (a light) paired with intravenous nicotine injections acquired two properties of an incentive stimulus: (1) the ability to elicit approach toward it, and (2) the ability to act as a conditioned reinforcer. In contrast to previous findings with food, cocaine, and opioid cues, we found that the nicotine cue was equally attractive in STs and GTs, eliciting dose-dependent approach behavior in both. However, the nicotine cue was a more effective conditioned reinforcer in STs than in GTs. We suggest the dissociation between these two measures of incentive salience attribution may be related to the fact that when present (as in the test of Pavlovian approach), nicotine can act as a potent "incentive amplifier," and by this action, nicotine may render cues especially salient for all animals.

Adolescent Alcohol Exposure Amplifies the Incentive Value of Reward-Predictive Cues Through Potentiation of Phasic Dopamine Signaling.

Adolescent alcohol use remains a major public health concern due in part to well-established findings implicating the age of onset in alcohol use in the development of alcohol use disorders and persistent decision-making deficits in adults. We have previously demonstrated that moderate adolescent alcohol consumption in rats promotes suboptimal decision making and an associated perturbation in mesolimbic dopamine transmission in adulthood. Dopamine-dependent incentive learning processes are an integral component of value-based decision making and a fundamental element to many theoretical accounts of addiction. Thus we tested the hypothesis that adolescent alcohol use selectively alters incentive learning processes through perturbation of mesolimbic dopamine systems. To assess incentive learning, behavioral and neurochemical measurements were made during the acquisition, maintenance, extinction, and reacquisition of a Pavlovian conditioned approach procedure in adult rats with a history of adolescent alcohol consumption. We show that moderate adolescent alcohol consumption potentiates stimulus-evoked phasic dopamine transmission, measured in vivo by fast-scan cyclic voltammetry, in adulthood and biases individuals toward a dopamine-dependent incentive learning strategy. Moreover, we demonstrate that animals exposed to alcohol in adolescence are more sensitive to an unexpected variation in reward outcomes. This pattern of phasic dopamine signaling and the associated bias in learning may provide a mechanism for the well-documented vulnerability of individuals with early-life alcohol use for alcohol use disorders in adulthood.

Environmental manipulations alter age differences in attribution of incentive salience to reward-paired cues

Cues repeatedly paired with rewards often themselves become imbued with enhanced motivational value, or incentive salience. During Pavlovian conditioned approach procedures, a cue repeatedly preceding reward delivery often elicits conditioned responses at either the reward delivery location (“goal-tracking”) or the cue itself (“sign-tracking”). Sign-tracking behavior is thought to reflect the individual differences in attribution of incentive salience to reward-paired cues that may contribute to addiction vulnerability. Adolescent rats typically demonstrate less sign-tracking behavior than adult rats, a surprising finding given that adolescence is hypothesized to be a time of heightened addiction vulnerability. Given evidence that adult sign-tracking behavior can be influenced by environmental conditions, the present study compared the effects of isolate housing and food deprivation on expression of sign-tacking and goal-tracking behavior in adolescent and adult male rats across eight days of a Pavlovian conditioned approach procedure. Pair-housed adults exhibited more sign-tracking behavior than pair-housed adolescents; however, this age difference was not apparent in isolate-housed subjects. Adolescents often appeared more sensitive than adults to both food restriction- and isolate housing-induced changes in behavior, with food restriction promoting an increase in sign-tracking among isolate-housed adolescents and an increase in goal-tracking among pair-housed adolescents. For adults, food restriction resulted in a modest increase in overall expression of both sign- and goal-tracking behavior. To the extent that sign-tracking behavior reflects attribution of incentive salience to reward-paired cues, results from the present study provide evidence that reactivity to rewards during adolescence is strongly related to the nature of the surrounding environment.

Appetitive Pavlovian goal-tracking memories reconsolidate only under specific conditions

Despite extensive evidence that appetitive memories undergo reconsolidation, two notable failures to observe reconsolidation have been reported: instrumental responding and goal-tracking. However, these studies do not provide conclusive evidence for a lack of memory reconsolidation due to the numerous boundary conditions that dictate whether a memory will undergo reconsolidation. In this study we sought to reexamine reconsolidation in an appetitive, Pavlovian conditioned approach procedure and the behavioral boundary conditions within which memories are destabilized and reconsolidated. This study demonstrated that a Pavlovian goal-tracking memory, previously thought to be resistant to destabilization, will undergo memory reconsolidation under discrete conditions that favor reconsolidation as opposed to extinction, and that this is dependent on the amount of training rats received. With restricted training, systemic administration of MK-801 impaired memory extinction. In contrast, with more extended training, MK-801 administration impaired memory reconsolidation. We also demonstrate that behavioral boundary conditions that exist for appetitive memory reconsolidation are much more complex than simple parametric calculations. Moreover, extinction per se is not a boundary on reconsolidation, in that MK-801 also has no behavioral effect under some conditions.

A classically conditioned cocaine cue acquires greater control over motivated behavior in rats prone to attribute incentive salience to a food cue

Cues associated with rewards bias attention towards them and can motivate drug-seeking and drug-taking behavior. There is, however, considerable individual variation in the extent to which cues associated with rewards acquire motivational properties. For example, only in some rats does a localizable food cue become attractive, eliciting approach towards it, and "wanted", in the sense that it serves as an effective conditioned reinforcer. We asked whether the propensity of animals to attribute incentive salience to a food cue predicts the extent to which a classically conditioned cocaine cue acquires incentive motivational properties. First, a Pavlovian conditioned approach procedure was used to identify rats prone to attribute incentive salience to a food cue. We then measured the extent to which a classically conditioned cocaine cue acquired two properties of an incentive stimulus: (1) the ability to elicit approach towards it, and (2) the ability to reinstate drug-seeking behavior, using an extinction-reinstatement procedure (i.e., to act as a conditioned reinforcer). We found that a classically conditioned cocaine cue became more attractive, in that it elicited greater approach toward it, and more desired, in that it supported more drug-seeking behavior under extinction conditions, in individuals prone to attribute incentive salience to a food cue. We conclude that rats vary in their propensity to attribute incentive salience to both food and cocaine cues, and it is possible to predict, prior to any drug experience, in which rats a cocaine cue will acquire the strongest motivational control over behavior.

Individual variation in the propensity to attribute incentive salience to an appetitive cue predicts the propensity to attribute motivational salience to an aversive cue

It has been proposed that animals that attribute high levels of incentive salience to reward-related cues may be especially vulnerable to addiction. Individual variation has also been observed in the motivational value attributed to aversive cues, which may confer vulnerability to anxiety disorders such as post-traumatic stress disorder (PTSD). There may be a core behavioral trait that contributes to individual variation in the motivational value assigned to predictive cues regardless of emotional valence. To test this hypothesis, we used a Pavlovian conditioned approach procedure to classify rats based on whether they learned to approach and interact with a cue predicting food reward (sign-trackers) or learned upon cue presentation to go to the location of impending food delivery (goal-trackers), and then examined Pavlovian fear conditioning in the same animals. It has recently been proposed that sign-trackers are more vulnerable to substance abuse because they attribute greater incentive motivational value to drug cues. Here we show that sign-trackers also have a tendency to be more fearful of discrete cues that predict footshock. In addition, we found that goal-trackers exhibited greater contextual fear when placed back into the original fear-conditioning context in the absence of temporally discrete cues. These results suggest that there may be a subset of individuals who tend to attribute high levels of motivational salience to predictive cues regardless of emotional valence, which may predispose them to a number of psychiatric comorbidities including PTSD and substance abuse. Other individuals use contexts to appropriately modify their reactions to such salient stimuli.

A Cocaine Cue Acts as an Incentive Stimulus in Some but not Others: Implications for Addiction

In addicts drug cues attract attention, elicit approach, and motivate drug-seeking and drug-taking behavior, and addicts find it difficult to resist such cues. In preclinical studies we have found, however, that food cues acquire incentive motivational properties only in a subset of individuals. For example, a food cue becomes attractive, eliciting approach and engagement with it, and acts as an effective conditional reinforcer in some rats but not others. We asked, therefore, whether rats that have a propensity to attribute incentive salience to a food cue are the same ones that attribute incentive value to a drug (cocaine) cue. We first used a Pavlovian conditioned approach procedure to determine which individual rats attributed incentive salience to a food cue. A second cue was then associated with the IV self-administration of cocaine. Later, the ability of the cocaine cue to maintain self-administration behavior and to reinstate self-administration after extinction was assessed. We report that in individuals that had a propensity to attribute incentive salience to a food cue, a cocaine cue spurred motivation to take drugs (its removal greatly diminished self-administration) and reinstated robust drug-seeking after extinction. However, in those individuals that failed to attribute incentive salience to a food cue, the cocaine cue was relatively devoid of incentive motivational properties. We conclude that it is possible to determine, before any drug experience, which individuals will most likely have difficulty resisting drug cues, a trait that might confer susceptibility to addiction.