Pavlovian-instrumental Transfer Task Research Articles

Flexible control of Pavlovian-instrumental transfer based on expected reward value.

The Pavlovian-instrumental transfer (PIT) paradigm is widely used to assay the motivational influence of reward-predictive cues, reflected by their ability to invigorate instrumental behavior. Leading theories assume that a cue's motivational properties are tied to predicted reward value. We outline an alternative view that recognizes that reward-predictive cues may suppress rather than motivate instrumental behavior under certain conditions, an effect termed positive conditioned suppression. We posit that cues signaling imminent reward delivery tend to inhibit instrumental behavior, which is exploratory by nature, in order to facilitate efficient retrieval of the expected reward. According to this view, the motivation to engage in instrumental behavior during a cue should be inversely related to the value of the predicted reward, since there is more to lose by failing to secure a high-value reward than a low-value reward. We tested this hypothesis in rats using a PIT protocol known to induce positive conditioned suppression. In Experiment 1, cues signaling different reward magnitudes elicited distinct response patterns. Whereas the one-pellet cue increased instrumental behavior, cues signaling three or nine pellets suppressed instrumental behavior and elicited high levels of food-port activity. Experiment 2 found that reward-predictive cues suppressed instrumental behavior and increased food-port activity in a flexible manner that was disrupted by post-training reward devaluation. Further analyses suggest that these findings were not driven by overt competition between the instrumental and food-port responses. We discuss how the PIT task may provide a useful tool for studying cognitive control over cue-motivated behavior in rodents. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Neural correlates of instrumental responding in the context of alcohol-related cues index disorder severity and relapse risk.

The influence of Pavlovian conditioned stimuli on ongoing behavior may contribute to explaining how alcohol cues stimulate drug seeking and intake. Using a Pavlovian-instrumental transfer task, we investigated the effects of alcohol-related cues on approach behavior (i.e., instrumental response behavior) and its neural correlates, and related both to the relapse after detoxification in alcohol-dependent patients. Thirty-one recently detoxified alcohol-dependent patients and 24 healthy controls underwent instrumental training, where approach or non-approach towards initially neutral stimuli was reinforced by monetary incentives. Approach behavior was tested during extinction with either alcohol-related or neutral stimuli (as Pavlovian cues) presented in the background during functional magnetic resonance imaging (fMRI). Patients were subsequently followed up for 6months. We observed that alcohol-related background stimuli inhibited the approach behavior in detoxified alcohol-dependent patients (t=-3.86, p < .001), but not in healthy controls (t=-0.92, p = .36). This behavioral inhibition was associated with neural activation in the nucleus accumbens (NAcc) (t(30) = 2.06, p < .05). Interestingly, both the effects were only present in subsequent abstainers, but not relapsers and in those with mild but not severe dependence. Our data show that alcohol-related cues can acquire inhibitory behavioral features typical of aversive stimuli despite being accompanied by a stronger NAcc activation, suggesting salience attribution. The fact that these findings are restricted to abstinence and milder illness suggests that they may be potential resilience factors.Clinical trial: LeAD study, http://www.lead-studie.de , NCT01679145.

Failing to pay heed to health warnings in a food-associated environment

People often fail to adhere to food-related health information. Increasing evidence suggests that environmental stimuli interfere with good intentions by triggering choices relatively automatically. Using a Pavlovian-instrumental transfer (PIT) task, we examined whether food-associated stimuli reduce health warnings’ effectiveness. We expected that people adhere to health warnings in the absence, but not presence, of food-associated stimuli. In addition, we examined timing effects, i.e., whether health warnings are more effective when they are given prior to associative learning rather than afterwards. In the PIT task, participants learned to press keys for two food rewards (instrumental learning) and associations between stimuli and these rewards (Pavlovian learning) in separated phases. Health warnings about one reward were given after associative learning (Study 1), or before versus afterwards (Study 2). During test phase, participants pressed for food outcomes while occasionally food-related stimuli were presented. In absence of food-related stimuli, participants increased responding for rewards perceived as more healthy. However, when stimuli were present, responding was biased towards the signaled outcome, regardless of health warnings or timing. Health messages influence food choice behavior, but are no longer effective when food-associated stimuli are present. This provides important insights why health warning effects might be limited in an obesogenic environment.

Dopamine D2/3- and μ-opioid receptor antagonists reduce cue-induced responding and reward impulsivity in humans.

Increased responding to drug-associated stimuli (cue reactivity) and an inability to tolerate delayed gratification (reward impulsivity) have been implicated in the development and maintenance of drug addiction. Whereas data from animal studies suggest that both the dopamine and opioid system are involved in these two reward-related processes, their role in humans is less clear. Moreover, dopaminergic and opioidergic drugs have not been directly compared with regard to these functions, even though a deeper understanding of the underlying mechanisms might inform the development of specific treatments for elevated cue reactivity and reward impulsivity. In a randomized, double-blind, between-subject design we administered the selective dopamine D2/D3 receptor antagonist amisulpride (400 mg, n=41), the unspecific opioid receptor antagonist naltrexone (50 mg, n=40) or placebo (n=40) to healthy humans and measured cue-induced responding with a Pavlovian-instrumental transfer task and reward impulsivity with a delay discounting task. Mood was assessed using a visual analogue scale. Compared with placebo, amisulpride significantly suppressed cue-induced responding and reward impulsivity. The effects of naltrexone were similar, although less pronounced. Both amisulpride and naltrexone decreased average mood ratings compared with placebo. Our results demonstrate that a selective blockade of dopamine D2/D3 receptors reduces cue-induced responding and reward impulsivity in healthy humans. Antagonizing μ-opioid receptors has similar effects for cue-induced responding and to a lesser extent for reward impulsivity.

The specificity of Pavlovian regulation is associated with recovery from depression.

Changes in reflexive emotional responses are hallmarks of depression, but how emotional reflexes make an impact on adaptive decision-making in depression has not been examined formally. Using a Pavlovian-instrumental transfer (PIT) task, we compared the influence of affectively valenced stimuli on decision-making in depression and generalized anxiety disorder compared with healthy controls; and related this to the longitudinal course of the illness. A total of 40 subjects with a current DSM-IV-TR diagnosis of major depressive disorder, dysthymia, generalized anxiety disorder, or a combination thereof, and 40 matched healthy controls performed a PIT task that assesses how instrumental approach and withdrawal behaviours are influenced by appetitive and aversive Pavlovian conditioned stimuli (CSs). Patients were followed up after 4-6 months. Analyses focused on patients with depression alone (n = 25). In healthy controls, Pavlovian CSs exerted action-specific effects, with appetitive CSs boosting active approach and aversive CSs active withdrawal. This action-specificity was absent in currently depressed subjects. Greater action-specificity in patients was associated with better recovery over the follow-up period. Depression is associated with an abnormal influence of emotional reactions on decision-making in a way that may predict recovery.

Commentary: Cafeteria diet impairs expression of sensory-specific satiety and stimulus-outcome learning.

Commentary: Cafeteria diet impairs expression of sensory-specific satiety and stimulus-outcome learning.

The effects of amphetamine sensitization on conditioned inhibition during a Pavlovian–instrumental transfer task in rats

Psychostimulant sensitization heightens behavioral and motivational responses to reward-associated stimuli; however, its effects on stimuli associated with reward absence are less understood. We examined whether amphetamine sensitization alters performance during Pavlovian-instrumental transfer (PIT) to conditioned excitors and inhibitors. We further sought to characterize the effects of amphetamine sensitization on learning versus performance by exposing rats to amphetamine prior to Pavlovian training or between training and test. Adult male Long-Evans rats were given conditioned inhibition (A+/AX-) and Pavlovian (B+) training, followed by variable-interval instrumental conditioning. Rats were sensitized to D-amphetamine (2mg/kg daily injections for 7days) or served as non-exposed controls. Rats were given a PIT test, in which they were presented with stimulus B alone or in compound with the conditioned inhibitor (BX). During the PIT test, control rats significantly reduced instrumental responding on BX trials (to approximately 50% of responding to B). Amphetamine sensitization prior to Pavlovian conditioning increased lever pressing on BX trials and reduced lever pressing on B trials compared to controls. Amphetamine sensitization between training and test increased lever pressing on B and BX trials compared to controls. No effects of sensitization were observed on conditioned food cup approach. Amphetamine sensitization increases instrumental responding during PIT to a conditioned inhibitor by enhancing the excitation of conditioned stimuli and reducing the inhibition of conditioned inhibitors.

A role for alpha‐amino‐3‐hydroxy‐5‐methylisoxazole‐4‐propionic acid GluR1 phosphorylation in the modulatory effects of appetitive reward cues on goal‐directed behavior

Alpha-amino-3-hydroxy-5-methylisoxazole-4-propionic acid (AMPA) receptor regulation has been shown to be critically involved in synaptic plasticity underlying learning and memory. This regulation occurs through trafficking of the receptor and modulation of the receptor's channel properties, both of which depend on protein phosphorylation. Using homologous recombination (knock-in) techniques we targeted two phosphorylation sites on the AMPA-GluR1 receptor: the Ser831 site, phosphorylated by calcium calmodulin-dependent protein kinase II/protein kinase C, and the Ser845 site, phosphorylated by protein kinase A. Mice with mutations that prevented phosphorylation at one or both of these sites were tested on a single-outcome Pavlovian-instrumental transfer task often used to assess the acquisition of incentive motivation by cues for food reinforcement. Mice were separately trained to associate a Pavlovian cue with food and to perform an instrumental lever-press response to earn that same reward. During a transfer test, the cue was presented while the mice were lever-pressing under extinction conditions. Whereas wild-type control mice showed substantial enhancement of lever-pressing when the cue was presented (i.e. showed Pavlovian-instrumental transfer), mice with mutations at both of these phosphorylation sites showed no evidence of such transfer. By contrast, mice with either serine site mutated alone showed normal transfer. These results suggest critical roles for GluR1 phosphorylation pathways in a form of incentive learning that can play an important part in regulating normal motivated behavior as well as maladaptive behaviors such as addiction and eating disorders.

Clozapine, SCH 23390 and α-flupenthixol but not haloperidol attenuate acute phencyclidine-induced disruption of conditional discrimination performance

Forebrain dopamine (DA) manipulation has recently been shown to selectively disrupt a conditional discrimination task whose design parameters approximate tasks repeatedly shown to be impaired in schizophrenia. To investigate the reversal potential of the D(1)/D(2) receptor antagonist alpha-flupenthixol, the selective D(1) antagonist SCH 23390, the typical antipsychotic haloperidol and the atypical antipsychotic clozapine on acute phencyclidine (PCP)-induced disruption of a conditional discrimination task dependent on the ability to use task-setting cues that inform goal-directed performance. Rats learned a conditional discrimination task where reinforcement was contingent on an appropriate lever press during a specific auditory stimulus. PCP disrupted task performance at 1.5 mg/kg, attenuated correct lever pressing at 2.5 mg/kg and abolished overall responding at 5 mg/kg (experiment 1). Pavlovian-instrumental transfer task results (experiment 2) showed that 1.5 and 2.5 mg/kg PCP had no disruptive effects on basic sensory, motor or motivational processes; however, such deficits were evident in 5-mg/kg-treated animals. PCP (1.5 mg/kg) disruption of conditional discrimination was attenuated by acute pretreatment with clozapine, SCH 23390 and alpha-flupenthixol; however, pretreatment with haloperidol did not attenuate task disruption. The predictive validity of the conditional discrimination model is enhanced as the selective task disruption by the preeminent psychotomimetic PCP is reversed by clozapine (known to ameliorate cognitive deficits in schizophrenia) and the role of DA D(1) receptors as mediators of tasks that require conditional relationships is discussed.

Targeted deletion of the GluR-1 AMPA receptor in mice dissociates general and outcome-specific influences of appetitive rewards on learning.

The authors assessed the hypothesis that deletion of the GluR-1 subtype of the alpha-amino-3-hydroxy-5-methyl-4-isoxazole propionate (AMPA) receptor in mice disrupts the associative activation of a sensory-specific representation of an appetitive reward. In Experiment 1, mice received training on a Pavlovian-instrumental transfer task. In the test stage, conditioned stimulus (CS) presentations enhanced instrumental actions in both groups. However, this effect was specific to the action that shared the same outcome as the CS in wild-type (WT), but not GluR-1-super(-/-), mice. In Experiment 2, the mice were trained on a heterogeneous instrumental chain in which rewards were obtained for emitting 1 response (R1, that was distal to reward delivery), followed by a 2nd response (R2, that was proximal to reward delivery). A change in general motivational state (from hungry to sated) reduced the number of R2 responses in both groups. In contrast, an outcome-specific satiety treatment produced a selective decline in R1 responding only in WT mice. The results support the hypothesis that GluR-1 deletion impairs the associative activation of a representation of the sensory-specific incentive motivational properties of an appetitive reward.