Outcome Devaluation Research Articles

Working for beverages without being thirsty: Human Pavlovian-instrumental transfer despite outcome devaluation

The incentive-motivational salience acquired by a Pavlovian conditioned stimulus (CS) is reflected by its ability to strengthen the performance of a separately learned instrumental action exerted to obtain an outcome, a phenomenon known as Pavlovian-Instrumental transfer (PIT). By means of a PIT paradigm, the present study addressed whether the CS motivational properties vary dynamically with the value of the associated outcome. Previous studies on human PIT and outcome devaluation have provided mixed results, showing that in some cases post-training devaluation leaves PIT unaffected when outcomes are palatable foods or drugs, and when the devalued outcome is not consumed immediately. In Experiment 1, thirsty participants first learned to squeeze a rubber bulb to accumulate a beverage (plain water or sugary drink); then participants learned Pavlovian associations between cues and the beverage. When tested in extinction, a PIT effect emerged as expected. In Experiment 2, the PIT effect emerged even despite participants quenched their thirst before the test phase. Our results suggest that the incentive properties of a CS can surprisingly and irrationally endure the devaluation of the associated outcome even when plain water is used as reward, and thirst is quenched by immediate reward consumption. This result may provide important insights in the understanding of the psychological mechanisms underlying different types of addiction.

Impaired cognitive plasticity and goal-directed control in adolescent obsessive-compulsive disorder.

Youths with obsessive-compulsive disorder (OCD) experience severe distress and impaired functioning at school and at home. Critical cognitive domains for daily functioning and academic success are learning, memory, cognitive flexibility and goal-directed behavioural control. Performance in these important domains among teenagers with OCD was therefore investigated in this study. A total of 36 youths with OCD and 36 healthy comparison subjects completed two memory tasks: Pattern Recognition Memory (PRM) and Paired Associates Learning (PAL); as well as the Intra-Extra Dimensional Set Shift (IED) task to quantitatively gauge learning as well as cognitive flexibility. A subset of 30 participants of each group also completed a Differential-Outcome Effect (DOE) task followed by a Slips-of-Action Task, designed to assess the balance of goal-directed and habitual behavioural control. Adolescent OCD patients showed a significant learning and memory impairment. Compared with healthy comparison subjects, they made more errors on PRM and PAL and in the first stages of IED involving discrimination and reversal learning. Patients were also slower to learn about contingencies in the DOE task and were less sensitive to outcome devaluation, suggesting an impairment in goal-directed control. This study advances the characterization of juvenile OCD. Patients demonstrated impairments in all learning and memory tasks. We also provide the first experimental evidence of impaired goal-directed control and lack of cognitive plasticity early in the development of OCD. The extent to which the impairments in these cognitive domains impact academic performance and symptom development warrants further investigation.

Model-based and model-free pain avoidance learning.

Background: While there is good evidence that reward learning is underpinned by two distinct decision control systems – a cognitive ‘model-based’ and a habitbased ‘model-free’ system, a comparable distinction for punishment avoidance has been much less clear. Methods: We implemented a pain avoidance task that placed differential emphasis on putative model-based and model-free processing, mirroring a paradigm and modelling approach recently developed for reward-based decision-making. Subjects performed a two-step decision-making task with probabilistic pain outcomes of different quantities. The delivery of outcomes was sometimes contingent on a rule signalled at the beginning of each trial, emulating a form of outcome devaluation. Results: The behavioural data showed that subjects tended to use a mixed strategy – favouring the simpler model-free learning strategy when outcomes did not depend on the rule, and favouring a model-based when they did. Furthermore, the data were well described by a dynamic transition model between the two controllers. When compared with data from a reward-based task (albeit tested in the context of the scanner), we observed that avoidance involved a significantly greater tendency for subjects to switch between model-free and model-based systems in the face of changes in uncertainty. Conclusion: Our study suggests a dual-system model of pain avoidance, similar to but possibly more dynamically flexible than reward-based decision-making.

Evidence of a goal-directed process in human Pavlovian-instrumental transfer.

Cues that signal rewards can motivate reward-seeking behaviors, even for outcomes that are not currently desired. Three experiments examined this phenomenon, using an outcome-selective Pavlovian-instrumental transfer (PIT) design and an outcome devaluation procedure. In Experiment 1, participants learned to perform one response to earn crisps points and another response to earn popcorn points. One outcome was then devalued by adulterating it to make it taste unpleasant. On test, overall response choice was biased toward the outcome that had not been devalued, indicating goal-directed control. Stimuli that signaled crisps and popcorn also biased instrumental response choice toward their respective outcomes (a PIT effect). Most importantly, the strength of this bias was not influenced by the devaluation manipulation. In contrast, Experiment 2 demonstrated that when stimuli signaled equal probability of the two outcomes, cue-elicited response choice was sensitive to the devaluation manipulation. Experiment 3 confirmed this conclusion by demonstrating a selective avoidance of the cued, devalued outcome. Together, these data support a goal-directed model of PIT in which expected outcome probability and value make independent contributions to response choice. (PsycINFO Database Record

Lever Insertion as a Salient Stimulus Promoting Insensitivity to Outcome Devaluation.

Flexible and efficient decision-making in complex environments can be achieved through constant interactions between the goal-directed and habitual systems. While goal-directed behavior is considered dependent upon Response-Outcome (R-O) associations, habits instead rely on Stimulus-Response (S-R) associations. However, the stimuli that support the S-R association underlying habitual responding in typical instrumental procedures are poorly defined. To resolve this issue, we designed a discrete-trials procedure, in which rats must wait for lever insertion and complete a sequence of five lever presses to obtain a reward (20% sucrose or grain-based pellets). Lever insertion thus constituted an audio-visual stimulus signaling the opportunity for reward. Using sensory-specific satiety-induced devaluation, we found that rats trained with grain-based pellets remained sensitive to outcome devaluation over the course of training with this procedure whereas rats trained with a solution of 20% sucrose rapidly developed habit, and that insensitivity to outcome devaluation in rats trained with sucrose did not result from a bias in general satiety. Importantly, although rats trained with pellets were sensitive to satiety-induced devaluation, their performance was not affected by degradation of instrumental contingency and devaluation by conditioned taste aversion (CTA), suggesting that these rats may also have developed habitual responding. To test whether the discrete-trials procedure biases subjects towards habitual responding, we compared discrete-trials to free-running instrumental responding, and found that rats trained with sucrose in a fixed-ratio 5 (FR5) procedure with continuous presentation of the lever were goal-directed. Together, these results demonstrate that discrete presentations of a stimulus predictive of reward availability promoted the formation of S-R habit in rats trained with liquid sucrose. Further research is necessary to explain inconsistencies in sensitivity to outcome devaluation when rats are trained with grain-based pellets.

Insular and Ventrolateral Orbitofrontal Cortices Differentially Contribute to Goal-Directed Behavior in Rodents.

The medial prefrontal cortex (mPFC) has long been considered a critical site in action control. However, recent evidence indicates that the contribution of cortical areas to goal-directed behavior likely extends beyond mPFC. Here, we examine the function of both insular (IC) and ventrolateral orbitofrontal (vlOFC) cortices in action-dependent learning. We used chemogenetics to study the consequences of IC or vlOFC inhibition on acquisition and performance of instrumental actions using the outcome devaluation task. Rats first learned to associate actions with desirable outcomes. Then, one of these outcomes was devalued and we assessed the rats' choice between the 2 actions. Typically, rats will bias their selection towards the action that delivers the still valued outcome. We show that chemogenetic-induced inhibition of IC during choice abolishes goal-directed control whereas inhibition during instrumental acquisition is without effect. IC is therefore necessary for action selection based on current outcome value. By contrast, vlOFC inhibition during acquisition or the choice test impaired goal-directed behavior but only following a shift in the instrumental contingencies. Our results provide clear evidence that vlOFC plays a critical role in action-dependent learning, which challenges the popular idea that this region of OFC is exclusively involved in stimulus-dependent behaviors.

Selective impairment of goal-directed decision-making following lesions to the human ventromedial prefrontal cortex.

Neuroimaging studies suggest that the human ventromedial prefrontal cortex is a key region for goal-directed behaviour. However, it remains unclear whether the ventromedial prefrontal cortex is necessary for such behaviour. Here we used a canonical test from the animal literature designed to distinguish goal-directed from habit-based choice: namely, outcome devaluation. Patients with focal damage to the ventromedial prefrontal cortex showed deficits in goal-directed choice by persistently selecting actions for a food outcome that had been devalued through selective satiation. By contrast, the same patients had entirely intact acquisition of instrumental contingencies, demonstrating preserved habitual control, and also gave normal ratings of the hedonic value of the devalued food. These findings for the first time demonstrate a necessary and selective role for the human ventromedial prefrontal cortex in goal-directed choice, reconciling prior neuroimaging results in humans with lesion studies in animals, and providing a mechanistic explanation of the real-life deficits in decision-making that have been documented in patients with damage to this structure.

Triggering Avoidance: Dissociable Influences of Aversive Pavlovian Conditioned Stimuli on Human Instrumental Behavior.

The present study investigates human aversive Pavlovian-to-Instrumental Transfer (PIT) and possible influences of outcome devaluation and instrumental overtraining on this effect. PIT measures the extent to which a Pavlovian conditioned stimulus (CS) can increase instrumental responses independently paired with the same (outcome-specific transfer) or a different (general transfer) reinforcer. Two measures of PIT were obtained: the percentage of instrumental responses and the vigor of such responses. Thirty-eight volunteers performed a standard PIT task sequence. Results showed a double dissociation between outcome-specific and general transfer: the first selectively expressed in the amount of responses, the second in the vigor measure solely. Furthermore, outcome-specific transfer was enhanced by overtraining, but not affected by devaluation. General transfer, on the other hand, was affected by neither overtraining, nor devaluation. A positive correlation between general transfer and sensitivity to punishments was found. Findings are discussed in terms of hypothetically different underlying neurobehavioral mechanisms and their relations to habits and goal-directed behavior.

Peripheral nerve injury impairs the ability to maintain behavioural flexibility following acute stress in the rat

Chronic neuropathic pain often leads to impaired cognition and reduced behavioural flexibility. This study used a rat model to investigate if a peripheral nerve injury, with or without an additional acute psychological stress, alters behavioural flexibility and goal directed behaviour as measured by sensitivity to devaluation. Neuropathic pain was induced by a chronic constriction injury (CCI) of the sciatic nerve. CCI, sham-injury and naïve rats were trained to press two levers for two rewards. In outcome devaluation tests, one of the rewards was devalued by pre-feeding it to satiety, immediately prior to an extinction test measuring responding on the two levers. The ability to preferentially direct responding toward the action earning the currently-valued reward was taken as evidence of goal-directed behaviour. To test the impact of acute stress, rats were subjected to 15min restraint following pre-feeding and prior to the devaluation test. Neither CCI surgery nor acute stress alone altered sensitivity to devaluation, but in combination CCI and acute stress significantly reduced sensitivity to devaluation. This Study demonstrates that relatively mild stressors that are without effect in uninjured populations can markedly impair cognition under conditions of chronic pain. It further suggests that overlapping neural substrates regulated by nerve injury and/or acute stress are having a cumulative effect on behavioural flexibility.

Thalamic Control of Dorsomedial Striatum Regulates Internal State to Guide Goal-Directed Action Selection.

We (Bradfield et al., 2013) have demonstrated previously that parafascicular thalamic nucleus (PF)-controlled neurons in the posterior dorsomedial striatum (pDMS) are critical for interlacing new and existing action-outcome contingencies to control goal-directed action. Based on these findings, it was suggested that animals with a dysfunctional PF-pDMS pathway might suffer a deficit in creating or retrieving internal contexts or "states" on which such information could become conditional. To assess this hypothesis more directly, rats were given a disconnection treatment using contralateral cytotoxic lesions of the PF and pDMS (Group CONTRA) or ipsilateral control lesions (Group IPSI) and trained to press a right and left lever for sucrose and pellet outcomes, after which these contingencies were reversed. The rats were then given an outcome devaluation test (all experiments) and a test of outcome-specific reinstatement (Experiments 1 and 3). We found that devaluation performance was intact for both groups after training of initial contingencies, but impaired for Group CONTRA after reversal. However, performance was restored by additional reversal training. Furthermore, when tested a second time after reversal training, rats in both groups demonstrated responding in accordance with the original contingencies, providing direct evidence of modulation of action selection by state. Finally, we found that external context could substitute for internal state and so could rescue responding in Group CONTRA, but only in the reinstatement test. Together, these findings suggest that animals use internal state information to guide action selection and that this information is modulated by the PF-pDMS pathway.SIGNIFICANCE STATEMENT Individuals with Parkinson's disease dementia often suffer a characteristic deficit in "cognitive flexibility." It has been suggested that neurodegeneration in the pathway between the centromedian/parafascicular thalalmic nucleus (PF) and striatum might underlie such deficits (Smith et al., 2014). In rats, we have similarly observed that a functional disconnection of the PF-posterior dorsomedial striatal pathway produces a specific impairment in the ability to alter goal-directed actions (Bradfield et al., 2013). It was suggested that this impairment could be a result of a deficit in state modulation. Here, we present four experiments that provide evidence for this hypothesis and suggest several ways (e.g., extended practice, providing external cues) in which this state modulation can be rescued.

Identification of an unconventional process of instrumental learning characteristically initiated with outcome devaluation-insensitivity and generalized action selection

The distinction between goal-directed action and habitual response, particularly with respect to moderate or extended appetitive instrumental training, is well documented; however, the propensity toward instrumental behavior in the early training stage has not been elucidated. In this study, we trained Sprague Dawley rats to press a lever to obtain food as an outcome for various time periods and monitored the changes in their sensitivity to outcome devaluation and choice between the levers they had been trained with and unfamiliar levers. After the extensive training with a random interval schedule, the rats were insensitive to outcome devaluation, and exhibited a typical habit-like phenotype, as previously reported, and the untrained leverpresses were relatively rare and sporadic. During the initial stage of training (≤1 week), the rats exhibited a similar insensitivity to the devaluation; however, in contrast to the overtrained condition, they performed distinctive unbiased leverpresses on both the trained and untrained levers. Thus, we propose a possibility that, contrary to the authentic concept that instrumental learning is initiated with an outcome devaluation-sensitive goal-directed stage, under some conditions, this learning can unconventionally begin with the initial stage that is distinct from both goal-directed action and habitual response.

Goal-Directed and Habit-Like Modulations of Stimulus Processing during Reinforcement Learning.

Recent research has shown that perceptual processing of stimuli previously associated with high-value rewards is automatically prioritized even when rewards are no longer available. It has been hypothesized that such reward-related modulation of stimulus salience is conceptually similar to an "attentional habit." Recording event-related potentials in humans during a reinforcement learning task, we show strong evidence in favor of this hypothesis. Resistance to outcome devaluation (the defining feature of a habit) was shown by the stimulus-locked P1 component, reflecting activity in the extrastriate visual cortex. Analysis at longer latencies revealed a positive component (corresponding to the P3b, from 550-700 ms) sensitive to outcome devaluation. Therefore, distinct spatiotemporal patterns of brain activity were observed corresponding to habitual and goal-directed processes. These results demonstrate that reinforcement learning engages both attentional habits and goal-directed processes in parallel. Consequences for brain and computational models of reinforcement learning are discussed.SIGNIFICANCE STATEMENT The human attentional network adapts to detect stimuli that predict important rewards. A recent hypothesis suggests that the visual cortex automatically prioritizes reward-related stimuli, driven by cached representations of reward value; that is, stimulus-response habits. Alternatively, the neural system may track the current value of the predicted outcome. Our results demonstrate for the first time that visual cortex activity is increased for reward-related stimuli even when the rewarding event is temporarily devalued. In contrast, longer-latency brain activity was specifically sensitive to transient changes in reward value. Therefore, we show that both habit-like attention and goal-directed processes occur in the same learning episode at different latencies. This result has important consequences for computational models of reinforcement learning.

Intermittent feeding alters sensitivity to changes in reward value

The influence of binge-like feeding schedules on subsequent food-related behavior is not well understood. We investigated the effect of repeated cycles of restriction and refeeding on two food-related behaviors; goal-directed responding for a palatable food reward and sensory-specific satiety. Hungry rats were trained to perform two instrumental actions for two distinct food outcomes and were then subjected to repeated cycles of restricted and unrestricted access to their maintenance chow for 30-days or were maintained on food restriction. Goal-directed control was then assessed using specific satiety-induced outcome devaluation. Rats were given 1 h access to one of theoutcomes and were then immediately given a choice between the two actions. Rats maintained on restriction responded more for the valued than the devalued reward but rats with a history of restriction and refeeding failed to show this effect. Importantly, all rats showed sensory-specific satiety when offered a choice between the two foods, indicating that pre-feeding selectively reduced the value of the pre-fed food. By contrast, sensory-specific satiety was not observed in rats with a history of intermittent feeding when the foods were offered sequentially. These results indicate that, similar to calorically dense diets, intermittent feeding patterns can impair the performance of goal-directed actions as well as the ability to reject a pre-fed food when it is offered alone.

Effects of outcome devaluation on instrumental behaviors in a discriminated heterogeneous chain.

Operant behavior often takes place in a sequence, or chain, of linked responses that lead to a reinforcer. We have recently studied rats performing a discriminated heterogeneous behavior chain that involves the presentation of a discriminative stimulus (e.g., a panel light) to set the occasion for a procurement behavior (e.g., a lever press) that leads to a second stimulus (e.g., a second panel light) that indicates that a consumption response (e.g., a chain pull) will be reinforced. The present study assessed the role played by a representation of the reinforcer in controlling the performance of the responses in this chain. After acquisition of the chain, rats received a reinforcer devaluation treatment in the form of repeated paired, or unpaired, presentations of the food-pellet outcome and lithium-chloride illness. Once paired rats came to reject the pellets, half the animals in each group were tested on procurement, and the other half were tested on consumption. Neither response was affected by the outcome devaluation treatment, although entries into the food cup were suppressed. Combined with other results, the findings suggest that the "goal" for goal-directed procurement responding in a discriminated heterogeneous chain may be the consumption response rather than the primary reinforcer. (PsycINFO Database Record

Loss of lateral prefrontal cortex control in food-directed attention and goal-directed food choice in obesity

Loss of lateral prefrontal cortex (lPFC)-mediated attentional control may explain the automatic tendency to eat in the face of food. Here, we investigate the neurocognitive mechanism underlying attentional bias to food words and its association with obesity using a food Stroop task. We tested 76 healthy human subjects with a wide body mass index (BMI) range (19–35kg/m2) using fMRI. As a measure of obesity we calculated individual obesity scores based on BMI, waist circumference and waist-to-hip ratio using principal component analyses. To investigate the automatic tendency to overeat directly, the same subjects performed a separate behavioral outcome devaluation task measuring the degree of goal-directed versus automatic food choices. We observed that increased obesity scores were associated with diminished lPFC responses during food attentional bias. This was accompanied by decreased goal-directed control of food choices following outcome devaluation. Together these findings suggest that deficient control of both food-directed attention and choice may contribute to obesity, particularly given our obesogenic environment with food cues everywhere, and the choice to ignore or indulge despite satiety.

Contexts Paired with Junk Food Impair Goal-Directed Behavior in Rats: Implications for Decision Making in Obesogenic Environments.

The high prevalence of obesity and related metabolic diseases calls for greater understanding of the factors that drive excess energy intake. Calorie-dense palatable foods are readily available and often are paired with highly salient environmental cues. These cues can trigger food-seeking and consumption in the absence of hunger. Here we examined the effects of palatable food-paired environmental cues on control of instrumental food-seeking behavior. In Experiment 1, adult male rats received exposures to one context containing three “junk” foods (JFs context) and another containing chow (Chow context). Next, rats were food-deprived and trained to perform instrumental responses (lever-press) for two novel food rewards in a third, distinct context. Contextual influences on flexible control of food-seeking behavior were then assessed by outcome devaluation tests held in the JF, chow and training contexts. Devaluation was achieved using specific satiety and test order was counterbalanced. Rats exhibited goal-directed control over behavior when tested in the training and chow-paired contexts. Notably, performance was habitual (insensitive to devaluation) when tested in the JF context. In Experiment 2 we tested whether the impairment found in the JF context could be ameliorated by the presentation of a discrete auditory cue paired with the chow context, relative to a second cue paired with the JF context. Consistent with the results of Experiment 1, the devaluation effect was not significant when rats were tested in the JF context with the JF cue. However, presenting the chow cue increased the impact of the devaluation treatment leading to a robust devaluation effect. Further tests confirmed that performance in the chow context was goal-directed and that sensory-specific satiety in the JF context was intact. These results show that environments paired with palatable foods can impair goal-directed control over food-seeking behavior, but that this deficit was improved by a cue paired with chow. This has promising implications for assisting individuals in controlling their eating behavior in environments designed to dysregulate it.

Alcohol seeking by rats becomes habitual after prolonged training.

This study examines the effect of the amount of training on alcohol seeking behavior in rats. Contemporary theories of instrumental learning suggest that habit learning processes are involved in the development of the compulsive drug seeking that characterizes addiction. Wistar rats were trained to perform an instrumental response for a solution of ethanol. In Experiment 1, the rats received 2 instrumental training sessions, whereas animals in Experiment 2 received 2, 8, or 16 sessions. An aversion was then conditioned to ethanol by pairing it with LiCl, and the performance in extinction was subsequently tested. Instrumental responding showed variable sensitivity to outcome devaluation as a function of the length of training. After 2 and 8 training sessions, but not after 16 sessions, drug seeking was influenced by a change in the value of ethanol. The results suggest that alcohol seeking is more flexible and goal-directed in early stages of training, but it becomes habitual and less governed by its consequences with more extended training.

The effect of high-fat diet consumption on appetitive instrumental behavior in rats

Evidence now indicates that the chronic consumption of high-calorie foods, such as a high-fat diet (HFD), is associated with impaired control over food-seeking, yet the extent of this alteration is not fully understood. Using different reinforcement schedules, we evaluated whether HFD intake from weaning to adulthood modifies instrumental responding and induces a shift from goal-directed actions to habitual responding. We first observed reduced instrumental performance and motivation for a food reward in HFD-fed rats trained under schedules of reinforcement that facilitate habitual responding [Random Interval (RI)]. However, this deficit was alleviated if rats trained under RI were subsequently trained with reinforcement schedules that promote goal-directed strategies [Random Ratio (RR)]. Using an outcome devaluation procedure, we then demonstrated that consumption of a HFD promoted habitual behavior in rats trained under RI but not RR schedules. Finally, extended HFD exposure did not interfere with the ability of RR training to overcome impaired RI instrumental performance and to favor goal-directed behavior. These results indicate that chronic consumption of a HFD changes the co-ordination of goal-directed actions and habits and that alteration of food-seeking may be reversed under particular behavioral conditions.

Extended cocaine-seeking produces a shift from goal-directed to habitual responding in rats

Cocaine addiction is often characterized by a rigid pattern of behavior in which cocaine users continue seeking and taking drug despite negative consequences associated with its use. As such, full acquisition and relapse of drug-seeking behavior may be attributed to a shift away from goal-directed responding and a shift towards the maladaptive formation of rigid and habit-like responses. This rigid nature of habitual responding can be developed with extended training and is typically characterized by insensitivity to changes in outcome value. The present study determined whether cocaine (primary reinforcer) and cocaine associated cues (secondary reinforcer) could be devalued in rats with different histories of cocaine self-administration. Specifically, rats were trained on two schedules of cocaine self-administration (long-access vs. short-access). Following training the cocaine reinforcer was devalued through three separate pairings of lithium chloride with cocaine infusions. Cocaine history did not have an impact on devaluation of cocaine-associated cues. However, the reinforcing properties of cocaine were devalued only in rats on a short-access cocaine schedule but not those trained on a long-access schedule. Taken together this pattern of findings suggests that, in short access rats, devaluation is specific to the primary reinforcer and not associative stimuli such as cues. Importantly, rats that received extended training during self-administration displayed insensitivity to outcome devaluation of the primary reinforcer as well as all associative stimuli, thus displaying rigid behavioral responding similar to behavioral patterns found in addiction. Alternatively, long access cocaine exposure may have altered the devaluation threshold.

Decreasing Striatopallidal Pathway Function Enhances Motivation by Energizing the Initiation of Goal-Directed Action.

Altered dopamine D2 receptor (D2R) binding in the striatum has been associated with abnormal motivation in neuropsychiatric disorders, including schizophrenia. Here, we tested whether motivational deficits observed in mice with upregulated D2Rs (D2R-OEdev mice) are reversed by decreasing function of the striatopallidal "no-go" pathway. To this end, we expressed the Gαi-coupled designer receptor hM4D in adult striatopallidal neurons and activated the receptor with clozapine-N-oxide (CNO). Using a head-mounted miniature microscope we confirmed with calcium imaging in awake mice that hM4D activation by CNO inhibits striatopallidal function measured as disinhibited downstream activity in the globus pallidus. Mice were then tested in three operant tasks that address motivated behavior, the progressive ratio task, the progressive hold-down task, and outcome devaluation. Decreasing striatopallidal function in the dorsomedial striatum or nucleus accumbens core enhanced motivation in D2R-OEdev mice and control littermates. This effect was due to increased response initiation but came at the cost of goal-directed efficiency. Moreover, response vigor and the sensitivity to changes in reward value were not altered. Chronic activation of hM4D by administering CNO for 2 weeks in drinking water did not affect motivation due to a tolerance effect. However, the acute effect of CNO on motivation was reinstated after discontinuing chronic treatment for 48 h. Used as a therapeutic approach, striatopallidal inhibition should consider the risk of impairing goal-directed efficiency and behavioral desensitization. Motivation involves a directional component that allows subjects to efficiently select the behavior that will lead to an optimal outcome and an activational component that initiates and maintains the vigor and persistence of actions. Striatal output pathways modulate motivated behavior, but it remains unknown how these pathways regulate specific components of motivation. Here, we found that the indirect pathway controls response initiation without affecting response vigor or the sensitivity to changes in the reward outcome. A specific enhancement in the activational component of motivation, however, can come at the cost of goal-directed efficiency when a sustained response is required to obtain the goal. These data should inform treatment strategies for brain disorders with impaired motivation such as schizophrenia and Parkinson's disease.