Reward Devaluation Research Articles

Childhood socioeconomic position relates to adult decision-making: Evidence from a large cross-cultural investigation.

Early exposure to poverty may have profound and enduring impacts on developmental trajectories over the lifespan. This study investigated potential links between childhood socioeconomic position, recent economic change, and temporal discounting in a large international cohort (N = 12,951 adults from 61 countries). Temporal discounting refers to the tendency to prefer smaller immediate rewards over larger rewards delivered after a delay, and connects to consequential outcomes including academic achievement, occupational success, and risk-taking behaviors. Consistent with multiple theories about the impacts of stress exposure, individuals who reported lower socioeconomic positions in childhood exhibited greater temporal discounting in adulthood compared to peers who did not. Furthermore, an interaction emerged between childhood socioeconomic position and recent economic change, such that the steepest temporal discounting was found among those from lower childhood socioeconomic positions who also recently experienced negative economic change as a result of the COVID pandemic. These associations remained significant even when accounting for potentially confounding factors like education level and current employment. Findings provide new evidence that childhood socioeconomic position relates to greater temporal discounting and steeper devaluation of future rewards later in adulthood, particularly in response to contemporaneous economic change. This suggests childhood socioeconomic position may have longer-term impacts on developmental trajectories. Speculatively, childhood socioeconomic position may shape adult behavior through increased life stress, diminished access to resources, and lower perceived trust and reliability in social systems. These findings underscore the long-term implications of socioeconomic gaps, cycles of disadvantage and economic marginalization.

Goal-directed behavior in Tenebrio molitor larvae

Can signs of intentional behavior be traced in an insect larva, traditionally thought to be driven only by mere reflexes? We trained Tenebrio molitor coleoptera larvae in a uniform Y-maze to prefer one target branch to get access to food, observing their ability to learn and retain access to the reward-associated side for up to 24 h. During reward devaluation, the reward food (experimental group) and a different food (control group) were paired with an aversive stimulus in a new environment. When tested again in the Y-maze, mealworms of the experimental group significantly reduced their visits to the target branch, whereas mealworms of the control group did not. Importantly, we found that the larvae did not have to experience the unpleasant consequences directly in the target branch to halt their behavior, as the exposure to the aversive taste occurred in a separate unfamiliar context. This is evidence that the mealworms formed a mental representation of action-consequence relationships, demonstrating flexible control of their actions to achieve desired outcomes at an early stage of their development.

Value-Driven Adaptations of Mesolimbic Dopamine Release Are Governed by Both Model-Based and Model-Free Mechanisms.

The magnitude of dopamine signals elicited by rewarding events and their predictors is updated when reward value changes. It is actively debated how readily these dopamine signals adapt and whether adaptation aligns with model-free or model-based reinforcement-learning principles. To investigate this, we trained male rats in a pavlovian-conditioning paradigm and measured dopamine release in the nucleus accumbens core in response to food reward (unconditioned stimulus) and reward-predictive conditioned stimuli (CS), both before and after reward devaluation, induced via either sensory-specific or nonspecific satiety. We demonstrate that (1) such devaluation reduces CS-induced dopamine release rapidly, without additional pairing of CS with devalued reward and irrespective of whether the devaluation was sensory-specific or nonspecific. In contrast, (2) reward devaluation did not decrease food reward-induced dopamine release. Surprisingly, (3) postdevaluation reconditioning, by additional pairing of CS with devalued reward, rapidly reinstated CS-induced dopamine signals to predevaluation levels. Taken together, we identify distinct, divergent adaptations in dopamine-signal magnitude when reward value is decreased: CS dopamine diminishes but reinstates fast, whereas reward dopamine is resistant to change. This implies that, respective to abovementioned findings, (1) CS dopamine may be governed by a model-based mechanism and (2) reward dopamine by a model-free one, where (3) the latter may contribute to swift reinstatement of the former. However, changes in CS dopamine were not selective for sensory specificity of reward devaluation, which is inconsistent with model-based processes. Thus, mesolimbic dopamine signaling incorporates both model-free and model-based mechanisms and is not exclusively governed by either.

Differential effects of acute and prolonged morphine withdrawal on motivational and goal-directed control over reward-seeking behaviour.

Opioid addiction is a relapsing disorder marked by uncontrolled drug use and reduced interest in normally rewarding activities. The current study investigated the impact of spontaneous withdrawal from chronic morphine exposure on emotional, motivational and cognitive processes involved in regulating the pursuit and consumption of food rewards in male rats. In Experiment 1, rats experiencing acute morphine withdrawal lost weight and displayed somatic signs of drug dependence. However, hedonically driven sucrose consumption was significantly elevated, suggesting intact and potentially heightened reward processing. In Experiment 2, rats undergoing acute morphine withdrawal displayed reduced motivation when performing an effortful response for palatable food reward. Subsequent reward devaluation testing revealed that acute withdrawal disrupted their ability to exert flexible goal-directed control over reward seeking. Specifically, morphine-withdrawn rats were impaired in using current reward value to select actions both when relying on prior action-outcome learning and when given direct feedback about the consequences of their actions. In Experiment 3, rats tested after prolonged morphine withdrawal displayed heightened rather than diminished motivation for food rewards and retained their ability to engage in flexible goal-directed action selection. However, brief re-exposure to morphine was sufficient to impair motivation and disrupt goal-directed action selection, though in this case, rats were only impaired in using reward value to select actions in the presence of morphine-paired context cues and in the absence of response-contingent feedback. We suggest that these opioid-withdrawal induced deficits in motivation and goal-directed control may contribute to addiction by interfering with the pursuit of adaptive alternatives to drug use.

Associations among posttraumatic stress disorder symptoms, suicidal ideation, suicide attempts, and reward discounting.

Posttraumatic stress disorder (PTSD) is associated with suicidal thoughts and behaviours. Decision-making processes and risk-taking are prominent for coping in both, but the implications for guaranteed and probabilistic reward discounting, important components in behavioural decision-making processes, are unclear. This study explored the relationships between PTSD and suicide risk with tendencies towards devaluing guaranteed rewards that are larger but delayed (i.e., delay discounting; DD) and devaluing larger but uncertain rewards (i.e., probability discounting; PD) for immediate but smaller rewards. The current study evaluated 498 participants (majority male [51.4%] and white [63.8%]; 33.3% screening positive for probable PTSD; 19.2% with lifetime suicide attempts; 30.8% with recent suicide ideation) on both delayed discounting and PD tasks. Provisional PTSD diagnosis, but not suicide attempts or ideation, was associated with increased PD (i.e., more devaluation of uncertain rewards). Conversely, PTSD interacted with both attempt history and ideation to predict increased delayed discounting (i.e., more devaluing of greater but delayed rewards). These results highlight how those with PTSD symptoms assign valuations to rewards, as well as how the addition of suicide risk interacts to impact these decision-making processes. While further research is needed, this suggests potential implications for treatment as they may benefit from structuring progress in smaller, more immediate goals.

Levonorgestrel maintains goal-directed behavior in habit-trained intact female rats

Hormonal contraceptives are utilized by millions of women worldwide. However, it remains unclear if these powerful endocrine modulators may alter cognitive function. Habit formation involves the progression of instrumental learning as it goes from being a conscious goal-directed process to a cue-driven automatic habitual motor response. Dysregulated goal and/or habit is implicated in numerous psychopathologies, underscoring the relevance of examining the effect of hormonal contraceptives on goal-directed and habitual behavior. This study examined the effect of levonorgestrel (LNG), a widely used progestin-type contraceptive, on the development of habit in intact female rats. Rats were implanted with subcutaneous capsules that slowly released LNG over the course of the experiment or cholesterol-filled capsules. All female rats underwent operant training followed by reward devaluation to test for habit. One group of females was trained at a level that is sub-threshold to habit, while another group of females was trained to a level well over the habit threshold observed in intact females. The results reveal that all sub-threshold trained rats remained goal-directed irrespective of LGN treatment, suggesting LNG is not advancing habit formation in female rats at this level of reinforcement. However, in rats that were overtrained well above the threshold, cholesterol females showed habitual behavior, thus replicating a portion of our original studies. In contrast, LNG-treated habit-trained rats remained goal-directed, indicating that LNG impedes the development and/or expression of habit following this level of supra-threshold to habit training. Thus, LNG may offset habit formation by sustaining attentional or motivational processes during learning in intact female rats. These results may be clinically relevant to women using this type of hormonal contraceptive as well as in other progestin-based hormone therapies.

Action control and selection in social disinhibition following severe TBI: a pavlovian-to-instrumental transfer and outcome devaluation study

ABSTRACT Introduction Social disinhibition is a significant sequela of severe traumatic brain injury (TBI). Some research suggests that it could reflect a deficiency in goal-directed behavior. The current study aimed to test whether these inappropriate behaviors tend to be deficient in goal-directed control, that is, triggered more by environmental stimuli than by the known consequences of their actions. Method We used a between-group design with 25 adult participants with severe TBI, and 27 control participants. Social disinhibition was measured using Frontal Systems Behavior Scale and Social Disinhibition Interview. Changes in reward-related goal-directed behavior were evaluated using a computer-based task in which we assessed the influence of cues predicting reward and of reward devaluation on choice performance. Results We found no difference in the levels of social disinhibition between the TBI and control groups and, using mixed two-way ANCOVAs, no overall effect of the stimuli or outcome devaluation. However, after combing these groups and splitting them based on their disinhibition levels, a significant interaction between group (High vs Low disinhibition) and reward type (Valued vs Devalued) in sensitivity to outcome devaluation test (F = 5.99, p = .01, ηp2 = .13) appeared. Comparing with the baseline rate of responding, the Low disinhibition group decreased their responding to devalued and increased their responding to still-valued outcomes. In contrast, the High disinhibition group showed the opposite pattern of choice performance. Conclusions It appears that people with clinical levels of social disinhibition are both prone to outcome-response priming effects and insensitive to changes in the value of the consequences of their actions, that is, despite evidence they were aware of the reduction in the value of their actions’s outcomes, people with high-level disinhibition kept performing those actions. This pattern has the hallmarks of a habit suggesting their disinhibition reflects a loss of executive control.

Short- and Long-Term High-Fat Diet Exposure Differentially Alters Phasic and Tonic GABAergic Signaling onto Lateral Orbitofrontal Pyramidal Neurons.

The chronic consumption of caloric dense high-fat foods is a major contributor to increased body weight, obesity, and other chronic health conditions. The orbitofrontal cortex (OFC) is critical in guiding decisions about food intake and is altered with diet-induced obesity. Obese rodents have altered morphologic and synaptic electrophysiological properties in the lateral orbitofrontal cortex (lOFC). Yet the time course by which exposure to a high-fat diet (HFD) induces these changes is poorly understood. Here, male mice are exposed to either short-term (7 d) or long-term (90 d) HFD. Long-term HFD exposure increases body weight, and glucose signaling compared with short-term HFD or a standard control diet (SCD). Both short and long-term HFD exposure increased the excitability of lOFC pyramidal neurons. However, phasic and tonic GABAergic signaling was differentially altered depending on HFD exposure length, such that tonic GABAergic signaling was decreased with early exposure to the HFD and phasic signaling was changed with long-term diet exposure. Furthermore, alterations in the short-term diet exposure were transient, as removal of the diet restored electrophysiological characteristics similar to mice fed SCD, whereas long-term HFD electrophysiological changes were persistent and remained after HFD removal. Finally, we demonstrate that changes in reward devaluation occur early with diet exposure. Together, these results suggest that the duration of HFD exposure differentially alters lOFC function and provides mechanistic insights into the susceptibility of the OFC to impairments in outcome devaluation.SIGNIFICANCE STATEMENT This study provides mechanistic insight on the impact of short-term and long-term high-fat diet (HFD) exposure on GABAergic function in the lateral orbitofrontal cortex (lOFC), a region known to guide decision-making. We find short-term HFD exposure induces transient changes in firing and tonic GABA action on lOFC pyramidal neurons, whereas long-term HFD induces obesity and has lasting changes on firing, tonic GABA and inhibitory synaptic transmission onto lOFC neurons. Given that GABAergic signaling in the lOFC can influence decision-making around food, these results have important implications in present society as palatable energy dense foods are abundantly available.

A corticoamygdalar pathway controls reward devaluation and depression using dynamic inhibition code

Reward devaluation adaptively controls reward intake. It remains unclear how cortical circuits causally encode reward devaluation in healthy and depressed states. Here, we show that the neural pathway from the anterior cingulate cortex (ACC) to the basolateral amygdala (BLA) employs a dynamic inhibition code to control reward devaluation and depression. Fiber photometry and imaging of ACC pyramidal neurons reveal reward-induced inhibition, which weakens during satiation and becomes further attenuated in depression mouse models. Ablating or inhibiting these neurons desensitizes reward devaluation, causes reward intake increase and ultimate obesity, and ameliorates depression, whereas activating the cells sensitizes reward devaluation, suppresses reward consumption, and produces depression-like behaviors. Among various ACC neuron subpopulations, the BLA-projecting subset bidirectionally regulates reward devaluation and depression-like behaviors. Our study thus uncovers a corticoamygdalar circuit that encodes reward devaluation via blunted inhibition and suggests that enhancing inhibition within this circuit may offer a therapeutic approach for treating depression.

Self-Referential Processing and Depression: A Systematic Review and Meta-Analysis

Reward devaluation theory posits that depressed individuals avoid and devalue positivity, suggesting that they may hold fewer positive self-schemas. Previous meta-analytic reviews have supported this theoretical framework regarding positivity but have not assessed for self-referential stimuli. Self-referential encoding and recall tasks assess for self-schemas and thus provide further insight into how depressed individuals process self-referential positivity. The aim of this systematic review and meta-analysis was to examine the extent to which depressed individuals differ in processing self-referential positivity and negativity and whether this processing differs when depressed individuals think of others (i.e., other-referential). Results indicate that depressed individuals recall and endorse fewer self-referential positive words than negative words and fewer self-referential positive words than other-referential positive words than nondepressed individuals. These findings support reward devaluation theory and suggest that conceptualizing self-referential processing in depression as merely based on negativity biases can overlook crucial information about how depressed individuals devalue self-referential positive information.

The role of sex on sign-tracking acquisition and outcome devaluation sensitivity in Long Evans rats

Cues that predict rewards can trigger reward-seeking behaviors but also can, in some cases, become targets of motivation themselves. One behavioral phenomenon that captures this idea is sign-tracking in which animals, including humans, interact with reward-predictive cues even though it is not necessary to do so. Sign-tracking in rats has been studied in the domain of motivation and in how motivated behaviors can or cannot become excessive and habit-like over time. Many prior studies look at sign-tracking examine this behavior in male subjects, but there are few papers that look at this behavior in female subjects. Moreover, it is unknown where there might be sex-related variation in how flexible sign-tracking is when faced with changing reward values. Therefore, we asked if there were sex differences in the acquisition of sign-tracking behavior and if there were any sex differences in how sensitive animals were in their sign-tracking following reward devaluation. In contrast to previous reports, we found that males and females show no differences in how they acquire sign-tracking and in ultimate sign-tracking levels following training. Additionally, we found no difference in how quickly males and females learned to devalue the food reward, and we found no differences in sign-tracking levels by sex following outcome devaluation. We believe that this is primarily due to our experiment being performed in the Long Evans strain but also believe that there are many other factors contributing to differences between our study and previous work.

Refining the study of decision-making in animals: differential effects of d-amphetamine and haloperidol in a novel touchscreen-automated Rearing-Effort Discounting (RED) task and the Fixed-Ratio Effort Discounting (FRED) task

Effort-based decision-making is impaired in multiple psychopathologies leading to significant impacts on the daily life of patients. Preclinical studies of this important transdiagnostic symptom in rodents are hampered, however, by limitations present in currently available decision-making tests, including the presence of delayed reinforcement and off-target cognitive demands. Such possible confounding factors can complicate the interpretation of results in terms of decision-making per se. In this study we addressed this problem using a novel touchscreen Rearing-Effort Discounting (RED) task in which mice choose between two single-touch responses: rearing up to touch an increasingly higher positioned stimulus to obtain a High Reward (HR) or touching a lower stimulus to obtain a Low Reward (LR). To explore the putative advantages of this new approach, RED was compared with a touchscreen version of the well-studied Fixed Ratio-based Effort Discounting (FRED) task, in which multiple touches are required to obtain an HR, and a single response is required to obtain an LR. Results from dopaminergic (haloperidol and d-amphetamine), behavioral (changes in the order of effort demand; fixed-ratio schedule in FRED or response height in RED), and dietary manipulations (reward devaluation by pre-feeding) were consistent with the presence of variables that may complicate interpretation of conventional decision-making tasks, and demonstrate how RED appears to minimize such variables.

Excitatory and Inhibitory Signaling in the Nucleus Accumbens Encode Different Aspects of a Pavlovian Cue in Sign Tracking and Goal Tracking Rats.

When a Pavlovian cue is presented separately from its associated reward, some animals will acquire a sign tracking (ST) response - approach and/or interaction with the cue - while others will acquire a goal tracking response - approach to the site of reward. We have previously shown that cue-evoked excitations in the nucleus accumbens (NAc) encode the vigor of both behaviors; in contrast, reward-related responses diverge over the course of training, possibly reflecting neurochemical differences between sign tracker and goal tracker individuals. However, a substantial subset of neurons in the NAc exhibit inhibitory, rather than excitatory, cue-evoked responses, and the evolution of their signaling during Pavlovian conditioning remains unknown. Using single-neuron recordings in behaving rats, we show that NAc neurons with cue-evoked inhibitions have distinct coding properties from neurons with cue-evoked excitations. Cue-evoked inhibitions become more numerous over the course of training and, like excitations, may encode the vigor of sign tracking and goal tracking behavior. However, the responses of cue-inhibited neurons do not evolve differently between sign tracker and goal tracker individuals. Moreover, cue-evoked inhibitions, unlike excitations, are insensitive to extinction of the cue-reward relationship. Finally, we show that cue-evoked excitations are greatly diminished by reward devaluation, while inhibitory cue responses are virtually unaffected. Overall, these findings converge with existing evidence that cue-excited neurons in NAc, but not cue-inhibited neurons, are profoundly sensitive to the same behavior variations that are often associated with changes in dopamine release.

The Hippocampus Contributes to Temporal Discounting When Delays and Rewards Are Experienced in the Moment.

Temporal discounting (TD) represents the mental devaluation of rewards that are available after a delay. Whether the hippocampus is critical for TD remains unclear, with marked discrepancies between animal and human studies: although animals with discrete hippocampal lesions display impaired TD, human participants with similar lesions show intact performance on classic intertemporal choice tasks. A candidate explanation for this discrepancy is that delays and rewards are experienced in the moment in animal studies but tend to be hypothetical in human studies. We tested this hypothesis by examining the performance of amnesic participants with hippocampal lesions (one female, six males) on a novel experiential intertemporal choice task that used interesting photographs occluded by thick lines as rewards (Patt et al., 2021). Using a logistic function to model indifference points data, we compared performance to that on a classic intertemporal choice task with hypothetical outcomes. Participants with hippocampal lesions displayed impaired patterns of choices in the experiential task but not in the hypothetical task. Specifically, hippocampal lesions were associated with decreased amplitude of the delay-reward trade-off, with persistent choice of the delayed option despite delay increase. These results help explain previous discrepancies across animal and human studies, indicating that the hippocampus plays a critical role in temporal discounting when the outcomes of decisions are experienced in the moment, but not necessarily when they are hypothetical.SIGNIFICANCE STATEMENT Impaired temporal discounting (TD) has been related to maladaptive behaviors, including substance dependence and nonadherence to medical treatment. There is consensus that TD recruits the brain valuation network but whether the hippocampal memory system is additionally recruited remains unclear. This study examined TD in hippocampal amnesia, providing a unique opportunity to explore the role of the hippocampus in cognition. Whereas most human studies have used hypothetical outcomes, this study used a novel experiential task with real-time delays and rewards. Results demonstrated hippocampal involvement in the experiential task, but not in a classic hypothetical task administered for comparison. These findings elucidate previous discrepancies between animal and human TD studies. This reconciliation is critical as animals serve as models of human neurocognition.

Fear of Happiness Predicts Concurrent but not Prospective Depressive Symptoms in Adolescents.

It is increasingly recognised that the study of responses to positive emotions significantly contributes to our understanding of psychopathology. Notably, positive emotions are not necessarily experienced as pleasurable. Instead, some believe that experiencing happiness may have negative consequences, referred to as fear of happiness (FOH), or they experience a fear of losing control over positive emotions (FOLC). According to reward devaluation theory, such an association of positivity with negative outcomes will result in positive stimuli being devalued over time, contributing to or maintaining depressive symptoms. The prospective relationship between fears of positivity and depressive symptoms is yet to be examined in adolescents. The present longitudinal study investigated whether FOH and FOLC prospectively predict depressive symptoms. 128 adolescents between 16-18 years of age (M = 16.87, SD = 0.80) recruited from two secondary schools in Flanders, Belgium, completed measures of depressive symptoms (Depression Anxiety Stress Scales) including consummatory anhedonia, FOH (Fear of Happiness Scale), and FOLC (Affective Control Scale) in their classroom at baseline and 2-months follow-up. Regression analyses were performed to test the association between FOH, FOLC, and depressive symptoms. FOH concurrently, but not prospectively, predicted depressive symptoms. There was no significant association between FOH and consummatory anhedonia. FOLC was not a significant predictor of depressive symptoms or consummatory anhedonia. These findings suggest that FOH may only be concurrently related to depressive symptoms. Considering prior findings in adults, future research should investigate the association of FOH with anticipatory anhedonia in adolescents.

Effects of predictive and incentive value manipulation on sign- and goal-tracking behavior

When a neutral stimulus is repeatedly paired with an appetitive reward, two different types of conditioned approach responses may develop: a sign-tracking response directed toward the neutral cue, or a goal-tracking response directed toward the location of impending reward delivery. Sign-tracking responses have been postulated to result from attribution of incentive value to conditioned cues, while goal-tracking reflects the assignment of only predictive value to the cue. We therefore hypothesized that sign-tracking rats would be more sensitive to manipulations of incentive value, while goal-tracking rats would be more responsive to changes in the predictive value of the cue. We tested sign- and goal-tracking before and after devaluation of a food reward using lithium chloride, and tested whether either response could be learned under negative contingency conditions that precluded any serendipitous reinforcement of the behavior that might support instrumental learning. We also tested the effects of blocking the predictive value of a cue using simultaneous presentation of a pre-conditioned cue. We found that sign-tracking was sensitive to outcome devaluation, while goal-tracking was not. We also confirmed that both responses are Pavlovian because they can be learned under negative contingency conditions. Goal-tracking was almost completely blocked by a pre-conditioned cue, while sign-tracking was much less sensitive to such interference. These results indicate that sign- and goal-tracking may follow different rules of reinforcement learning and suggest a need to revise current models of associative learning to account for these differences.

What can machine learning teach us about habit formation? Evidence from exercise and hygiene

We apply a machine learning technique to characterize habit formation in two large panel data sets with objective measures of 1) gym attendance (over 12 million observations) and 2) hospital handwashing (over 40 million observations). Our Predicting Context Sensitivity (PCS) approach identifies context variables that best predict behavior for each individual. This approach also creates a time series of overall predictability for each individual. These time series predictability values are used to trace a habit formation curve for each individual, operationalizing the time of habit formation as the asymptotic limit of when behavior becomes highly predictable. Contrary to the popular belief in a "magic number" of days to develop a habit, we find that it typically takes months to form the habit of going to the gym but weeks to develop the habit of handwashing in the hospital. Furthermore, we find that gymgoers who are more predictable are less responsive to an intervention designed to promote more gym attendance, consistent with past experiments showing that habit formation generates insensitivity to reward devaluation.

Early life adversity impaired dorsal striatal synaptic transmission and behavioral adaptability to appropriate action selection in a sex-dependent manner.

Early life adversity (ELA) is a major health burden in the United States, with 62% of adults reporting at least one adverse childhood experience. These experiences during critical stages of brain development can perturb the development of neural circuits that mediate sensory cue processing and behavioral regulation. Recent studies have reported that ELA impaired the maturation of dendritic spines on neurons in the dorsolateral striatum (DLS) but not in the dorsomedial striatum (DMS). The DMS and DLS are part of two distinct corticostriatal circuits that have been extensively implicated in behavioral flexibility by regulating and integrating action selection with the reward value of those actions. To date, no studies have investigated the multifaceted effects of ELA on aspects of behavioral flexibility that require alternating between different action selection strategies or higher-order cognitive processes, and the underlying synaptic transmission in corticostriatal circuitries. To address this, we employed whole-cell patch-clamp electrophysiology to assess the effects of ELA on synaptic transmission in the DMS and DLS. We also investigated the effects of ELA on the ability to update action control in response to outcome devaluation in an instrumental learning paradigm and reversal of action-outcome contingency in a water T-maze paradigm. At the circuit level, ELA decreased corticostriatal glutamate transmission in male but not in female mice. Interestingly, in DMS, glutamate transmission is decreased in male ELA mice, but increased in female ELA mice. ELA impaired the ability to update action control in response to reward devaluation in a context that promotes goal-directedness in male mice and induced deficits in reversal learning. Overall, our findings demonstrate the sex- and region-dependent effects of ELA on behavioral flexibility and underlying corticostriatal glutamate transmission. By establishing a link between ELA and circuit mechanisms underlying behavioral flexibility, our findings will begin to identify novel molecular mechanisms that can represent strategies for treating behavioral inflexibility in individuals who experienced early life traumatic incidents.

Learning about reward identities and time.

We discuss three empirical findings that we think any theory attempting to integrate interval timing with associative learning concepts will need to address. These empirical phenomena all come from studies that combine peak timing procedures with reinforcer devaluation or conditional discrimination tasks commonly employed, respectively, in interval timing or associative learning research traditions. The three phenomena we discuss include: (1) the observation that disruptions in reward identity encoding have little to no impact on the encoding of reward time in the peak procedure (Delamateret al., 2018), (2) the findings that organisms tend to average their time estimates when presented with a stimulus compound consisting of separately learned stimuli indicating short or long reward times but that such temporal averaging, itself, is sensitive to post-conditioning selective reward devaluation, and (3) that rats can learn a temporal patterning task in which two stimuli presented independently indicate one time to reward availability while their compound indicates another. We review our prior results and present new findings illustrating these three phenomena and we discuss the special challenges they pose for cascade theories of timing, for multiple-oscillator models, and for any approach that attempts to integrate interval timing and associative models. We close by illustrating some ways in which multi-layer connectionist network models might begin to address some of our key findings. We believe this will require an approach that includes separate mechanisms that code for reward identity and time, but that does so in a way that permits for integration between the two systems.

Physical activity reduces alcohol consumption induced by reward downshift.

Increased voluntary consumption of alcohol and other anxiolytics has been demonstrated in animals after experiencing frustrative reward devaluation (downshift) or omission. These results have been interpreted in terms of emotional self-medication. In the present study, we analyzed whether voluntary physical activity reduces alcohol intake induced by reward downshift. Sixty-four male Wistar rats were divided into eight groups (n = 8). Thirty-two (downshifted) animals received 32% sucrose during 10 preshift sessions (5 min), followed by 4% sucrose during five postshift sessions, whereas 32 (unshifted) controls were always exposed to 4% sucrose. Immediately after each consummatory session, animals were exposed to a 2-hr two-bottle preference test involving 32% alcohol versus water or water versus water. Half of the animals had also access to a wheel for voluntary running during the preference test. The results showed lower sucrose consumption in downshifted groups compared with unshifted controls (the frustrative reward downshift effect). Reward downshift significantly increased alcohol intake, this effect being absent in downshifted animals with access to the wheel. These findings suggest that physical exercise could be useful to prevent alcohol self-medication induced by frustrative nonreward. (PsycInfo Database Record (c) 2023 APA, all rights reserved).