Reward-based Decision-making Research Articles

12669 Oxytocin Levels Are Associated With Inhibitory Control In Young Female Individuals With A Low-weight Eating Disorder

Abstract Disclosure: M. Wronski: None. F. Plessow: None. M. Rogers: None. D.L. Kahn: None. E.R. Golden: None. M. Slattery: None. J.J. Thomas: None. L.M. Holsen: None. K.T. Eddy: None. M. Misra: None. E.A. Lawson: None. Background: Preclinical and clinical evidence suggests that the hypothalamic neuropeptide oxytocin (OXT) impacts inhibitory control and reward processing. In male adults with overweight or obesity, we showed that exogeneous OXT increases inhibitory control and neural activation in associated brain regions while attenuating activation in reward-related brain regions. Low-weight eating disorders (LWEDs) are characterized by decreased endogenous OXT levels, altered inhibitory control over behavior, and reduced responsiveness to rewards. However, links between these characteristics are unknown in LWEDs. Here, we examined associations between endogenous OXT levels and performance in behavioral tasks requiring inhibitory control and reward-based decision-making in individuals with a LWED compared to healthy controls (HC). Methods: In 58 females with a LWED and 39 female HC (aged 11-23 years), we measured serum OXT concentrations fasting and 30, 60, and 120 minutes after a 400-kcal standardized meal and calculated OXT area under the curve (AUC) as a composite measure. After the meal (following the 60-minute blood draw), participants completed a Go/NoGo Task to assess inhibitory control over behavior and a monetary Delay Discounting Task to assess reward-based decision-making. We analyzed associations between OXT AUC and behavioral outcomes across groups using robust linear models with main effects of group (LWED vs. HC) and OXT AUC, the interaction effect of group*OXT AUC, and covariates age and body mass index (BMI) z score. Results: Per study design, individuals with a LWED had a lower BMI z score (t=10.90, p<0.001, d=2.00), whereas groups did not differ in OXT AUC (t=1.20, p=0.232, d=0.24). For the Go/NoGo Task, we observed a group effect on NoGo error rate (higher values indicating lower inhibitory control; NoGo error rate: adj. mean [std. error] LWED 35.6 [2.7] % > HC 26.6 [3.4] %) as well as an interaction effect of group*OXT AUC, independent of age and BMI z score (t=2.73, p=0.008, d=0.72). Follow-up simple main effects analysis within each group revealed a significant negative relationship of OXT AUC and NoGo error rate in individuals with a LWED (t=-2.42, p=0.022, d=0.85), while this relationship emerged as nonsignificant but trend-level positive in HC (t=1.73, p=0.099, d=0.74). We did not detect group (t=0.69, p=0.493, d=0.17) or group*OXT interaction (t<0.01, p=0.996, d<0.01) effects on delay discounting rate. Conclusions: In females with a LWED, lower OXT exposure around a meal correlated with lower inhibitory control over behavior. In HC, however, our data yielded a trend of opposite directionality. Links between OXT exposure and reward-related decision-making were absent across groups. Our findings indicate potential relevance and mechanistic involvement of OXT in inhibitory control in LWEDs that warrants further causal investigations. Presentation: 6/3/2024

Two sides of the same coin? What neural processing of emotion and rewards can tell us about complex post-traumatic stress disorder and borderline personality disorder

BackgroundBorderline personality disorder (BPD) and complex posttraumatic stress disorder (cPTSD) share clinical similarities, complicating diagnosis and treatment. Research on the neurobiology of BPD and monotraumatic PTSD has shown that a prefrontal-limbic imbalance in emotional and reward processing is a hallmark of both disorders, but studies examining this network in cPTSD are lacking. Therefore, this study aimed to directly compare neural processing of emotion and reward during decision making in cPTSD and BPD. MethodsUsing functional magnetic resonance imaging, we measured neural activity in female patients (27 patients with cPTSD, 21 patients with BPD and 37 healthy controls) during a Desire-Reason Dilemma task featuring distracting fearful facial expressions. ResultsWe found no differences in neural activation when comparing cPTSD and BPD. However, when grouping patients based on symptom severity instead on diagnosis, we found that increased symptoms of cPTSD were associated with increased activation of dorsolateral prefrontal cortex during reward rejection, whereas increased symptoms of BPD were associated with decreased activation in prefrontal and limbic regions during reward rejection with distracting negative emotional stimuli. ConclusionThis is the first study to investigate and compare emotional processing and reward-based decision making in cPTSD and BPD. Although we found no neural differences between disorders, we identified symptom-related neural patterns. Specifically, we found that elevated cPTSD symptoms were related to greater sensitivity to reward stimuli, whereas heightened BPD symptoms were related to increased susceptibility to emotional stimuli during goal-directed decision making. These findings enhance our understanding of neural pathomechanisms in trauma-related disorders.

HMM for discovering decision-making dynamics using reinforcement learning experiments.

Major depressive disorder (MDD), a leading cause of years of life lived with disability, presents challenges in diagnosis and treatment due to its complex and heterogeneous nature. Emerging evidence indicates that reward processing abnormalities may serve as a behavioral marker for MDD. To measure reward processing, patients perform computer-based behavioral tasks that involve making choices or responding to stimulants that are associated with different outcomes, such as gains or losses in the laboratory. Reinforcement learning (RL) models are fitted to extract parameters that measure various aspects of reward processing (e.g. reward sensitivity) to characterize how patients make decisions in behavioral tasks. Recent findings suggest the inadequacy of characterizing reward learning solely based on a single RL model; instead, there may be a switching of decision-making processes between multiple strategies. An important scientific question is how the dynamics of strategies in decision-making affect the reward learning ability of individuals with MDD. Motivated by the probabilistic reward task within the Establishing Moderators and Biosignatures of Antidepressant Response in Clinical Care (EMBARC) study, we propose a novel RL-HMM (hidden Markov model) framework for analyzing reward-based decision-making. Our model accommodates decision-making strategy switching between two distinct approaches under an HMM: subjects making decisions based on the RL model or opting for random choices. We account for continuous RL state space and allow time-varying transition probabilities in the HMM. We introduce a computationally efficient Expectation-maximization (EM) algorithm for parameter estimation and use a nonparametric bootstrap for inference. Extensive simulation studies validate the finite-sample performance of our method. We apply our approach to the EMBARC study to show that MDD patients are less engaged in RL compared to the healthy controls, and engagement is associated with brain activities in the negative affect circuitry during an emotional conflict task.

Dissociable Representations of Decision Variables within Subdivisions of the Macaque Orbital and Ventrolateral Frontal Cortex.

The ventral frontal cortex (VFC) in macaques is involved in many affective and cognitive processes and has a key role in flexibly guiding reward-based decision-making. VFC is composed of a set of anatomically distinct subdivisions that are within the orbitofrontal cortex, ventrolateral prefrontal cortex, and anterior insula. In part, because prior studies have lacked the resolution to test for differences, it is unclear if neural representations related to decision-making are dissociable across these subdivisions. Here we recorded the activity of thousands of neurons within eight anatomically defined subdivisions of VFC in male macaque monkeys performing a two-choice probabilistic task for different fruit juice outcomes. We found substantial variation in the encoding of decision variables across these eight subdivisions. Notably, ventrolateral Area 12l was unique relative to the other areas that we recorded from as the activity of single neurons integrated multiple attributes when monkeys evaluated the different choice options. Activity within Area 12o, in contrast, more closely represented reward probability and whether reward was received on a given trial. Orbitofrontal Area 11m/l contained more specific representations of the quality of the outcome that could be earned later on. We also found that reward delivery encoding was highly distributed across all VFC subdivisions, while the properties of the reward, such as its flavor, were more strongly represented in Areas 11m/l and 13m. Taken together, our work reveals the diversity of encoding within the various anatomically distinct subdivisions of VFC in primates.

Reward-Related Brain Activity Mediates the Relationship Between Decision-Making Deficits and Pediatric Depression Symptom Severity

BackgroundThe mechanisms that link neural and behavioral indices of reduced reward sensitivity in depression, particularly in children, remain unclear. Reward positivity (RewP), a neural index of reward processing, has been consistently associated with depression. Separately, recent studies using the drift-diffusion model on behavioral data have delineated computational indices of reward sensitivity. Therefore, in the current study, we examined whether RewP is a neural mediator of drift-diffusion model–based indices of reward processing in predicting pediatric depression across varying levels of symptom severity. MethodsA community sample of 166 girls, ages 8 to 14 years, completed 2 tasks. The first was a reward guessing task from which RewP was computed using electroencephalography; the second was a probabilistic reward-based decision-making task. On this second task, drift-diffusion model analysis was applied to behavioral data to quantify the efficiency of accumulating reward-related evidence (drift rate) and potential baseline bias (starting point) toward the differently rewarded choices. Depression severity was measured using the self-report Children’s Depression Inventory. ResultsRewP was correlated with drift rate, but not starting point bias, toward the more rewarded choice. Furthermore, RewP completely mediated the association between a slower drift rate toward the more rewarded option and higher depression symptom severity. ConclusionsOur findings suggest that reduced neural sensitivity to reward feedback may be a neural mechanism that underlies behavioral insensitivity to reward in children and adolescents with higher depression symptom severity, offering novel insights into the relationship between neural and computational indices of reward processing in this context.

Expression of Chemokine Ligands cxcl12a and cxcl12b in the Habenular Region in Danio rerio (zebrafish)

The habenula (Hb) is a bilateral cluster of neurons in the forebrain. The interpeduncular nucleus (IPN) is an important component of the midbrain. Together, they make up the Hb-IPN conduction system. This system plays an important role in sleep, reward-based decision making, and various other behaviors and processes. These important structures are found in all vertebrates, but the understanding of the development of this pathway is in the preliminary stages. Previous studies in zebrafish show that chemokine signaling plays an important role in Hb axonal outgrowth. Chemokine (c-x-c) motif receptor 4b (Cxcr4b), which is made in the dorsal habenula (dHb), helps direct axons toward the IPN. Cxcl12a and Cxcl12b are the two ligands in this signaling pathway, which offer guidance cues to dHb axons, though their functions are not yet entirely clear. cxcl12a mutants show dysfunctional dHb axonal projections, with many axons projecting anteriorly, in the opposite direction of the IPN. Mutants with ectopic cxcl12b expression show similar results. Dorsal views show cxcl12a and cxcl12b are both transcribed in regions posterior to the dHb; cxcl12b is also transcribed anterior to the dHb. However, the relative expression patterns of these ligands is unknown, and may give us a clearer understanding of their respective functions in directing dHb axons. To do this, we will employ in situ hybridization, which will allow us to simultaneously visualize where cxcl12a and cxcl12b are being transcribed along the path of the developing dHb axons.

Reward-Based Decision-Making in Depression or At-Risk Population

This paper discussed the recent studies on the behavioral and neural patterns of individuals with depression and those with familial risk in reward-based decision-making. Current theories for depression and reward-based decision-making were presented so that they can pave the way for investigation of the interaction between the two under scrutiny. The paper argues that depression influences individuals’ aspects of reward-based decision-making, including thinking strategies, flexibility, reward perceptions, and motivation. At-risk populations inherited the same patterns. According to the empirical studies from recent years, results mainly support the argument. Both clinical and at-risk groups have conservative thinking strategies, inflexibility in demanding situations, and lower perceived reward salience. Furthermore, at-risk populations can obtain the same reward amount even though their neural signals indicate a diminishing reward salience. Future studies, such as longitudinal studies to scrutinize the effect of depression on clinical and at-risk populations, should seek insight into the long-term impact. Moreover, in the future, more studies should investigate the critical period for at-risk populations adopting inflexible thinking patterns so that clinicians can prevent depression in time.

Predictions about reward outcomes in rhesus monkeys.

Human infants and nonhuman animals respond to surprising events by looking longer at unexpected than expected situations. These looking responses provide core cognitive evidence that nonverbal minds make predictions about possible outcomes and detect when these predictions fail to match reality. We propose that this phenomenon has crucial parallels with the processes of reward prediction error, indexing the difference between expected and actual reward outcomes. Most work on reward prediction errors to date involves neurobiological techniques that cannot be implemented in many relevant populations, so we developed a novel behavioral task to assess monkeys' predictions about reward outcomes using looking time responses. In Study 1, we tested how semi-free-ranging monkeys (n = 210) responded to positive error (more rewards than expected), negative error (less rewards than expected), and a number control. We found that monkeys looked longer at a given reward when it was unexpectedly large or small, compared to when the same quantity was expected. In Study 2, we compared responses in the positive error condition in monkeys ranging from infancy to old age (n = 363), to assess lifespan changes in sensitivity to reward predictions. We found that adolescent monkeys showed heightened responses to unexpected rewards, similar to patterns seen in humans, but showed no changes during aging. These results suggest that monkeys' looking responses can be used to track their predictions about rewards, and that monkeys share some developmental signatures of reward sensitivity with humans, providing a new approach to access cognitive processes underlying reward-based decision making. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Corrective feedback guides human perceptual decision-making by informing about the world state rather than rewarding its choice.

Corrective feedback received on perceptual decisions is crucial for adjusting decision-making strategies to improve future choices. However, its complex interaction with other decision components, such as previous stimuli and choices, challenges a principled account of how it shapes subsequent decisions. One popular approach, based on animal behavior and extended to human perceptual decision-making, employs "reinforcement learning," a principle proven successful in reward-based decision-making. The core idea behind this approach is that decision-makers, although engaged in a perceptual task, treat corrective feedback as rewards from which they learn choice values. Here, we explore an alternative idea, which is that humans consider corrective feedback on perceptual decisions as evidence of the actual state of the world rather than as rewards for their choices. By implementing these "feedback-as-reward" and "feedback-as-evidence" hypotheses on a shared learning platform, we show that the latter outperforms the former in explaining how corrective feedback adjusts the decision-making strategy along with past stimuli and choices. Our work suggests that humans learn about what has happened in their environment rather than the values of their own choices through corrective feedback during perceptual decision-making.

Visualizing risky situations induces a stronger neural response in brain areas associated with mental imagery and emotions than visualizing non-risky situations.

In an fMRI study, we tested the prediction that visualizing risky situations induces a stronger neural response in brain areas associated with mental imagery and emotions than visualizing non-risky and more positive situations. We assumed that processing mental images that allow for "trying-out" the future has greater adaptive importance for risky than non-risky situations, because the former can generate severe negative outcomes. We identified several brain regions that were activated when participants produced images of risky situations and these regions overlap with brain areas engaged in visual, speech, and movement imagery. We also found that producing images of risky situations, in contrast to non-risky situations, was associated with increased neural activation in the insular cortex and cerebellum-the regions involved, among other functions, in emotional processing. Finally, we observed an increased BOLD signal in the cingulate gyrus associated with reward-based decision making and monitoring of decision outcomes. In summary, risky situations increased neural activation in brain areas involved in mental imagery, emotional processing, and decision making. These findings imply that the evaluation of everyday risky situations may be driven by emotional responses that result from mental imagery.

Dopamine and glutamate regulate striatal acetylcholine in decision-making

Striatal dopamine and acetylcholine are essential for the selection and reinforcement of motor actions and decision-making1. In vitro studies have revealed an intrastriatal circuit in which acetylcholine, released by cholinergic interneurons (CINs), drives the release of dopamine, and dopamine, in turn, inhibits the activity of CINs through dopamine D2 receptors (D2Rs). Whether and how this circuit contributes to striatal function in vivo is largely unknown. Here, to define the role of this circuit in a living system, we monitored acetylcholine and dopamine signals in the ventrolateral striatum of mice performing a reward-based decision-making task. We establish that dopamine and acetylcholine exhibit multiphasic and anticorrelated transients that are modulated by decision history and reward outcome. Dopamine dynamics and reward encoding do not require the release of acetylcholine by CINs. However, dopamine inhibits acetylcholine transients in a D2R-dependent manner, and loss of this regulation impairs decision-making. To determine how other striatal inputs shape acetylcholine signals, we assessed the contribution of cortical and thalamic projections, and found that glutamate release from both sources is required for acetylcholine release. Altogether, we uncover a dynamic relationship between dopamine and acetylcholine during decision-making, and reveal multiple modes of CIN regulation. These findings deepen our understanding of the neurochemical basis of decision-making and behaviour.

Effects of Adult Age and Functioning of the Locus Coeruleus Norepinephrinergic System on Reward-Based Learning.

Age-related impairments in value representations and updating during decision-making and reward-based learning are often related to age-related attenuation in the catecholamine system such as dopamine (DA) and norepinephrine (NE). However, it is unclear to what extent age-related declines in NE functioning in humans affect reward-based decision-making. We conducted a probabilistic decision-making task and applied a Q-learning model to investigate participants' anticipatory values and value sensitivities. Task-related pupil dilations and locus coeruleus (LC) magnetic resonance imaging (MRI) contrast, which served as a potential window of the LC-NE functions, were assessed in younger and older adults. Results showed that in both choice and feedback phases, younger adults' (N = 42, 22 males) pupil dilations negatively correlated with anticipatory values, indicating uncertainty about outcome probabilities. Uncertainty-evoked pupil dilations in older adults (N = 41, 27 males) were smaller, indicating age-related impairments in value estimation and updating. In both age groups, participants who showed a larger uncertainty-evoked pupil dilation exhibited a higher value sensitivity as reflected in the β parameter of the reinforcement Q-learning model. Furthermore, older adults (N = 34, 29 males) showed a lower LC-MRI contrast than younger adults (N = 25, 15 males). The LC-MRI contrast positively correlated with value sensitivity only in older but not in younger adults. These findings suggest that task-related pupillary responses can reflect age-related deficits in value estimation and updating during reward-based decision-making. Our evidence with the LC-MRI contrast further showed the age-related decline of the LC structure in modulating value representations during reward-based learning.SIGNIFICANCE STATEMENT Age-related impairments in value representation and updating during reward-based learning are associated with declines in the catecholamine modulation with age. However, it is unclear how age-related declines in the LC-NE system may affect reward-based learning. Here, we show that compared with younger adults, older adults exhibited reduced uncertainty-induced pupil dilations, suggesting age-related deficits in value estimation and updating. Older adults showed a lower structural MRI of the LC contrast than younger adults, indicating age-related degeneration of the LC structure. The association between the LC-MRI contrast and value sensitivity was only observed in older adults. Our findings may demonstrate a pioneering model to unravel the role of the LC-NE system in reward-based learning in aging.

Enhanced decision-making in nicotine dependent individuals who abstain: A computational analysis using Hierarchical Drift Diffusion Modeling

BackgroundVariability in decision-making capacity and reward responsiveness may underlie differences in the ability to abstain from smoking. Computational modeling of choice behavior, as with the Hierarchical Drift Diffusion Model (HDDM), can help dissociate reward responsiveness from underlying components of decision-making. Here we used the HDDM to identify which decision-making or reward-related parameters, extracted from data acquired in a reward processing task, contributed to the ability of people who smoke that are not seeking treatment to abstain from cigarettes during a laboratory task. Methods80 adults who smoke cigarettes completed the Probabilistic Reward Task (PRT) - a signal detection task with a differential reinforcement schedule - following smoking as usual, and the Relapse Analogue Task (RAT) - a task in which participants could earn money for delaying smoking up to 50min - after a period of overnight abstinence. Two cohorts were defined by the RAT; those who waited either 0-min (n=36) or the full 50-min (n=44) before smoking. ResultsPRT signal detection metrics indicated all subjects learned the task contingencies, with no differences in response bias or discriminability between the two groups. However, HDDM analyses indicated faster drift rates in 50-min vs. 0-min waiters. ConclusionsRelative to those who did not abstain, computational modeling indicated that people who abstained from smoking for 50min showed faster evidence accumulation during reward-based decision-making. These results highlight the importance of decision-making mechanisms to smoking abstinence, and suggest that focusing on the evidence accumulation process may yield new targets for treatment.

Erotic cue exposure increases physiological arousal, biases choices toward immediate rewards, and attenuates model-based reinforcement learning.

Computational psychiatry focuses on identifying core cognitive processes that appear altered across distinct psychiatric disorders. Temporal discounting of future rewards and model-based control during reinforcement learning have proven as two promising candidates. Despite its trait-like stability, temporal discounting may be at least partly under contextual control. Highly arousing cues were shown to increase discounting, although evidence to date remains somewhat mixed. Whether model-based reinforcement learning is similarly affected by arousing cues remains unclear. Here, we tested cue-reactivity effects (erotic pictures) on subsequent temporal discounting and model-based reinforcement learning in a within-subjects design in n = 39 healthy heterosexual male participants. Self-reported and physiological arousal (cardiac activity and pupil dilation) were assessed before and during cue exposure. Arousal was increased during exposure of erotic versus neutral cues both on the subjective and autonomic level. Erotic cue exposure increased discounting as reflected by more impatient choices. Hierarchical drift diffusion modeling (DDM) linked increased discounting to a shift in the starting point bias of evidence accumulation toward immediate options. Model-based control during reinforcement learning was reduced following erotic cues according to model-agnostic analysis. Notably, DDM linked this effect to attenuated forgetting rates of unchosen options, leaving the model-based control parameter unchanged. Our findings replicate previous work on cue-reactivity effects in temporal discounting and for the first time show similar effects in model-based reinforcement learning in a heterosexual male sample. This highlights how environmental cues can impact core human decision processes and reveal that comprehensive modeling approaches can yield novel insights in reward-based decision processes.

Secondary outcomes and qualitative findings of an open-label feasibility trial of lisdexamfetamine dimesylate for adults with bulimia nervosa

BackgroundThere is emerging evidence that stimulants warrant further investigation as a treatment for bulimia nervosa (BN) including a recent open-label feasibility trial examining the use of lisdexamfetamine dimestylate (LDX) for BN. The current report presents the secondary outcomes and qualitative interview results from that feasibility trial. These outcomes explore several purported mechanisms that may explain how stimulants affect symptoms of BN: appetite, impulsivity, obsessive and compulsive symptoms, eating disorder psychopathology/impairment and reward-based decision-making.MethodsTwenty-three participants with BN received LDX for eight weeks. Questionnaires assessing appetite, impulsivity, obsessive and compulsive symptoms, eating disorder psychopathology and impairment were administered at baseline and post-treatment. Participants also completed a two-step reinforcement learning task to assess their decision-making. Semi-structured interviews took place at baseline, week 5, and follow-up.ResultsReductions in hunger, food-related impulsivity, obsessive and compulsive features, eating disorder psychopathology and impairment were found. However, reward learning, as far as it is assessed by the task, did not seem to contribute to the effect of LDX on BN symptoms. Qualitative analysis suggested four themes: (1) reprieve from the eating disorder, (2) improvement in function and quality of life, (3) renewed hope for recovery, and (4) ability to normalize eating.ConclusionsThis report suggests several potential mechanisms by which LDX may reduce symptoms of binging and purging in those with BN. Importantly, due to the open-label design, we are unable to attribute findings to the medication. Instead, our results should be interpreted as hypothesis generating to inform future studies such as adequately powered randomized controlled trials.Trial registration NCT03397446.

How Obstructed Action Efficacy Impacts Reward-Based Decision Making in Adolescent Depression: An fMRI Study

Disruption of reward seeking behavior by unforeseen obstacles can promote negative affect, including frustration and irritability, in adolescents. Repeated experiences of obstructed reward may in fact contribute to the development of depression in adolescents. However, the neurocognitive mechanisms whereby goal disruption impacts reward processing in adolescent depression have not yet been characterized. The present study addresses this gap using neuroimaging and a novel paradigm to assess how incidental action obstruction impacts reward-based decision-making. We assessed 62 unmedicated adolescents with Major Depressive Disorder (MDD; mean age=15.6, SD=1.4, 67% female participants) and 68 matched healthy control participants (mean age=15.3, SD=1.4, 50% female participants) using functional magnetic resonance imaging (fMRI) while they played a card game in which they had to guess between two options to earn points, in low- and high-stake conditions. Functioning of button presses through which they made decisions was intermittently blocked, thereby blocking action efficacy. Participants with MDD made fewer button press repetitions in response to action efficacy obstruction, which was more apparent in the low-stake condition (Rate Ratio =0.85, p=0.034). During response repetition across stake conditions, MDDs exhibited higher activation in regions in the ventromedial prefrontal cortex, caudate, and putamen (F(1,125)= 16.4-25.6, df=1,125; ps<0.001; Hedges' g=0.85-0.98). Adolescent with depression tend to exhibit less flexible behavioral orientation in the face of blocked action efficacy, and abnormalities in neural systems critical to regulating negative affect during reward-based decision-making. This research highlights possible mechanisms relevant to understanding and treating affective dysregulation in adolescent depression.

Aging-related changes in reward-based decision-making depend on punishment frequency: An fMRI study.

Aging is often accompanied by significant cognitive decline and altered decision making. Previous studies have found that older adults have difficulty in processing reward/risk information, leading to suboptimal decision strategy. However, it is still under investigated about the neural substrates of risky decision-making under ambiguity in aging. Using the Iowa Gambling Task, the current study investigated inter-individual differences of risk-taking behaviors in healthy older adults with task-related functional magnetic resonance imaging. It was found that participants were able to improve their decisions in advantageous decks, but failed to avoid disadvantageous decks during task performance. The task-related activations within multiple brain regions were observed significantly different across the four decks, and showed negative correlations with age in disadvantageous decks but not in advantageous decks. Consistently, age-related whole brain analyses confirmed the negative age-effect on brain activations in disadvantageous decks, especially in high punishment frequency. In addition, the relationship between age and task performance in high punishment frequency was mediated by activation in the frontal subregions such as the middle frontal cortex and superior medial frontal cortex. Our findings shed light on the neural substrates of altered risk-taking behaviors in aging, suggesting a greater sensitivity to high punishment frequency in older adults.

Evaluating the neural substrates of effort-expenditure for reward in adults with major depressive disorder and obesity

Converging evidence has suggested that disturbances in monetary reward processing may subserve the shared biosignature between major depressive disorder (MDD) and obesity. However, there remains a paucity of studies that have evaluated the deficits in specific subcomponents of reward functioning in populations with MDD and obesity comorbidity. We evaluated the association between effort-expenditure for monetary reward and neural activation in regions associated with reward-based decision making (i.e., the caudate nucleus, anterior cingulate cortex (ACC) and hippocampus) in people with MDD and obesity comorbidity. We acquired structural and functional magnetic resonance imaging (fMRI) in 12 participants and performed a spherical region-of-interest analysis (ROI) using previously defined peak MNI coordinates. A one-sample t-test was employed to compare ROI-specific blood-oxygen-level-dependent (BOLD) signal change during the task choice selection window (i.e., high-effort vs. low-effort task) of the effort-expenditure for reward task (EEfRT). We observed no change in activation of the caudate nucleus, ACC or hippocampus in participants with increased BMI when contrasting the high effort > low effort reward magnitude condition for the EEfRT. The findings from our exploratory study evaluated the disturbances in fundamental reward processes, including cost-benefit decision making, in people MDD and obesity. Future studies should further investigate this relationship with a larger sample size.

Role of serotonin in modulation of decision-making in Parkinson's disease.

Dysfunction of dopaminergic pathways has been considered to play a pivotal role in Parkinson's disease (PD), affecting the processing of emotional and rewarding information, and potentially leading to symptoms of depression or apathy. However, some aspects of motivation in PD might be affected by non-dopaminergic mechanisms. The objective of this experimental medicine study was to investigate the contribution of serotonergic modulation via administration of citalopram (20 mg) for 7 days on motivated decision-making in twenty PD patients, measured using several different computerised tasks and clinical questionnaires that probe different aspects of decision-making. Twenty healthy controls were additionally tested without medication to assess any baseline differences between the two groups. Results indicated that PD patients were overall less motivated than controls on an effort- and reward-based decision-making task. Citalopram increased or decreased willingness to exert effort for reward, depending on whether baseline motivation was high or low, respectively. A task assessing decision-making under risk revealed higher levels of risk aversion for potential losses in PD patients, which neither serotonin nor the patient's regular dopaminergic medication seemed to restore. However, citalopram in PD was associated with more risk-seeking choices for gains, although patients and controls did not differ on this at baseline. The results provide evidence for a role of the serotonergic system in influencing some aspects of motivated decision-making in PD processes.

A neurocognitive perspective on the relationship between exercise and reward: Implications for weight management and drug addiction

The impact of exercise on food reward is increasingly being discussed as an interplay between executive function (EF), homeostasis and mechanisms promoting or undermining intentional behaviour change. Integrating current knowledge of neurocognitive processes encompassing cognitive and affective networks within an energy balance framework will provide a more comprehensive account. Reward circuitry affected by recreational drugs and food overlap. Therefore the underlying processes explaining changes in drug-taking behaviour may offer new insights into how exercise affects the reward value of recreational drugs and food. EF is important for successful self-regulation, and training EF may boost inhibitory control in relation to food- and drug-related reward. Preclinical and clinical observations suggest that reward-seeking can transfer within and between categories of reward. This may have clinical implications beyond exercise improving metabolic health in people with obesity to understanding therapeutic responses to exercise in people with neurocognitive deficits in non-food reward-based decision making such as drug dependence.