Reward In Orbitofrontal Cortex Research Articles

Identity-Specific Reward Representations in Orbitofrontal Cortex Are Modulated by Selective Devaluation.

Goal-directed behavior is sensitive to the current value of expected outcomes. This requires independent representations of specific rewards, which have been linked to orbitofrontal cortex (OFC) function. However, the mechanisms by which the human brain updates specific goals on the fly, and translates those updates into choices, have remained unknown. Here we implemented selective devaluation of appetizing food odors in combination with pattern-based neuroimaging and a decision-making task. We found that in a hungry state, participants chose to smell high-intensity versions of two value-matched food odor rewards. After eating a meal corresponding to one of the two odors, participants switched choices toward the low intensity of the sated odor but continued to choose the high intensity of the nonsated odor. This sensory-specific behavioral effect was mirrored by pattern-based changes in fMRI signal in lateral posterior OFC, where specific reward identity representations were altered after the meal for the sated food odor but retained for the nonsated counterpart. In addition, changes in functional connectivity between the OFC and general value coding in ventromedial prefrontal cortex (vmPFC) predicted individual differences in satiety-related choice behavior. These findings demonstrate how flexible representations of specific rewards in the OFC are updated by devaluation, and how functional connections to vmPFC reflect the current value of outcomes and guide goal-directed behavior.SIGNIFICANCE STATEMENT The orbitofrontal cortex (OFC) is critical for goal-directed behavior. A recent proposal is that OFC fulfills this function by representing a variety of state and task variables ("cognitive maps"), including a conjunction of expected reward identity and value. Here we tested how identity-specific representations of food odor reward are updated by satiety. We found that fMRI pattern-based signatures of reward identity in lateral posterior OFC were modulated after selective devaluation, and that connectivity between this region and general value coding ventromedial prefrontal cortex (vmPFC) predicted choice behavior. These results provide evidence for a mechanism by which devaluation modulates a cognitive map of expected reward in OFC and thereby alters general value signals in vmPFC to guide goal-directed behavior.

Identity-specific coding of future rewards in the human orbitofrontal cortex

Nervous systems must encode information about the identity of expected outcomes to make adaptive decisions. However, the neural mechanisms underlying identity-specific value signaling remain poorly understood. By manipulating the value and identity of appetizing food odors in a pattern-based imaging paradigm of human classical conditioning, we were able to identify dissociable predictive representations of identity-specific reward in orbitofrontal cortex (OFC) and identity-general reward in ventromedial prefrontal cortex (vmPFC). Reward-related functional coupling between OFC and olfactory (piriform) cortex and between vmPFC and amygdala revealed parallel pathways that support identity-specific and -general predictive signaling. The demonstration of identity-specific value representations in OFC highlights a role for this region in model-based behavior and reveals mechanisms by which appetitive behavior can go awry.

Willingness to Wait and Altered Encoding of Time-Discounted Reward in the Orbitofrontal Cortex with Normal Aging

Normal aging has been associated with cognitive changes, including shifts in responding for time-discounted rewards. The orbitofrontal cortex, an area previously associated with aging-related cognitive changes, is critical for normal discounting. Previously we have shown in a choice task that rats prefer immediate over delayed reward and that neural representations of delayed reward in orbitofrontal cortex were attenuated, whereas immediate reward elicited strong responses. Changes in choice performance were correlated with changes in firing rate in orbitofrontal neurons, suggesting that these reward representations were critical to the rats' ability to wait for reward. Here we asked whether age-dependent changes in discounting behavior were related to changes in the representation of delayed reward in the orbitofrontal cortex. Young (3-6 months) and aged (22-26 months) rats were trained on the same discounting paradigm used previously. We found that aged rats showed less sensitivity to increasing delay preceding reward delivery, shifting behavior away from the delayed reward more slowly than younger rats. This sensitivity was specific to delay, since choice performance did not differ between the two groups when delay was held constant and reward size varied. Aged rats exhibited a corresponding increase in the prevalence of neurons that fired more strongly for delayed reward. Again this change was specific to delay; there was no change in encoding of different-sized rewards. These results suggest that natural aging results in altered representations of reward in orbitofrontal cortex. These changes may relate to the increased ability to delay gratification and reduced impulsivity associated with aging.

Should I stay or should I go? Transformation of time-discounted rewards in orbitofrontal cortex and associated brain circuits.

Animals prefer a small, immediate reward over a larger delayed reward (time discounting). Lesions of the orbitofrontal cortex (OFC) can either increase or decrease the breakpoint at which animals abandon the large delayed reward for the more immediate reward as the delay becomes longer. Here we argue that the varied effects of OFC lesions on delayed discounting reflect two different patterns of activity in OFC; one that bridges the gap between a response and an outcome and another that discounts delayed reward. These signals appear to reflect the spatial location of the reward and/or the action taken to obtain it, and are encoded independently from representations of absolute value. We suggest a dual role for output from OFC in both discounting delayed reward, while at the same time supporting new learning for them.

Encoding of Time-Discounted Rewards in Orbitofrontal Cortex Is Independent of Value Representation

We monitored single-neuron activity in the orbitofrontal cortex of rats performing a time-discounting task in which the spatial location of the reward predicted whether the delay preceding reward delivery would be short or long. We found that rewards delivered after a short delay elicited a stronger neuronal response than those delivered after a long delay in most neurons. Activity in these neurons was not influenced by reward size when delays were held constant. This was also true for a minority of neurons that exhibited sustained increases in firing in anticipation of delayed reward. Thus, encoding of time-discounted rewards in orbitofrontal cortex is independent of the encoding of absolute reward value. These results are contrary to the proposal that orbitofrontal neurons signal the value of delayed rewards in a common currency and instead suggest alternative proposals for the role this region plays in guiding responses for delayed versus immediate rewards.