Abstract
People and other animals learn the values of choices by observing the contingencies between them and their outcomes. However, decisions are not guided by choice-linked reward associations alone; macaques also maintain a memory of the general, average reward rate – the global reward state – in an environment. Remarkably, global reward state affects the way that each choice outcome is valued and influences future decisions so that the impact of both choice success and failure is different in rich and poor environments. Successful choices are more likely to be repeated but this is especially the case in rich environments. Unsuccessful choices are more likely to be abandoned but this is especially likely in poor environments. Functional magnetic resonance imaging (fMRI) revealed two distinct patterns of activity, one in anterior insula and one in the dorsal raphe nucleus, that track global reward state as well as specific outcome events.
Highlights
People and other animals learn the values of choices by observing the contingencies between them and their outcomes
The positive effects of global reward state (GRS) observed in our study are in line with previous reports of spread of effect[8,11,12,13] and suggest a mechanism by which the assignment of previous rewards to subsequent choices can emerge within an reinforcement learning (RL) framework
The GRS may act a as a proxy for how good the current and expected states of the animal are and this might bias the evaluation of newly encountered options
Summary
People and other animals learn the values of choices by observing the contingencies between them and their outcomes. Negative PEs decrease a choice’s value estimate Implicit in such models is the notion that the experience of choice-reward conjunctions determines choice valuations. We show that in addition to conjunctive choicereward associations, unlinked memories of both choice and reward persist over several trials and influence current and future choices the monkeys take Rewards related to the latter effect – an influence of reward experience that is unlinked to any particular choice – we term global reward state (GRS). It has a striking impact on behavior: Animals stayed increasingly with rewarded choices if those were encountered in high GRS, while they abandoned poor choices when encountered in low GRS.
Published Version (Free)
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have