Abstract

The acknowledged importance of uncertainty in economic decision making has stimulated the search for neural signals that could influence learning and inform decision mechanisms. Current views distinguish two forms of uncertainty, namely risk and ambiguity, depending on whether the probability distributions of outcomes are known or unknown. Behavioural neurophysiological studies on dopamine neurons revealed a risk signal, which covaried with the standard deviation or variance of the magnitude of juice rewards and occurred separately from reward value coding. Human imaging studies identified similarly distinct risk signals for monetary rewards in the striatum and orbitofrontal cortex (OFC), thus fulfilling a requirement for the mean variance approach of economic decision theory. The orbitofrontal risk signal covaried with individual risk attitudes, possibly explaining individual differences in risk perception and risky decision making. Ambiguous gambles with incomplete probabilistic information induced stronger brain signals than risky gambles in OFC and amygdala, suggesting that the brain's reward system signals the partial lack of information. The brain can use the uncertainty signals to assess the uncertainty of rewards, influence learning, modulate the value of uncertain rewards and make appropriate behavioural choices between only partly known options.

Highlights

  • Every day we make decisions about the goals we like to pursue, but we do not even know how the brain processes the simplest parameters that determine our decisions

  • RISK AND AMBIGUITY SIGNALS IN HUMAN BRAIN STRUCTURES (a) Coding of risk The experiments followed the rationale of the recordings from dopamine neurons and used variations in the probability of fixed reward outcomes to assess brain responses to risk separately from reward value

  • We investigated the coding of risk in the card task and aimed to reveal a relatively tonic risk signal similar to that seen in dopamine neurons during the period between stimulus and reward (Preuschoff et al 2006)

Read more

Summary

Explicit neural signals reflecting reward uncertainty

Wolfram Schultz1,2,*, Kerstin Preuschoff 2, Colin Camerer, Ming Hsu, Christopher D. The acknowledged importance of uncertainty in economic decision making has stimulated the search for neural signals that could influence learning and inform decision mechanisms. Behavioural neurophysiological studies on dopamine neurons revealed a risk signal, which covaried with the standard deviation or variance of the magnitude of juice rewards and occurred separately from reward value coding. Human imaging studies identified distinct risk signals for monetary rewards in the striatum and orbitofrontal cortex (OFC), fulfilling a requirement for the mean variance approach of economic decision theory. Ambiguous gambles with incomplete probabilistic information induced stronger brain signals than risky gambles in OFC and amygdala, suggesting that the brain’s reward system signals the partial lack of information. The brain can use the uncertainty signals to assess the uncertainty of rewards, influence learning, modulate the value of uncertain rewards and make appropriate behavioural choices between only partly known options

INTRODUCTION
CONCLUSIONS
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call