Risk aversion in expected intertemporal discounted utilities bandit problems

Abstract

We consider a situation where an individual is facing an uncertain situation, but may costly alter his knowledge of the uncertainties. We study in this context how risk aversion may modify the individual search behavior. We consider a one-armed bandit problem (where one arm is safe and the other is risky) and study how the agent risk aversion can change the sequence of arms selected. The main result is that when the utility function is more concave, the agent has more chances to select the safe arm. We also discuss how search is affected by risk aversion.