Abstract

Animals face the dilemma between exploiting known opportunities and exploring new ones, a decision-making process supported by cortical circuits. While different types of learning may bias exploration, the circumstances and the degree to which bias occurs is unclear. We used an instrumental lever press task in mice to examine whether learned rules generalize to exploratory situations and the cortical circuits involved. We first trained mice to press one lever for food and subsequently assessed how that learning influenced pressing of a second novel lever. Using outcome devaluation procedures we found that novel lever exploration was not dependent on the food value associated with the trained lever. Further, changes in the temporal uncertainty of when a lever press would produce food did not affect exploration. Instead, accrued experience with the instrumental contingency was strongly predictive of test lever pressing with a positive correlation between experience and trained lever exploitation, but not novel lever exploration. Chemogenetic attenuation of orbital frontal cortex (OFC) projection into secondary motor cortex (M2) biased novel lever exploration, suggesting that experience increases OFC-M2 dependent exploitation of learned associations but leaves exploration constant. Our data suggests exploitation and exploration are parallel decision-making systems that do not necessarily compete.

Highlights

  • The concepts of exploration and exploitation have been widely studied with focus on the competition between these two processes[1,2]

  • Structural plasticity of orbital frontal cortex (OFC) projections into M2 (OFC-M2) correlates with rule learning27 – bouton gain correlates with rule learning and subsequent exploitation, while bouton loss correlates with exploration

  • Response requirement increased across training, with random interval (RI) schedules progressing from RI 30 s to RI 60 s, and RR10 progressing to RR20 after two days of schedule training (Fig. 1a)

Read more

Summary

Introduction

The concepts of exploration and exploitation have been widely studied with focus on the competition between these two processes[1,2]. We used a self-paced operant instrumental lever press task in mice to determine if exploration utilizes learned rules and the extent to which exploration and exploitation directly compete. In this task[28,29,30], mice are trained to press one lever for a food reward. Different schedules of reinforcement can be used to bias either exploitation of the trained lever or exploration of the novel lever[28,29] Previous studies using this particular task have hypothesized that responding reflects either exploration[28,30] or action generalization mechanisms[29], though this has not been tested

Methods
Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call