Abstract
The pedunculopontine tegmental nucleus (PPTg) in the brainstem plays a role in controlling reinforcement learning and executing conditioned behavior. We previously examined the activity of PPTg neurons in monkeys during a reward-conditioned, visually guided saccade task, and reported that a population of these neurons exhibited tonic responses throughout the task period. These tonic responses might depend on prediction of the upcoming reward, successful execution of the task, or both. Here, we sought to further distinguish these factors and to investigate how each contributes to the tonic neuronal activity of the PPTg. In our normal visually guided saccade task, the monkey initially fixated on the central fixation target (FT), then made saccades to the peripheral saccade target and received a juice reward after the saccade target disappeared. Most of the tonic activity terminated shortly after the reward delivery, when the monkey broke fixation. To distinguish between reward and behavioral epochs, we then changed the task sequence for a block of trials, such that the saccade target remained visible after the reward delivery. Under these visible conditions, the monkeys tended to continue fixating on the saccade target even after the reward delivery. Therefore, the prediction of the upcoming reward and the end of an individual trial were separated in time. Regardless of the task conditions, half of the tonically active PPTg neurons terminated their activity around the time of the reward delivery, consistent with the view that PPTg neurons might send reward prediction signals until the time of reward delivery, which is essential for computing reward prediction error in reinforcement learning. On the other hand, the other half of the tonically active PPTg neurons changed their activity dependent on the task condition. In the normal condition, the tonic responses terminated around the time of the reward delivery, while in the visible condition, the activity continued until the disappearance of the saccade target (ST) after reward delivery. Thus, for these neurons, the tonic activity might be related to maintaining attention to complete fixation behavior. These results suggest that, in addition to the reward value information, some PPTg neurons might contribute to the execution of conditioned task behavior.
Highlights
Humans and other animals select and execute appropriate behavior moment by moment, based on the prediction of the upcoming reward
We previously reported that a population of PPTg neurons exhibited tonic responses throughout the task period of a conditioning task, and some of them showed a significant dependency on the magnitude of the predicted reward (Okada et al, 2009)
This property of the signal matches that of the reward prediction signal that is necessary for the computation of reward prediction error as represented by dopaminergic neurons
Summary
Humans and other animals select and execute appropriate behavior moment by moment, based on the prediction of the upcoming reward In this context, when we obtain or loose a reward, we must acquire and renew our behavioral policy. We previously reported that a population of PPTg neurons exhibited tonic responses throughout the task period of a conditioning task, and some of them showed a significant dependency on the magnitude of the predicted reward (Okada et al, 2009). This property of the signal matches that of the reward prediction signal that is necessary for the computation of reward prediction error as represented by dopaminergic neurons. To clarify the functional significance of tonic activity for behavior and learning, we examined individual, tonically active PPTg neurons during two task conditions that distinguished between reward and behavioral epochs
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.