Event Abstract Back to Event A spiking network model for learning reward timing in cortex The ability to represent time is an essential component of cognition but its neural basis is unknown. Although extensively studied both behaviorally and electrophysiologically, a general theoretical framework describing the elementary neural mechanisms used by the brain to learn temporal representations is lacking. It is commonly believed that the underlying cellular mechanisms reside in high order cortical regions but recent studies show sustained neural activity in primary sensory cortices that can represent the timing of expected reward. In particular, a recent study by Shuler and Bear (2006) has shown learned, reward timing dependent cortical activity in primary visual cortex. We postulate that a network of laterally connected cortical neurons is sufficient for generating the timing dependent neuronal dynamics, that the timing information can be stored within synaptic efficacies, and that this cortical activity can be learned through a novel variant of reinforcement learning. One of the advantages of the theory proposed here is that it does not require specialized processes such as tagged delay lines of phase locked oscillators, as assumed explicitly or implicitly in previous theories of timing. We mathematically formulate the neuronal dynamics and the learning rule, and implement our model computationally both in a rate based implementation and in a model of conductance based spiking neurons. We show that this theory can account for various aspects of the experimental data, but also explore the limitations of this model. We further analyze the spiking neural model using a quasi-steady state mean field theory (e.g: Renart et al, 2003). This analysis reduces the dynamics of the network to a single non-linear dynamical equation. We show that the results of the mean field theory are in close agreement with the simulation results. Our theoretical model can account for existing experimental results, and can also produce novel predictions. We show several such predictions which include change in pair wise correlations as a result of learning, and an increase in spontaneous and evoked activity after learning. Using the original data from the Shuler and Bear (2006) paper we show that the experimental data is consistent with these predictions and that both evoked activity and spontaneous activity are significantly increased by 74% and 40% respectively as a result of training. One prominent experimental feature of temporal interval estimation is the scalar rule (Webber law), which states that the standard deviation of estimation errors increase linearly with the estimated interval. Using a simple population decoding scheme based on the activity of the trained network of spiking neurons we show that this model produces estimation errors that increase approximately linearly with the estimated interval. We explore the origin of these results, and how they compare to experimental findings. Here we present a theory to account for the specific results of Shuler and Bear (2006) which can also form the basis for a general theory of timing estimation in the cortex. We computationally implement and mathematically analyze the theory, and propose experimental tests. We also show here experimental confirmation of some of our theoretical predictions. Conference: Computational and systems neuroscience 2009, Salt Lake City, UT, United States, 26 Feb - 3 Mar, 2009. Presentation Type: Poster Presentation Topic: Poster Presentations Citation: (2009). A spiking network model for learning reward timing in cortex. Front. Syst. Neurosci. Conference Abstract: Computational and systems neuroscience 2009. doi: 10.3389/conf.neuro.06.2009.03.313 Copyright: The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers. They are made available through the Frontiers publishing platform as a service to conference organizers and presenters. The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated. Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed. For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions. Received: 04 Feb 2009; Published Online: 04 Feb 2009. Login Required This action requires you to be registered with Frontiers and logged in. To register or login click here. Abstract Info Abstract The Authors in Frontiers Google Google Scholar PubMed Related Article in Frontiers Google Scholar PubMed Abstract Close Back to top Javascript is disabled. Please enable Javascript in your browser settings in order to see all the content on this page.
Read full abstract