Event Abstract Back to Event Modeling managment of access to working memory as a self-evalution process for intrinsically motiveted prediction. Catherine Wacongne1, 2*, Stanislas Dehaene1, 2 and Jean-Pierre Changeux3 1 INSERM , U992, Cognitive Neuroimaging Unit, France 2 Collège de France, France 3 Pasteur Institute, CNRS URA 2182, France Working memory offers the unique possibility to maintain information during an arbitrary long time. However, this possibility comes with the constraint that the number of items that can be maintained this way is very limited. This situation creates a computational problem of optimizing working memory content by choosing appropriately which items should be maintained and which items should be discarded. Previous work by O'Reilly (O'Reilly & Frank, 2006) showed that a reinforcement learning scheme could allow training of a basal ganglia dependent gating mechanism to successfully manage working memory content in order to complete diverse tasks. The predictive coding framework, proposes that one of the intrinsic purpose of the brain is the prediction of future events. Data (Bekinschtein et al., 2009) suggests that the involvment of working memory can be crucial, even in the absence of an explicit task to discover long distance temporal dependencies. We studied a simplified version of the working memory management problem by reducing working memory capacity to one slot. We show that using a value system that is sensitive to prediction accuracy, and a reinforcement learning algorithm, the brain can use self-evaluation to learn a successful gating policy to control the access to its working memory slot and optimize predictions. Specifically, we studied the performance of this value based working memory access (vbWMA) model on simple sequences of stimuli whose probability of occurrence was chosen independently of the past, except for one long distance predictive relation. The vbWMA model was able to learn to store the predictive stimulus for the appropriate duration. The dynamics of policy discovery was non-linear. Comparison with other models shows that this strategy offers an excellent trade-off between final performance and learning time. We also show that the vbWMA develops appropriate strategies in more complex situations with multiple long distance dependencies. Keywords: Dopamine, reinforcement learning, working memory, Gating, predictive coding, Self evaluation, self guided behavior Conference: XII International Conference on Cognitive Neuroscience (ICON-XII), Brisbane, Queensland, Australia, 27 Jul - 31 Jul, 2014. Presentation Type: Oral Presentation Topic: Memory and Learning Citation: Wacongne C, Dehaene S and Changeux J (2015). Modeling managment of access to working memory as a self-evalution process for intrinsically motiveted prediction.. Conference Abstract: XII International Conference on Cognitive Neuroscience (ICON-XII). doi: 10.3389/conf.fnhum.2015.217.00066 Copyright: The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers. They are made available through the Frontiers publishing platform as a service to conference organizers and presenters. The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated. Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed. For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions. Received: 19 Feb 2015; Published Online: 24 Apr 2015. * Correspondence: Ms. Catherine Wacongne, INSERM, U992, Cognitive Neuroimaging Unit, Gif/Yvette, France, catherine.waco@gmail.com Login Required This action requires you to be registered with Frontiers and logged in. To register or login click here. Abstract Info Abstract The Authors in Frontiers Catherine Wacongne Stanislas Dehaene Jean-Pierre Changeux Google Catherine Wacongne Stanislas Dehaene Jean-Pierre Changeux Google Scholar Catherine Wacongne Stanislas Dehaene Jean-Pierre Changeux PubMed Catherine Wacongne Stanislas Dehaene Jean-Pierre Changeux Related Article in Frontiers Google Scholar PubMed Abstract Close Back to top Javascript is disabled. Please enable Javascript in your browser settings in order to see all the content on this page.
Read full abstract