A neurologically plausible implementation of statistical inference applied to random dot motion

Abstract

We propose a model of basic motion perception consisting of a hierarchical non-linear state space model (NSSM) developed within a variational Bayesian (VB) framework. Each level of the hierarchy is a `cause' that generates a prior distribution on the level below via a generative function. The temporal dynamics and generative functions between layers of the hierarchy are implemented as neural networks with non-linear activation functions. Optimization of model parameters and causes proceed concurrently as a combination of fixed-point rules and gradient decent schemes. To make the optimization problem tractable, the standard mean-field and Laplace approximations are employed. The precise factoring used in the mean-field approximation is designed to meet a balance between tractability, neurological plausibility and modeling power. In this approach inference and learning proceed concurrently, in an online and unsupervised fashion. Other work has produced similar implementations of NSSMs that have been successful in predicting low-dimensional temporal signals, but with highly restrictive assumptions on the form of the posterior distributions and with learning done in batches instead of online [1]. Competing work has relaxed many of these implementation assumptions and achieved prediction of high dimensional input but at the cost of discarding VB techniques in favor of inefficient discrete state-space methods [2]. Moreover, such techniques have been demonstrated only with pre-learned weights and simplistic statistical models. Our model is primarily tested on realistic high-dimensional input generated by randomly moving dots over a detection grid. The results from a spiking neuron implementation of the model based on the Neural Engineering Framework (NEF) are compared directly to single cell recordings in random dot motion perception and decision-making tasks.