Stochastic radial basis functions.

Abstract

Stochastic signal processing can implement gaussian activation functions for radial basis function networks, using stochastic counters. The statistics of neural inputs which control the increment and decrement operations of the counter are governed by Bernoulli distributions. The transfer functions relating the input and output pulse probabilities can closely approximate gaussian activation functions which improve with the number of states in the counter. The means and variances of these gaussian approximations can be controlled by varying the output combinational logic function of the binary counter variables.