MLP training in a self-organizing state space model using unscented Kalman particle filter

Abstract

Many Bayesian learning approaches to the multi-layer perceptron (MLP) parameter optimization have been proposed such as the extended Kalman filter (EKF). This paper uses the unscented Kalman particle filter (UPF) to train the MLP in a self-organizing state space (SOSS) model. This involves forming augmented state vectors consisting of all parameters (the weights of the MLP) and outputs. The UPF is used to sequentially update the true system states and high dimensional parameters that are inherent to the SOSS model for the MLP simultaneously. Simulation results show that the new method performs better than traditional optimization methods.