Enhancing the non-linear modelling capabilities of MLP neural networks using spread encoding

Abstract

Two methods for representing data in a multi-layer perceptron (MLP) neural network are described and the resultant ability of networks, trained by the standard back-propagation algorithm, to identify the dynamics of non-linear systems is investigated. One of the data conditioning methods has been widely used in studies of the MLP network and consists of normalising each network input and output variable and applying the normalised data to single network nodes. In the second method, named spread encoding, each network variable is represented as a sliding Gaussian pattern of excitations across several network nodes. The spread encoding technique exhibits similarities with conventional algorithms used in fuzzy logic and a network utilising this method can be considered as a fuzzy-neural type network. Neural networks are configured to represent a non-linear, auto-regressive, exogenous (NARX) input-output model structure and the performance of trained networks is investigated in applications to modelling a real liquid level process unit and a simulation of a highly non-linear chemical process. Results show that using the data normalisation method, a network can provide accurate single-step predictions but is incapable of adequate long-range predictions. In contrast to this, the spread encoding technique significantly enhances the performance of a MLP network model enabling accurate single-step and long-range predictions to be achieved.