A hybrid Bayesian back‐propagation neural network approach to multivariate modelling

Abstract

AbstractThere is growing interest in the use of back‐propagation neural networks to model non‐linear multivariate problems in geotehnical engineering. To overcome the shortcomings of the conventional back‐propagation neural network, such as overfitting, where the neural network learns the spurious details and noise in the training examples, a hybrid back‐propagation algorithm has been developed. The method utilizes the genetic algorithms search technique and the Bayesian neural network methodology. The genetic algorithms enhance the stochastic search to locate the global minima for the neural network model. The Bayesian inference procedures essentially provide better generalization and a statistical approach to deal with data uncertainty in comparison with the conventional back‐propagation. The uncertainty of data can be indicated using error bars. Two examples are presented to demonstrate the convergence and generalization capabilities of this hybrid algorithm. Copyright © 2003 John Wiley & Sons, Ltd.