Research on Improved BP Learning Algorithm of BP Neural Network

Abstract

Aiming at the existence of the BP neural network learning algorithm in the slow learning speed, the possibility of failure is large, poor generalization ability, there are multiple issues, extreme value point and network structure are difficult to determine, in this paper, we study algorithm improvement methods. Explain the algorithm principle, on the basis of three improved methods are studied, respectively is dynamic learning rate, conjugate gradient, improved error function. Among them, the dynamic learning rate, it reaches the learning rate of the hidden layer and output layer; Conjugate gradient, this paper gives three calculating formula; Improved error function, to solve different problems are also given in three types of error function. BP learning algorithm in this paper, the research contents, make the convergence stability, convergence speed, initial value sensitivity, it has good effect, which has large significant in terms of academic and applied significance.