Augmentation of Elman Recurrent Network Learning with Particle Swarm Optimization

Abstract

Despite a variety of artificial neural network (ANN) categories, backpropagation network (BP) and Elman recurrent network (ERN) are the widespread modus operandi in real applications. However, there are many drawbacks in BP network, for instance, confinement in finding local minimum and may get stuck at regions of a search space or trap in local minima. To solve these problems, various optimization techniques such as particle swarm optimization (PSO) and genetic algorithm (GA) have been executed to improve ANN performance. In this study, we exploit errors optimization of Elman recurrent network with backpropagation (ERNBP) and Elman recurrent network with particle swarm optimization (ERNPSO) to probe the performance of both networks. The comparisons are done with PSO that is integrated with neural network (PSONN) and GA with neural network (GANN). The results show that ERNPSO furnishes promising outcomes in terms of classification accuracy and convergence rate compared to ERNBP, PSONN and GANN.