An improved ARPSO for feedforward neural networks

Abstract

Although particle swam optimization (PSO) algorithm is a good optimization tool for feedforward neural network s(FNN), it is easy to lose the diversity of the swarm and suffer from premature convergence. An improved PSO algorithm based on the attractive and repulsive PSO (ARPSO) is proposed to train FNN in this paper. In addition to the phases of repulsion and attraction, the third phase named as mixed phase is introduced in the improved PSO, in which the particles are attracting and compelling simultaneously to prevent premature convergence. Moreover, an improved mutation operation is taken to help particles jump out of local minima when the current global best position has not been changed for some predetermined iterations in the improved PSO. Since the improved PSO could improve the diversity of the swarm to avoid premature convergence, it has better convergence performance than traditional PSOs. Finally, the experimental results are given to show the effectiveness of the proposed algorithm on function approximation and iris classification problems.