Training Learning Weights of Elman Neural Network Using Salp Swarm Optimization Algorithm

Abstract

Elman Neural Network (ENN) is one of the most common type of recurrent neural network (RNN). It is frequently applied to numerous applications such as classification and predication. However, the ENN model, suffers from serious flaws like network stagnancy and delayed convergence during training. To enhance the effectiveness of the ENN and address the mention problems, numerous studies have been conducted to speed up the learning process of ENN. Many optimization techniques are being used and each algorithm has its own characteristics in terms of efficiency. Some of the algorithms inspire from nature, while others come from the swarm's combined behaviour. Different numbers of optimization methods, including Particle Swarm Optimization (PSO), Bat Algorithm, and Cuckoo Search (CS) are applied to improve the ENN's learning process. As a result, this study suggested using Salp Swarm algorithm (SSA) to address these issues and speed up the ENN algorithm's learning process. The SSA, which is based on the typical behaviour of Salp swarms, is proposed in this research as a novel optimization technique. Due to its effectiveness and Salp intelligent behaviour, a novel Salp algorithm improves the learning process of the artificial neural network (ANN), and ENN models. Therefore this study proposed Salp swarm artificial neural network (SSANN) and Salp swarm Elman neural network (SSElmanNN). Performance of the suggested models is evaluated against ANN, back propagation neural network (BPNN), along with ENN in term of accuracy and Mean Square Error (MSE). Two datasets such as IRIS and Credit Card are used for simulation. The simulation results demonstrate that the suggested models outperform the other algorithms used in this study in terms of MSE and accuracy.