Hybrid Deep Neural Network based on SDAE and GRUNN

Abstract

Stacked autoencoder (SAE) is hard to achieve satisfactory performance, when input data are complex and non-stationary. Besides, the identification performance of recurrent neural network (RNN) may decrease rapidly under noisy environment. In order to deal with these problems, a novel hybrid deep neural network (DNN) based on stacked denoising autoencoder (SDAE) and gated recurrent unit neural network (GRUNN) is presented. First, the structure of the presented hybrid DNN is given. The hybrid DNN contains a SDAE, a GRUNN, and a softmax classifier. Then, the training algorithm based on action discovery (AD) is proposed to train the presented hybrid DNN. The experimental studies indicate the presented hybrid DNN processes strong anti-noise ability and adaptability to time-varying signals.