Convolutional Neural Network With Automatic Learning Rate Scheduler for Fault Classification

Abstract

Fault classification is vital in smart manufacturing, and convolutional neural network (CNN) has been widely applied in fault classification. But the performance of CNN heavily depends on its learning rate. As the default setting on learning rate cannot guarantee its performance, the learning rate tuning process becomes essential. However, the traditional learning rate tuning methods either cost much time consumption or rely on the experts’ experiences, so it is a considerable barrier for the users. To overcome this drawback, this article proposes a CNN with automatic learning rate scheduler (AutoLR-CNN) for fault classification. First, the long short-term memory (LSTM) is used to extract the features of the past loss of CNN. Then, an agent based on deep deterministic policy gradient (DDPG) is trained to automatically control the learning rate for CNN online. Third, the double CNN structure is developed to enhance the stability of the proposed method. The proposed AutoLR-CNN is tested on two famous bearing data sets and a practical bearing data set on wind turbine. The results of AutoLR-CNN are superior to six commonly used baseline learning rate schedulers in Tensorflow. AutoLR-CNN is also compared with other reported machine learning and deep learning methods. The results show that AutoLR-CNN has achieved the state-of-the-art performance in fault classification.