A novel reinforcement learning agent for rotating machinery fault diagnosis with data augmentation

Abstract

The problem of data imbalance and limited sample poses a prominent challenge to fault diagnosis in industry, especially in rotating machinery fault diagnosis due to the constraints of sampling and labeling. Reinforcement learning is known for its auto-optimized learning ability but it is severely limited by the quality and quantity of data it is able to collect. This paper applies the Equilibrium Deep Q-Network (Equilibrium-DQN) based agent with the Variational Autoencoder with Wasserstein Generative Adversarial Network and Gradient Penalty (VAE-WGAN-GP) for rotating machinery fault diagnosis. The Equilibrium-DQN possesses the property of leveraging multiple target networks to improve training stability and accuracy. The VAE-WGAN-GP excels in resolving data scarcity problems in fault diagnosis, especially in enriching labeled data with more typical samples while keeping the original data features. Herein, a novel framework is presented that integrates both data augmentation techniques with reinforcement learning agent for fault diagnosis. The proposed framework improves the weakness of insufficient samples in fault diagnosis and reveals its potential in complex industrial applications. The experiments, both on the test bench dataset and on the real locomotive dataset, confirm the advantage of the proposed framework.