An Adaptive Activation Transfer Learning Approach for Fault Diagnosis

Abstract

For industrial scenarios with changing operating conditions, the vibration data of different operating conditions often have different data distributions. In this article, to make the deep learning framework perform more flexible nonlinear transformations for different input data, a new activation function, i.e., parameter-free adaptively Swish (PASwish), is developed. PASwish formulates different activation schemes for different input data so that vibration data under different operating conditions can carry out adaptive nonlinear transformation, and the generalization ability of the whole network is improved. In addition, this article proposes deep parameter-free cosine networks with PASwish on the basis of PASwish, which can help adjust the network weights of domain-specific features and domain-invariant features by constructing an attention module based on cosine adjustment. Finally, the reconstruction-based domain adaptation method is used to achieve cross-domain fault diagnosis. Experiments are carried out on the bearing fault experimental platform to verify the effectiveness and generalization of the proposed method. We have achieved 95.16 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\%$</tex-math></inline-formula> ( <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$ \pm 1.76\%$</tex-math></inline-formula> ) average accuracy on 72 transfer tasks, which shows better performance than current studies.