Western Reserve University Research Articles

M-IPISincNet: An explainable multi-source physics-informed neural network based on improved SincNet for rolling bearings fault diagnosis

Timely and accurate diagnosis of bearing faults can effectively reduce the chance of accidents in equipment. However, deep learning methods are mostly completely dependent on data and lack interpretability. It is difficult to deal with the differences between real-time data and training data under changing working conditions and noisy environments. In this study, we proposed M-IPISincNet, an explainability multi-source physics-informed convolutional network based on improved SincNet. Rolling bearing fault diagnosis is realized by extracting fault features from vibration and current signals. Firstly, a physics-informed convolutional layer is designed based on inverse Fourier transform and bandpass filters. Fault features are extracted by multi-scale convolution and multi-layer nonlinear mapping. A DBN network is applied extract unsupervised hidden fusion features in the vibration and current signals. The proposed method is validated under the datasets of Paderborn University (PU) and Case Western Reserve University (CWRU), which proves that the proposed method has explainability, robustness and great accuracy under multiple working conditions and noises.

Cepstrum-driven modulated empirical wavelet transform and its application in bearing fault diagnosis

Abstract Empirical wavelet transform (EWT) has a complete theoretical support and can adaptively separate modes with different characteristics from the frequency domain. Signal decomposition and mode extraction based on the empirical wavelet transform can obtain more accurate components. This paper proposes a modulated empirical wavelet transform driven by cepstrum under the basic framework of traditional EWT method. The most innovative point of this paper is to use the characteristics of cepstrum to update the waveform of trend spectrum and realize the function of separating different modes. The filtering process constructs filter banks covering the entire frequency band based on scaling functions and empirical wavelets. In order to enhance the fault characteristics from the filtering components, the amplitude of its spectrum was modulated based on the Fourier transform characteristics. Finally, the effectiveness of the algorithm is verified by using simulation signals and experimental signals provided by Case Western Reserve University. 
Keywords: Empirical wavelet transform, Rolling bearing, Cepstrum, Amplitude Modulation, Fault Diagnosis

A rolling bearing fault diagnosis method for imbalanced data based on multi-scale self-attention mechanism and novel loss function

Deep learning methods are widely used in the field of rolling bearing fault diagnosis and produce good results when faced with datasets with roughly equal numbers of normal and faulty samples. However, real-world data often has a serious imbalance, with the number of fault samples being significantly less than the number of normal samples. This dataset imbalance challenges the performance of traditional deep learning methods. To address this problem, this paper proposes an efficient imbalanced data rolling bearing fault diagnosis method. The method consists of two parts: a deep learning network based on a multi-scale self-attention mechanism and a novel loss function. In terms of the deep learning network, firstly, the one-dimensional vibration signal is converted into a two-dimensional image through the Gramian angular field. This conversion maximises the inherent feature extraction capability of the network. Subsequently, the multi-scale learning capability of the network is enhanced by implementing different expansion rates for the head of the multi-scale self-attention mechanism. This nuanced approach allows the network to capture the underlying information more efficiently. Finally, the inclusion of Ghost bottlenecks and feature pyramid networks (FPNs) helps to optimise network efficiency and improve generalisation performance. A novel loss function is also proposed to make the method more suitable for imbalanced data. During the training process, the classification of samples in each class is analysed using the recall metric of imbalanced classification and the real-time recall is used as a weight to weaken the dominance of the majority class. This weighting ensures the adaptability of the method to imbalanced datasets. The proposed method is evaluated using rolling bearing datasets from Case Western Reserve University, USA, and Southeast University, China. Comparison results with other state-of-the-art deep learning methods show that the proposed method has a robust performance when dealing with imbalanced data.

CNN Intelligent diagnosis method for bearing incipient faint faults based on adaptive stochastic resonance-wave peak cross correlation sliding sampling

As a representative of deep learning networks, convolutional neural networks (CNN) have been widely used in bearing fault diagnosis with good results. However, the signal length and segmentation of the input CNN can have a significant impact on diagnostic accuracy. In addition, the signal-to-noise ratio of early bearing faults is usually very low, which makes it difficult for traditional CNNs to accurately identify and classify these faults. To solve this problem, this paper proposes an adaptive stochastic resonance wave peak cross-correlation sliding sampling method. Firstly, the adaptive stochastic resonance is used to reduce the noise of the original signal, and then the data is divided from the position of the signal wave peak, the correlation coefficient between the divided signals is calculated, and the maximum value is found to determine the size of the division window. Finally, it is converted into a 2D image by Gramian Angular Field and input into CNN for diagnostic classification. The design methodology was validated using the Case Western Reserve University bearing dataset. Subsequently, three validation strategies were established on a self-built platform, including mixed diagnosis of 10 different bearing states, variable speed diagnosis, and low sampling data diagnosis. The proposed method outperforms the conventional CNN by 10% in the Case Western Reserve University dataset test set. The variable speed test set is 24.67% and 31.17% higher, respectively. It is 30% higher in low sampling data diagnosis.

Bearing fault diagnosis based on wavelet adaptive threshold filtering and multi-channel fusion cross-attention neural network.

In industrial applications, it is difficult to extract the fault feature directly when the rolling bearing works under strong background noise. In addition, single-channel vibration sensor data pose limitations in providing a comprehensive representation of bearing fault features; how to effectively fuse data of each channel and extract features is a challenge. To solve the above-mentioned problems, a fault diagnosis method based on wavelet adaptive threshold filtering and multi-channel fusion cross-attention neural network is proposed in this paper. First, the multi-scale discrete wavelet transform is applied to obtain the wavelet coefficients of each channel. Adaptive threshold filtering is conducted to filter out noise and extract symbolic features. The threshold updates with the training of the network. Then, the wavelet coefficients are reconstructed and the channel attention is performed to further extract the symbolic features of the fault signal. Finally, the multi-channel fault signals are fused by a cross-attention module. This module can fully extract the features of each channel and fuse multi-channel data. To improve the generalization ability of the network, residual connections are added. To verify the effectiveness of the proposed method, experiments are carried out on the rolling bearing datasets of Case Western Reserve University and Xi'an Jiaotong University. In addition, the gas turbine main bearing dataset is also applied to prove the reliability of this method.

Mechanical equipment fault diagnosis method based on improved deep residual shrinkage network.

Fault diagnosis of mechanical equipment can effectively reduce property losses and casualties. Bearing vibration signals, as one of the effective sources of diagnostic information, are often overwhelmed by substantial environmental noise. To address this issue, we present a fault diagnosis method, CCSDRSN, which exhibits strong noise resistance. This method enhances the soft threshold function in the traditional deep residual shrinkage network, allowing it to extract useful information from the fault signal to the maximum extent, thus significantly improving diagnostic accuracy. Additionally, we have developed a novel activation function that can nonlinearly transform the time frequency map across multiple dimensions and the entire region. In pursuit of network optimization and parameter reduction, we have strategically incorporated depthwise separable convolutions, effectively replacing conventional convolutional layers. This architectural innovation streamlines the network. By verifying the effectiveness of the proposed method using Case Western Reserve University datasets, the results demonstrate that the proposed method not only possesses strong noise resistance in high noise environments but also achieves high diagnostic accuracy and good generalization performance under different load conditions.

Dynamic Temporal Denoise Neural Network with Multi-Head Attention for Fault Diagnosis Under Noise Background.

Fault diagnosis plays a crucial role in maintaining the operational safety of mechanical systems. As intelligent data-driven approaches evolve, deep learning (DL) has emerged as a pivotal technique in fault diagnosis research. However, the collected vibrational signals from mechanical systems are usually corrupted by unrelated noises due to complicated transfer path modulations and component coupling. To solve the above problems, this paper proposed the dynamic temporal denoise neural network with multi-head attention (DTDNet). Firstly, this model transforms one-dimensional signals into two-dimensional tensors based on the periodic self-similarity of signals, employing multi-scale two-dimensional convolution kernels to extract signal features both within and across periods. Secondly, for the problem of lacking denoising structure in traditional convolutional neural networks, a temporal variable denoise (TVD) module with dynamic nonlinear processing is proposed to filter the noises. Lastly, a multi-head attention fusion (MAF) module is used to weight the denoted features of signals with different periods. Evaluation on two datasets, Case Western Reserve University bearing dataset (single sensor) and Real aircraft sensor dataset (multiple sensors), demonstrates that the DTDNet can reduce the useless noises in signals and achieve a remarkable improvement in classification performance compared with the state-of-the-art method. DTDNet provides a high-performance solution for potential noise that may occur in actual fault diagnosis tasks, which has important application value.

The unsupervised bearing fault diagnosis method based on the dual-framework Siamese network

Abstract Aiming at the problem of insufficient bearing fault samples in practical engineering, an unsupervised bearing fault diagnosis method with double frame twin network is proposed in this paper. This method only uses the source domain data to diagnose the target domain data, and can minimize the problem of domain difference. The concrete method is firstly to carry on continuous wavelet transform (CWT) to the rolling bearing signal, and the processed signal is used as the input feature of convolutional neural network (CNN). The twin network structure is optimized and Manhattan distance is used as the loss function in the training process. The proposed CM network is applied to the diagnosis of inner ring fault, outer ring fault and normal state of rolling bearing. The results show that CM network can achieve over 90% accuracy on SQ variable speed vibration signal data set (SQV), Shijiazhuang Railway University data set (STD) and Case Western Reserve University data set (CWRU), which is suitable for bearing fault diagnosis under different working conditions and provides a new direction for fault diagnosis. The PyTorch code is available at https://github.com/xiaotianqu/The-unsupervised-bearing-fault-diagnosis-method-based-on-the-dual-framework-Siamese-network

Rolling bearing fault diagnosis method based on adaptive signal diagnosis network and its application

Aiming at the problems of fixed convolution kernel size and poor targeting of extracted features in the application of deep learning in fault diagnosis, this paper develops a fault diagnosis framework called adaptive signal diagnosis network (ASDN), in which the EEMD of multi-scale signal decomposition is improved in the adaptive preprocessing stage to adaptively capture the transient changes of signals. Meanwhile, SSA is improved to further extract fault trends and periodic components to optimize the signal representation. In the adaptive deep learning stage, an innovative temporal convolutional network (TCN) with a dynamic adjustment mechanism was developed to enable the neural network to adjust its convolutional kernel size according to different frequency components so as to accurately process signals of different frequencies. Validation on datasets from Case Western Reserve University and Xi'an Jiaotong University shows the superior performance of the proposed method, with diagnostic accuracies of 100% and 97.42% on these two public datasets, respectively.

Bearing fault diagnosis based on novel hierarchical multiscale dispersion entropy in corresponding color block images

Abstract The rolling bearing is a critical component of mechanical equipment, and its failure can lead to serious consequences. In order to effectively extract fault features of rolling bearings and improve fault diagnosis performance, a fault diagnosis framework based on hierarchical multiscale dispersion entropy (HMDE) and improved histogram of oriented gradient (HOG) is proposed by combining entropy method with image recognition method. Firstly, the original vibration signal is subjected to moving average filtering to eliminate sudden noise and outliers. Then, HMDE is used for the extraction of fault features. HMDE can evaluate the complexity of the signal at different levels and scales, thereby extracting more comprehensive information. Based on HMDE, entropy color block (ECB) images are generated and the improved HOG of the images are extracted. Finally, Knearest neighbor (KNN) is used to classify the improved HOG features, completing the recognition of different working states of rolling bearings. The validity and robustness of the proposed fault diagnosis framework are proved by the verification experiments on the public bearing datasets in Case Western Reserve University and Southeast University.

Rolling bearing fault diagnosis method based on wavelet packet logarithmic energy map

Aiming at the fault diagnosis problem of rolling bearings, a diagnosis method based on wavelet packet logarithmic energy map is proposed. Firstly, a new wavelet packet node logarithmic energy formula is improved and proposed to overcome the shortcomings of cumbersome parameter determination and strong subjectivity in the traditional wavelet packet energy formula, improve the recognition of high-frequency faults and the distinction of low-frequency fault categories, so as to fully extract the initial time-frequency domain features; secondly, the Gram angle and field idea is used to realize the conversion from one-dimensional features to two-dimensional image features, so as to construct the logarithmic energy map feature based on wavelet packet, which further considers the spatial information between adjacent features, thereby optimizing the initial time-frequency domain features and improving the significance of the obtained features. On this basis, the residual network is used to improve the accuracy of fault diagnosis classification results. Finally, through the simulation verification of the standard rolling bearing data set of Case Western Reserve University, it can be seen that the fault diagnosis model constructed by the proposed method has high diagnostic accuracy and strong generalization ability.

Threshold-optimized and features-fused semi-supervised domain adaptation method for rotating machinery fault diagnosis

In the field of intelligent fault diagnosis, domain adaptation (DA) technology achieves significant breakthroughs, particularly in reducing reliance on large volumes of labeled samples. Despite these advancements, challenges persist when unlabeled data do not accurately represent actual application scenarios. Additionally, the impact of pseudo-labels on conditional domain adaptation raises concerns. To overcome the above challenges, a novel DA approach based on chaos sparrow search algorithm (CSSOA) optimized threshold parameters and feature fusion deep belief network (DBN) is proposed, named CSS-DADBN. Firstly, this method, by integrating pseudo-label updating with semi-supervised domain adaptation (SSDA) and employing confidence and entropy threshold parameters as corrective rules for pseudo-label filtering, along with the introduction of iterative conditions as an additional selection criterion, effectively alleviates the aforementioned issues. Furthermore, combining the feature extraction capabilities of DBN with a domain feature fusion strategy significantly enhances cross-domain feature learning, thereby substantially improving diagnostic accuracy. Ultimately, to validate the effectiveness and practicality of the CSS-DADBN method, a series of experiments conducted on the PT700 and Case Western Reserve University (CWRU) rolling bearing test platform clearly demonstrate its utility and efficiency in intelligent fault diagnosis.

An interpretable hybrid framework combining convolution latent vectors with transformer based attention mechanism for rolling element fault detection and classification

Failure of industrial assets can cause financial, operational and safety hazards across different industries. Monitoring their condition is crucial for successful and smooth operations. The colossal volume of sensory data generated and acquired throughout industrial operations supports real-time condition monitoring of these assets. Leveraging digital technologies to analyze acquired data creates an ideal environment for applying advanced data-driven machine learning techniques, such as convolutional neural networks (CNNs) and vision transformer (ViT) to detect faults and classify, enabling accurate prediction and timely maintenance of industrial assets. In this paper, we present a novel hybrid framework based on the local feature extraction ability of CNN with comprehensive understanding of transformer within a global context. The proposed method leverages the complex weight-sharing properties of CNNs and ability of transformers to understand the larger context of spatial relationships in large-scale patterns, making it applicable to datasets of varying sizes. Preprocessing methods such as data augmentation are used to train the model on the Case Western Reserve University (CWRU) dataset in order to increase generalization through computational efficiency. An average fault classification accuracy of 99.62% is accomplished over all three fault classes with an average time-to-fault detection of 38.4 ms. MFPT fault dataset is used to further validate the method with an accuracy of 99.17% for outer race and 99.26% for inner race. Moreover, the proposed framework can be modified to accommodate alternative convolutional models.

An Improved Rolling Bearing Fault Diagnosis Model of Long Short-Term Memory Network Based on VMD Denoised Vibration Signals

Data driven fault diagnosis methods are increasingly being used for condition monitoring of rotating machinery in the era of Industry 4.0. The effectiveness of Variational Mode Decomposition (VMD) denoised vibration signals in improving the Long Short-Term Memory (LSTM) method for the intelligent fault diagnosis of a rolling bearing is reported. The raw and VMD denoised vibration signals of rolling bearings are provided as inputs to the LSTM network for classification of bearing condition. The efficacy of the methodology to extract the fault information is assessed through datasets obtained from experiment test rig and through the open-source dataset of Case Western Reserve University (CWRU). A comparative analysis is also carried out using both VMD based decomposition and denoising techniques along with four machine learning classifiers viz. Decision Tree, k-Nearest Neighbour (k-NN), Support Vector Machine (SVM) and Artificial Neural Network (ANN) by using the statistical features of the VMD modes. Among the different methods evaluated, VMD denoised signals when fed to LSTM result in the maximum classification accuracy of 99.14 % with experimental dataset. For the case of CWRU dataset, VMD denoised signals as input to the SVM resulted in maximum classification accuracy of 98.16%.

SPRout-DBN: a cross domain bearing fault diagnosis method based on spatial pyramid pooling residual network-DBN

Abstract Effectively leveraging the spatial features of time series signals to improve the accuracy of bearing fault classification in neural networks presents a significant challenge. To address this issue of different operating conditions, a novel model termed spatial pyramid pooling residual network-deep belief network (SPRout-DBN) is proposed. First and foremost, the Gramian angular difference fields (GADF) are utilized to encode original vibration signals of bearings. Secondly, two-dimensional images transformed by GADF from original signals are input to a novel designed residual network with spatial pyramid pooling to extract fixed-size temporal fusion feature vectors. Finally, a deep belief network is employed for classification and cross-domain learning, enabling the identification of fault samples under varying operating conditions. The proposed method is validated by two sets of datasets from Case Western Reserve University and Jiangnan University, achieving accuracies of 99.81% and 99.0% under identical operating conditions, and 99.41% and 98.43% under different operating conditions with 40 samples. Comparative analysis indicates that the proposed SPRout-DBN remains more robust and effective compared with other methods such as K-nearest neighbors, support vector machines, LeNet-5, ResNet-18, domain adaptation networks, and domain-adversarial neural networks in diverse operating environments.

Application of improved adaptive method of CEEMD and data-drive in fault diagnosis

PurposeThe diagnosis and prediction methods used for estimating the health conditions of the bearing are of great significance in modern petrochemical industries. This paper aims to discuss the accuracy and stability of improved empirical mode decomposition (EMD) algorithm in bearing fault diagnosis.Design/methodology/approachThis paper adopts the improved adaptive complementary ensemble empirical mode decomposition (ICEEMD) to process the nonlinear and nonstationary signals. Two data sets including a multistage centrifugal fan data set from the laboratory and a motor bearing data set from the Case Western Reserve University are used to perform experiments. Furthermore, the proposed fault diagnosis method, combined with intelligent methods, is evaluated by using two data sets. The proposed method achieved accuracies of 99.62% and 99.17%. Through the experiment of two data, it can be seen that the proposed algorithm has excellent performance in the accuracy and stability of diagnosis.FindingsAccording to the review papers, as one of the effective decomposition methods to deal with nonlinear nonstationary signals, the method based on EMD has been widely used in bearing fault diagnosis. However, EMD is often used to figure out the nonlinear nonstationarity of fault data, but the traditional EMD is prone to modal confusion, and the white noise in signal reconstruction is difficult to eliminate.Research limitations/implicationsIn this paper only the top three optimal intrinsic mode functions (IMFs) are selected, but IMFs with less correlation cannot completely deny their value. Considering the actual working conditions of petrochemical units, the feasibility of this method in compound fault diagnosis needs to be studied.Originality/valueDifferent from traditional methods, ICEEMD not only does not need human intervention and setting but also improves the extraction efficiency of feature information. Then, it is combined with a data-driven approach to complete the data preprocessing, and further carries out the fault identification and classification with the optimized convolutional neural network.

Enhanced fault diagnosis of rolling bearings using an improved inception-lstm network

ABSTRACT Rolling bearings are integral to the operation of various mechanical systems, where their condition directly impacts equipment reliability and performance. Accurate fault diagnosis is essential for preventing unexpected failures and minimising downtime in industrial settings. This study presents a novel diagnostic model that combines Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) networks, enhanced by an improved Inception module. This integrated approach captures both spatial and temporal features of vibration signals, leading to superior diagnostic accuracy under diverse operating conditions. Experimental results using the Case Western Reserve University (CWRU) bearing dataset demonstrate an impressive average fault diagnosis accuracy of 99.83%, outperforming conventional models. The robustness of the proposed model against noise and its adaptability to varying operational environments underscore its practical value for real-world engineering applications, offering a reliable solution for maintaining the safety and efficiency of critical machinery.

Fault diagnosis method of rotating machinery based on MSResNet feature fusion and CAM

To solve the problem of noise interference, it is difficult to extract multi-scale information from complex vibration signals in fault diagnosis with the single-scale convolution kernel of classical deep learning model convolutional neural network (CNN). Therefore, a fault diagnosis method of rotating machinery based on MSResNet feature fusion and CAM is proposed. The residual network (ResNet) and multi-scale convolutional neural network (MSCNN) are combined to extract multi-scale feature information according to convolution kernels with different sizes, so as to avoid the loss of single-scale feature extraction. Make full use of the advantages of the residual network to skip the connection and prevent the feature information extracted by the multi-scale convolution kernel from being lost when the convolution layer propagates forward. In addition, in order to avoid the interference of invalid features after multi-scale information feature fusion, a channel attention mechanism module (CAM) is introduced to screen important features adaptively. The effectiveness of MSResNet-CAM is verified by the bearing data set of Western Reserve University (CWRU) and the data set of QPZZ-II gearbox, and the anti-noise ability is verified by adding noise to the two data sets. The experimental results show that MSResNet-CAM has the characteristics of high fault classification accuracy, good robustness and strong anti-noise ability.

Predicting peritumoral glioblastoma infiltration and subsequent recurrence using deep-learning-based analysis of multi-parametric magnetic resonance imaging.

Glioblastoma (GBM) is the most common and aggressive primary adult brain tumor. The standard treatment approach is surgical resection to target the enhancing tumor mass, followed by adjuvant chemoradiotherapy. However, malignant cells often extend beyond the enhancing tumor boundaries and infiltrate the peritumoral edema. Traditional supervised machine learning techniques hold potential in predicting tumor infiltration extent but are hindered by the extensive resources needed to generate expertly delineated regions of interest (ROIs) for training models on tissue most and least likely to be infiltrated. We developed a method combining expert knowledge and training-based data augmentation to automatically generate numerous training examples, enhancing the accuracy of our model for predicting tumor infiltration through predictive maps. Such maps can be used for targeted supra-total surgical resection and other therapies that might benefit from intensive yet well-targeted treatment of infiltrated tissue. We apply our method to preoperative multi-parametric magnetic resonance imaging (mpMRI) scans from a subset of 229 patients of a multi-institutional consortium (Radiomics Signatures for Precision Diagnostics) and test the model on subsequent scans with pathology-proven recurrence. Leave-one-site-out cross-validation was used to train and evaluate the tumor infiltration prediction model using initial pre-surgical scans, comparing the generated prediction maps with follow-up mpMRI scans confirming recurrence through post-resection tissue analysis. Performance was measured by voxel-wised odds ratios (ORs) across six institutions: University of Pennsylvania (OR: 9.97), Ohio State University (OR: 14.03), Case Western Reserve University (OR: 8.13), New York University (OR: 16.43), Thomas Jefferson University (OR: 8.22), and Rio Hortega (OR: 19.48). The proposed model demonstrates that mpMRI analysis using deep learning can predict infiltration in the peri-tumoral brain region for GBM patients without needing to train a model using expert ROI drawings. Results for each institution demonstrate the model's generalizability and reproducibility.

Feasibility of Solar Thermal Water Heating Systems on Case Western's Campus

Feasibility of Solar Thermal Water Heating Systems on Case Western's Campus