Stacked Denoising Autoencoder Research Articles

Non-destructive estimation for Kyoho grape shelf-life using Vis/NIR hyperspectral imaging and deep learning algorithm

Grape shelf-life estimation is a substantial challenge for the grape industry. The objective of this study is to investigate the potential of grape shelf-life estimation using HSI technique and a deep learning algorithm. The visible and near-infrared (400.68–1001.61 nm) hyperspectral reflectance images data of grape samples was acquired and preprocessed with different spectral preprocessing methods. Additionally, a stacked denoising autoencoder (SDAE)-based deep learning algorithm was developed to extract deep features from pixel-level hyperspectral data of grapes, and then these features were used as inputs to establish support vector machine (SVM) models for estimating grape shelf-life. Furthermore, SVM, one-dimensional convolutional neural network (1D CNN) and long short-term memory (LSTM) models were used as traditional machine learning and end to end models for comparison. The results demonstrated that the SDAE-SVM model achieved reasonable recognition accuracy of 100 % and 98.125 % for the shelf-life of grapes in the training and test sets, respectively. The overall results suggested that SDAE-based deep learning method can be used as a powerful tool to deal with large-scale hyperspectral data as well as this research confirms the feasibility of non-destructive estimation for grapes shelf-life by the combination of HSI technique and deep learning method, which would provide a valuable guidance for shelf-life estimation of other postharvest fruit.

Temperature modeling of wave rotor refrigeration process based on variable time-delay compensation and SDAE-GRU

Abstract Aiming at the problem of noise and time-delay in temperature prediction modeling of large wave rotor refrigeration process, this paper proposes a novel modeling algorithm that combines the advantages of stacked denoising autoencoder (SDAE) network and Gate Recurrent Unit (GRU) algorithm and utilizes the Maximal Information Coefficient (MIC) algorithm to solve the targeting problem. The MIC algorithm is utilized to calculate the delay time of each input variable and output variable, and the input matrix is reconstructed to compensate for the time-delay, thus solving the problem afterwards. The SDAE network is utilized for denoising the input data and feature extraction to solve the problem of presence of noise in the data. The simulation results show that the proposed MIC-SDAE-GRU algorithm achieves a Root Mean Squared Error (RMSE) of 0.6432 and an R-squared (R²) value of 0.9638, outperforming traditional machine learning methods and other deep learning approaches. Specifically, compared to the standard GRU algorithm, it improves the accuracy of temperature prediction for the wave rotor refrigeration process by 24.7% and exhibits strong generalization ability across various operating conditions.

Demodulating Optical Wireless Communication of FBG Sensing with Turbulence-Caused Noise by Stacked Denoising Autoencoders and the Deep Belief Network

Free-space optics communication (FSO) can be used as a transmission medium for fiber optic sensing signals to make fiber optic sensing easier to implement; however, interference with the sensing signals caused by the optical turbulence and scattering of airborne particles in the FSO path is a potential problem. This work aims to deep denoise sensed signals from fiber Bragg grating (FBG) sensors based on FSO link transmission using advanced denoising deep learning techniques, such as stacked denoising autoencoders (SDAE). Furthermore, it will demodulate the sensed wavelength of FBGs by applying the deep belief network (DBN) technique. This is the first time the real FBG sensing experiment has utilized the actual noise interference caused by the environmental turbulence from an FSO link rather than adding noise through numerical processing. Consequently, the spectrum of the FBG sensors is clearly modulated by the noise and the issue with peak power variation. This complicates the determination of the center wavelengths of multiple stacked FBG spectra, requiring the use of machine learning techniques to predict these wavelengths. The results indicate that SDAE is efficient in denoising from the FBG spectrum, and DBN is effective in demodulating the central wavelength of the overlapped FBG spectrum. Thus, it is beneficial to implement an FSO link-based FBG sensing system in adverse weather conditions or atmospheric turbulence.

Stacked Noise Reduction Auto Encoder–OCEAN: A Novel Personalized Recommendation Model Enhanced

With the continuous development of information technology and the rapid increase in new users of social networking sites, recommendation technology is becoming more and more important. After research, it was found that the behavior of users on social networking sites has a great correlation with their personalities. The five characteristics of the OCEAN personality model can cover all aspects of a user’s personality. In this research, a micro-directional propagation model based on the OCEAN personality model and a Stacked Denoising Auto Encoder (SDAE) was built through the application of deep learning to a collaborative filtering technique. Firstly, the dimension of the user and item feature matrices was lowered using SDAE in order to extract deeper information. The user OCEAN personality model matrix and the reduced user feature matrix were integrated to create a new user feature matrix. Finally, the multiple linear regression approach was used to predict user-unrated goods and generate recommendations. This approach allowed us to leverage the relationships between various factors to deliver personalized recommendations. This experiment evaluated the RMSE and MAE of the model. The evaluation results show that the stacked denoising auto encoder collaborative filtering algorithm can improve the accuracy of recommendations, and the user’s OCEAN personality model improves the accuracy of the model to a certain extent.

Deep Learning in Computer Vision: A Critical Review

Today, a machine learning tool has gained a lot of consideration as a data analysis and image processing tool, with encouraging results. Massive amounts of data are being generated in every field or any domain at a distressing rate. This review paper provides a brief overview of current technologies and a conceptual explanation of the development of computer vision with image processing and the usage of specific regions in their respective fields. Computer vision with deep learning allows researchers to investigate pictures and videos to attain essential facts, recognize facts on occasions, or provide explanations and exquisite patterns. It utilized the approach of diverse-variety utility areas with large-scale data mining. We employed a review to extract and synthesize the techniques and attributes that have been used in different applications of computer vision, like image classification, image localization, object detection, and many more, with their features. So according to computer vision tasks, there are Deep Belief Networks, Convolutional Neural Networks (CNN), Deep Boltzmann Machines (DBN), Recurrent Neural Networks (RNN), Stacked Denoising Auto Encoders, and Long-Short Term Memory (LSTM) algorithms that are some of the most important advanced machine learning (deep learning) algorithms. Lastly, a quick evaluation of future approaches to constructing advanced machine learning algorithms is provided for challenges and issues related to computer vision with improved performance.

Life prediction of IGBT module for nuclear power plant rod position indicating and rod control system based on SDAE-LSTM

To reduce the losses caused by aging failure of insulation gate bipolar transistor (IGBT), which is the core components of nuclear power plant rod position indicating and rod control (RPC) system. It is necessary to conduct studies on its life prediction. The selection of IGBT failure characteristic parameters in existing research relies heavily on failure principles and expert experience. Moreover, the analysis and learning of time-domain degradation data have not been fully conducted, resulting in low prediction efficiency as the monotonicity, time correlation, and poor anti-interference ability of extracted degradation features. This paper utilizes the advantages of the stacked denoising autoencoder(SDAE) network in adaptive feature extraction and denoising capabilities to perform adaptive feature extraction on IGBT time-domain degradation data; establishes a long-short-term memory (LSTM) prediction model, and optimizes the learning rate, number of nodes in the hidden layer, and number of hidden layers using the Gray Wolf Optimization (GWO) algorithm; conducts verification experiments on the IGBT accelerated aging dataset provided by NASA PCoE Research Center, and selects performance evaluation indicators to compare and analyze the prediction results of the SDAE-LSTM model, PSO-LSTM model, and BP model. The results show that the SDAE-LSTM model can achieve more accurate and stable IGBT life prediction.

An Improved Transformer Model for Remaining Useful Life Prediction of Lithium-Ion Batteries under Random Charging and Discharging

With the development of artificial intelligence and deep learning, deep neural networks have become an important method for predicting the remaining useful life (RUL) of lithium-ion batteries. In this paper, drawing inspiration from the transformer sequence-to-sequence task’s transformation capability, we propose a fusion model that integrates the functions of the stacked denoising autoencoder (SDAE) and the Transformer model in order to improve the performance of RUL prediction. Firstly, the health factors under three different conditions are extracted from the measurement data as model inputs. These conditions include constant current and voltage, random discharge, and the application of principal component analysis (PCA) for dimensionality reduction. Then, SDAE is responsible for denoising and feature extraction, and the Transformer model is utilized for sequence modeling and RUL prediction of the processed data. Finally, accurate prediction of the RUL of the four battery cells is achieved through cross-validation and four sets of comparison experiments. Three evaluation metrics, MAE, RMSE, and MAPE, are selected, and the values of these metrics are 0.170, 0.202, and 19.611%, respectively. The results demonstrate that the proposed method outperforms other prediction models in terms of prediction accuracy, robustness, and generalizability. This provides a new solution direction for the daily life prediction research of lithium-ion batteries.

Cavitation fault diagnosis of centrifugal pump based on RIME-SDAE

In order to fully extract the fault characteristics of different cavitation fault states of centrifugal pumps, reduce the influence of hyperparameter settings on the identification and classification results of machine learning algorithms, this paper designs a network model based on the rime optimization algorithm (RIME) to improve the stacked denoising autoencoder (SDAE) network, which is named as RIME-SDAE. First of all, Singular Value Decomposition (SVD) is used to denoise the X, Y and Z signals of the triaxial vibration sensor, and time-domain, frequency-domain and time-frequency features are extracted to construct a signal feature set. Secondly, the three-dimensional feature indicators are analyzed and selected to be merged into the input dataset, and SDAE is trained with the RIME is used to determine the model parameters of SDAE synchronously. The feasibility of the proposed method is verified by the signals collected in the actual test, and the test results show that the accuracy on the test set reaches more than 98 %.

Surrogate model-based multi-objective optimization algorithm for train-ballast turnout system: Balancing safety and vibration damping in parameter design

In rail transportation structural parameter design, multi-objective optimal algorithms (MOOAs) have advanced significantly in safety, comfort, and aerodynamics domain. However, the vital factor of environment vibration remains neglected, impeding depot cover technology advancements. To address this challenge, with a focus on both safety and vibration damping. Firstly, the mechanistic models are constructed to establish a surrogate modeling database. Subsequently, a surrogate model is proposed, integrating stacked denoising autoencoders (SdAEs), self-attention (SA), and the gated recurrent unit (GRU). In addition, A novel MOOA, Dynamic Population-Multi-Objective Harris Hawks Optimization-Crowding Distance-Elitist Learning Strategy (D-MOHHO-CD-ELS), is proposed and its efficacy is validated against five existing MOOAs using the CTP1∼CTP7 test functions. Moreover, the train-ballast No.12 turnout system is considered as an engineering case. Importantly, the accuracy of both the mechanistic model and surrogate model is thoroughly validated. Among them, the performance of the data preprocessing and prediction algorithms is substantiated through a comparison of the proposed SdAEs-SA-GRU model against simulation results and eight other algorithms. Furthermore, the surrogate-based D-MOHHO-CD-ELS method, applied to tackle a multi-objective optimization problem with nine optimization parameters and four optimization objectives, demonstrates an efficiency improvement of 1 to 2 orders of magnitude compared to traditional methods. Consequently, following optimization, the wheel load reduction rate, derailment coefficient, capsizing coefficient and vibration damping effect are improved by 15.5%, 11.1%, 5.5% and 24.8% respectively, which reveals the effectiveness of enhancements in both the safety and damping efffect. the study offers a novel perspective for parameter design of TBT.

Automatic fault diagnosis of rolling bearings under multiple working conditions based on unsupervised stack denoising autoencoder

In practical engineering, data often lack labels, resulting in difficulty in fault diagnosis. Because stack-denoising autoencoders possess robust feature extraction capabilities and resistance to interference, an automatic and unsupervised bearing fault diagnosis method based on the stack-denoising autoencoder without an output layer was proposed in this study. As the stacked denoising autoencoder is an unsupervised algorithm, this approach can reduce reliance on manually labeled data labels. Therefore, this study proposed a new method for automatic fault diagnosis. First, the bearing fault features of the rolling bearing were extracted using the stack denoising autoencoder without an output layer. Meanwhile, the dimensions of the features were directly reduced to two or three dimensions by several hidden layers, thereby reducing manual experience. Second, the labels extracted from the clustering model were selected as inputs for different classifier models to automatically identify different types of faults. Two open-source rolling bearing datasets under various conditions were used to validate the classification performance of the proposed method. Finally, its effectiveness was verified using the experimental results. Various indicators were used to evaluate the performance of the proposed method, and the results showed an automatic bearing fault diagnosis accuracy of up to 90% when using different models and working conditions. Among the two datasets, the classification model achieved the highest accuracies of 0.99667 and 0.97143 and the lowest accuracies of 0.98000 and 0.90476, respectively.

Stacked Denoising Autoencoder Based Parkinson’s Disease Classification using Improved Pigeon-Inspired Optimization Algorithm

One of the most common neurological conditions caused by gradual brain degeneration is Parkinson's disease (PD). Although this neurological condition has no known treatment, early detection and therapy can help patients improve their quality of life. An essential patient's health record is made of medical images used to control, manage, and treat diseases. However, in computer-based diagnostics, disease classification is a difficult task. To overcome this problem, this paper introduces a stacked denoising Autoencoder (SDA) for Parkinson's disease classification. The main aim of this paper is to derive an optimal feature selection design for an effective PD classification. Improved Pigeon-Inspired Optimization (IPIO) algorithm is introduced to enhance the performance of the classifier. Thus, the classification result improved by the optimal features and also increased the sensitivity, accuracy, and specificity in the medical image diagnosis. The proposed scheme is implemented in PYTHON and compared with traditional feature selection models and other classification approaches. The experimental outcomes show that the proposed method yields a superior classification of PD than the current state-of-the-art method

A Fusion Network with Stacked Denoise Autoencoder and Meta Learning for Lateral Walking Gait Phase Recognition and Multi-Step-Ahead Prediction.

Lateral walking gait phase recognition and prediction are the premise of hip exoskeleton application in lateral resistance walk exercise. In this work, we presented a fusion network with stacked denoise autoencoder and meta learning (SDA-NN-ML) to recognize gait phase and predict gait percentage from IMU signals. Experiments were conducted to detect the four lateral walking gait phases and predict their percentage in 10 healthy subjects across different speeds. The performance of SDA-NN-ML and other widely used algorithms including Support Vector Machine (SVM), Adaptive Boosting (AdaBoost) and Long Short Term Memory (LSTM) were evaluated. The cross-subject recognition accuracy of SDA-NN-ML (89.94%) decreased by 4.62% compared to the training accuracy, which outperformed SVM (8.60%), AdaBoost (5.61%), and LSTM (7.12%). For real-time and cross-subject prediction of gait phase percentage, the RMSE of SDA-NN-ML (0.2043) outperformed that of a single regression network (0.2426). With a signal noise ratio of 100:30, the cross-subject recognition accuracy decreased by a mere 5.70%, while the prediction result (RMSE) of SDA-NN-ML increased by 0.0167 when compared to the noise-free results. SDA-NN-ML demonstrates a stable multi-step-ahead prediction ability with an accuracy higher than 82.50% and an RMSE of less than 0.23 when the ahead time is less than 200 ms. The results demonstrated that the proposed method has high accuracy and robust performance in lateral walking gait recognition and prediction.

Traffic Image Analysis Based on Stacked Denoising Autoencoder Neural Network

This study aims to explore major neural network models - Stacked Denoising Autoencoder (SDAE), Deep Belief Network (DBN), Backpropagation - that have recently garnered attention and propose the most suitable and reliable artificial neural network model for real-time road traffic information collection. In this study, to enhance the reliability of experimental results, numerous experiments were conducted under identical conditions (such as parameter values and network configuration) by setting different initial values for the weight vector. The results of the experiments were statistically validated to draw conclusions. The research results showed that the SDAE model exhibited the most superior performance, while the accuracy of the DBN was somewhat lower compared to the SDAE model. On the other hand, the Backpropagation model demonstrated a relatively low predictive accuracy compared to both models, particularly showing a significant influence of the initial values

Transmission Line Fault Diagnosis Method Based on SDA-ISSA-XGBoost under Meteorological Factors

Transmission lines are directly exposed to the natural environment and are prone to failure due to meteorological factors. A novel approach for diagnosing transmission line faults under various meteorological conditions has been introduced. This method, known as SDA-ISSA-XGBoost, combines the power of Stacked Denoising Autoencoder (SDA), an improved Sparrow Search Algorithm (ISSA) enhanced with chaotic mapping sequences, adaptive weights, improved iterative local search, and a random differential mutation strategy, and eXtreme Gradient Boosting (XGBoost). The process begins with SDA, which extracts essential features from the initial meteorological data. Subsequently, ISSA is applied to optimize the parameters of the XGBoost model. This results in the ISSA-XGBoost fault diagnosis model. The performance of this model is compared to PSO-XGBoost and SSA-XGBoost. The experimental findings demonstrate that the ISSA-XGBoost model achieves an impressive fault diagnosis accuracy of 94.39%, surpassing both PSO-XGBoost and SSA-XGBoost by 6.54% and 3.74%, respectively.

Similarity-Based Remaining Useful Lifetime Prediction Method Considering Epistemic Uncertainty

Measuring the similarity between two trajectories is fundamental and essential for the similarity-based remaining useful life (RUL) prediction. Most previous methods do not adequately account for the epistemic uncertainty caused by asynchronous sampling, while others have strong assumption constraints, such as limiting the positional deviation of sampling points to a fixed threshold, which biases the results considerably. To address the issue, an uncertain ellipse model based on the uncertain theory is proposed to model the location of sampling points as an observation drawn from an uncertain distribution. Based on this, we propose a novel and effective similarity measure metric for any two degradation trajectories. Then, the Stacked Denoising Autoencoder (SDA) model is proposed for RUL prediction, in which the models can be first trained on the most similar degradation data and then fine-tuned by the target dataset. Experimental results show that the predictive performance of the new method is superior to prior methods based on edit distance on real sequence (EDR), longest common subsequence (LCSS), or dynamic time warping (DTW) and is more robust at different sampling rates.

Research on tool condition monitoring (TCM) using a novel unsupervised deep neural network (DNN)

In order to improve the recognition precision and accuracy of tool wear monitoring, an unsupervised deep neural network (DNN) based on stack denoising autoencoder (SDA) is proposed. After feature extraction and selection, the stack denoising automatic coding network reduces the dimensionality of the feature vector. On this basis, principal component analysis (PCA) and T-distributed random neighbor embedding (t-SNE) are used to reduce the dimensionality of the features twice, and finally a simple two-dimensional feature matrix is obtained. Finally, the deep neural network model of SDA is established by adding SoftMax regression layer, and the tool wear monitoring results are taken as new labeled data, and the deep neural network parameters are fine-tuned by secondary backpropagation. The experimental results show that the proposed method can learn adaptively and obtain effective feature expression, and the tool wear state recognition results are highly accurate. The proposed method can effectively identify the tool wear state.

Internet of Things-Assisted Smart Skin Cancer Detection Using Metaheuristics with Deep Learning Model.

Internet of Things (IoT)-assisted skin cancer recognition integrates several connected devices and sensors for supporting the primary analysis and monitoring of skin conditions. A preliminary analysis of skin cancer images is extremely difficult because of factors such as distinct sizes and shapes of lesions, differences in color illumination, and light reflections on the skin surface. In recent times, IoT-based skin cancer recognition utilizing deep learning (DL) has been used for enhancing the early analysis and monitoring of skin cancer. This article presents an optimal deep learning-based skin cancer detection and classification (ODL-SCDC) methodology in the IoT environment. The goal of the ODL-SCDC technique is to exploit metaheuristic-based hyperparameter selection approaches with a DL model for skin cancer classification. The ODL-SCDC methodology involves an arithmetic optimization algorithm (AOA) with the EfficientNet model for feature extraction. For skin cancer detection, a stacked denoising autoencoder (SDAE) classification model has been used. Lastly, the dragonfly algorithm (DFA) is utilized for the optimal hyperparameter selection of the SDAE algorithm. The simulation validation of the ODL-SCDC methodology has been tested on a benchmark ISIC skin lesion database. The extensive outcomes reported a better solution of the ODL-SCDC methodology compared with other models, with a maximum sensitivity of 97.74%, specificity of 99.71%, and accuracy of 99.55%. The proposed model can assist medical professionals, specifically dermatologists and potentially other healthcare practitioners, in the skin cancer diagnosis process.

Inverter Fault Diagnosis for a Three-Phase Permanent-Magnet Synchronous Motor Drive System Based on SDAE-GAN-LSTM

In this study, a novel intelligent inverter fault diagnosis approach based on a stacked denoising autoencoder–generative adversarial network–long short-term memory (SDAE-GAN-LSTM) under an imbalanced sample is proposed for a three-phase permanent-magnet synchronous motor (PMSM) drive system. The proposed method can address the problem of unbalanced fault data samples and improve the accuracy of fault classification. Concretely speaking, firstly, the stacked denoising autoencoder (SDAE) is pre-trained to obtain the optimum decoder network. Afterward, a new generator of generative adversarial networks (GANs) is designed to generate high-quality samples by migrating the pre-trained optimal decoder network to the hidden layer and output layer of the generator of GANs. Additionally, a new model of long short-term memory (LSTM) based on the second discriminator of the GANs is presented for fault diagnosis. The generator of GANs is cross-trained using the reconstruction error gained by SDAE and the fault diagnosis error obtained by LSTM, resulting in the generation of high-quality samples for fault discrimination. Simulation and experimental results demonstrate the effectiveness of the proposed fault diagnosis approach, and the average fault identification accuracy reaches 98.63%.

A concatenation approach-based disease prediction model for sustainable health care system

In the present world, due to many factors like environmental changes, food styles, and living habits, human health is constantly affected by different diseases, which causes a huge amount of data to be managed in health care. Some diseases become life-threatening if they are not cured at the starting stage. Thus, it is a complex task for the healthcare system to design a well-trained disease prediction model for accurately identifying diseases. Deep learning models are the most widely used in disease prediction research, but their performance is inferior to conventional models. In order to overcome this issue, this work introduces the concatenation of Inception V3 and Xception deep learning convolutional neural network models. The proposed model extracts the main features and produces the prediction result more accurately than traditional predictive models. This work analyses the performance of the proposed model in terms of accuracy, precision, recall, and f1-score. It compares the proposed model to existing techniques such as Stacked Denoising Auto-Encoder (SDAE), Logistic Regression (LR), MLP, MLP with attention mechanism (MLP-A), Support Vector Machine (SVM), Multi Neural Network (MNN), and Hybrid Convolutional Neural Network (CNN)-Random Forest (RF).

Passenger flow prediction and management method of urban public transport based on SDAE model and improved Bi-LSTM neural network

In the era of big data, the exponentially increasing data volume and emerging technical tools have put forward new requirements for enterprise information management. Therefore, it is of great significance to enhance the core competitiveness of enterprises to explore how big data can empower the innovation of enterprise information management. Intelligent transportation system combines a variety of technologies and applies them to a large-scale transportation management system, so as to make a reasonable dispatch of traffic conditions. Aiming at the problem of the relatively low accuracy of bus passenger flow forecasting with the existing models, a short-term passenger flow prediction model combining Stacked Denoising Auto Encoder (SDAE) and improved bidirectional Long-short Term Memory network (Bi-LSTM) is proposed. First, the SDAE model is used to fill in the missing bus passenger flow data, the characteristics of the bus passenger flow data are effectively utilized, and the data with rich information is used to predict the missing values with high accuracy. Second, Bi-LSTM model combined with attention mechanism is used for short-term bus passenger flow prediction. Considering that the data sequence of bus passenger flow is relatively long and there is a two-way information flow, the BiLSTM neural network is used for prediction tasks, and the influence of key factors is highlighted through attention weights to mine the internal laws of passenger flow data. The experimental results show that the proposed method achieves the lowest prediction error among all the comparison methods in the task of short-term bus passenger flow prediction on the public transportation dataset, with MAE, MRE, and RMSE values of 6.014, 0.052, and 9.874, respectively. These findings confirmed the effectiveness of the new model in the passenger flow prediction field.