Long Short-term Memory For Prediction Research Articles

Prediction model of land surface settlement deformation based on improved LSTM method: CEEMDAN-ICA-AM-LSTM (CIAL) prediction model.

The uneven settlement of the surrounding ground surface caused by subway construction is not only complicated but also liable to cause casualties and property damage, so a timely understanding of the ground settlement deformation in the subway excavation and its prediction in real time is of practical significance. Due to the complex nonlinear relationship between subway settlement deformation and numerous influencing factors, as well as the existence of a time lag effect and the influence of various factors in the process, the prediction performance and accuracy of traditional prediction methods can no longer meet industry demands. Therefore, this paper proposes a surface settlement deformation prediction model by combining noise reduction and attention mechanism (AM) with the long short-term memory (LSTM). The complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) and independent component analysis (ICA) methods are used to denoise the input original data and then combined with AM and LSTM for prediction to obtain the CEEMDAN-ICA-AM-LSTM (CIAL) prediction model. Taking the settlement monitoring data of the construction site of Urumqi Rail Transit Line 1 as an example for analysis reveals that the model in this paper has better effectiveness and applicability in the prediction of surface settlement deformation than multiple prediction models. The RMSE, MAE, and MAPE values of the CIAL model are 0.041, 0.033 and 0.384%; R2 is the largest; the prediction effect is the best; the prediction accuracy is the highest; and its reliability is good. The new method is effective for monitoring the safety of surface settlement deformation.

Performance Comparison Between Artificial Neural Network, Recurrent Neural Network and Long Short-Term Memory for Prediction of Extreme Climate Change

Extreme climate change is the most common problem in Indonesia. Extreme climate change for months can cause various natural disasters. Therefore, it is necessary to make predictions about climate change that will occur in order to avoid the risk of future conflicts. This study uses the Artificial Neural Network (ANN), Recurrent Neural Network (RNN) and Long Short Term Memory (LSTM) algorithms by comparing the performance of the three using Mean Squared Error (MSE), Root Mean Squared Error (RMSE) and Mean Absolute Percentage Error (MAPE) evaluations. The results of this study indicate that RNN is better at predicting temperature in Indonesia compared to ANN and LSTM. This is evidenced by the MAPE value generated by the RNN which is smaller than the ANN and LSTM, which is 1.852 %, the RMSE value is 1,870, and the MSE value is 3,497.

A lightweight CORONA-NET for COVID-19 detection in X-ray images.

Since December 2019, COVID-19 has posed the most serious threat to living beings. With the advancement of vaccination programs around the globe, the need to quickly diagnose COVID-19 in general with little logistics is fore important. As a consequence, the fastest diagnostic option to stop COVID-19 from spreading, especially among senior patients, should be the development of an automated detection system. This study aims to provide a lightweight deep learning method that incorporates a convolutional neural network (CNN), discrete wavelet transform (DWT), and a long short-term memory (LSTM), called CORONA-NET for diagnosing COVID-19 from chest X-ray images. In this system, deep feature extraction is performed by CNN, the feature vector is reduced yet strengthened by DWT, and the extracted feature is detected by LSTM for prediction. The dataset included 3000 X-rays, 1000 of which were COVID-19 obtained locally. Within minutes of the test, the proposed test platform's prototype can accurately detect COVID-19 patients. The proposed method achieves state-of-the-art performance in comparison with the existing deep learning methods. We hope that the suggested method will hasten clinical diagnosis and may be used for patients in remote areas where clinical labs are not easily accessible due to a lack of resources, location, or other factors.

A Hybrid Model Based on CNN-LSTM to Detect and Forecast Harmonics: A Case Study of an Eskom Substation in South Africa

The ever-growing modern smart grid with more distributed energy resources is providing efficient energy supply while facing several challenges that include harmonics induced among many. Previous and present literature shows that various machine and deep learning models are superior and accurate as compared to the traditional and conventional signal processing techniques. Obtaining accurate results becomes extremely important especially the fact that harmonics are essentially nonlinear, nonparametric, and adaptive in nature. This paper proposes a novel forecasting model that aggregates two deep learning models: convolutional neural network (CNN) and long short term memory (LSTM) recurrent neural network (RNN) detect and forecast harmonics in a power system. CNN-LSTM hybrid forecasting model for harmonics in the power grid system has achieved significantly superior performance in collaborative data mining on spatiotemporal measurement data. Sample features are extracted using CNN before they are passed through LSTM for prediction. To show the superiority of the hybrid CNN-LSTM deep neural prediction network model, it is compared with CNN, LSTM and NARX (Non-Linear Autoregressive with External (Exogenous) Input). CNN-LSTM forecasting performance is superior as compared to the other four models. MSE and RMSE for CNN-LSTM are 0.00038 (〖3.8 × 10〗^ (−4)) and 0.0000014917 (1.4917 × 10^(−6)) respectively.

Variable Perturbation Based Fault Diagnosis for Industrial Process

Real-time fault detection, classification and diagnosis in manufacturing and process industries is essential to prevent unplanned downtime and improve the reliability of industrial operations. While several well-accepted machine learning techniques exist for fault detection and classification, there is a need for a reliable and generalized fault diagnosis technique that identifies sensors responsible for industrial faults in real time. In this work, we propose a variable perturbation matrix-based method for fault diagnosis in industrial processes. We utilize the Long ShortTerm Memory for prediction due to its ability to memorize temporal information in time-series data. First, the fault is detected, then one or more independent variables are perturbed across the fault detection point to check the sensitivity of the diagnosis model for the corresponding variables. Thus, a perturbation matrix is calculated and variables with high sensitivity are selected as the variables responsible for fault. The proposed method is applied to an Industry 4.0 quality control test bed set up for electronic components, the dataset for which is provided in the Prognostics and Health Management Euorpe-21 (PHME-21) data challenge. The proposed method accurately detected and classified 6 faults in the test bed and correctly diagnosed the most significant variables. Due to high fault detection accuracy coupled with sensitivity-based fault diagnosis, the method is suitable for multivariate industrial systems.

A Study on Sensor System Latency in VR Motion Sickness

One of the most frequent technical factors affecting Virtual Reality (VR) performance and causing motion sickness is system latency. In this paper, we adopted predictive algorithms (i.e., Dead Reckoning, Kalman Filtering, and Deep Learning algorithms) to reduce the system latency. Cubic, quadratic, and linear functions are used to predict and curve fitting for the Dead Reckoning and Kalman Filtering algorithms. We propose a time series-based LSTM (long short-term memory), Bidirectional LSTM, and Convolutional LSTM to predict the head and body motion and reduce the motion to photon latency in VR devices. The error between the predicted data and the actual data is compared for statistical methods and deep learning techniques. The Kalman Filtering method is suitable for predicting since it is quicker to predict; however, the error is relatively high. However, the error property is good for the Dead Reckoning algorithm, even though the curve fitting is not satisfactory compared to Kalman Filtering. To overcome this poor performance, we adopted deep-learning-based LSTM for prediction. The LSTM showed improved performance when compared to the Dead Reckoning and Kalman Filtering algorithm. The simulation results suggest that the deep learning techniques outperformed the statistical methods in terms of error comparison. Overall, Convolutional LSTM outperformed the other deep learning techniques (much better than LSTM and Bidirectional LSTM) in terms of error.