Stacked LSTM Research Articles

Deep learning models for hepatitis E incidence prediction leveraging Baidu index.

Infectious diseases are major medical and social challenges of the 21st century. Accurately predicting incidence is of great significance for public health organizations to prevent the spread of diseases. Internet search engine data, like Baidu search index, may be useful for analyzing epidemics and improving prediction. We collected data on hepatitis E incidence and cases in Shandong province from January 2009 to December 2022 are extracted. Baidu index is available from January 2009 to December 2022. Employing Pearson correlation analysis, we validated the relationship between the Baidu index and hepatitis E incidence. We utilized various LSTM architectures, including LSTM, stacked LSTM, attention-based LSTM, and attention-based stacked LSTM, to forecast hepatitis E incidence both with and without incorporating the Baidu index. Meanwhile, we introduce KAN to LSTM models for improving nonlinear learning capability. The performance of models are evaluated by three standard quality metrics, including root mean square error(RMSE), mean absolute percentage error(MAPE) and mean absolute error(MAE). Adjusting for the Baidu index altered the correlation between hepatitis E incidence and the Baidu index from -0.1654 to 0.1733. Without Baidu index, we obtained 17.04±0.13%, 17.19±0.57%, in terms of MAPE, by LSTM and attention based stacked LSTM, respectively. With the Baidu index, we obtained 15.36±0.16%, 15.15±0.07%, in term of MAPE, by the same methods. The prediction accuracy increased by 2%. The methods with KAN can improve the performance by 0.3%. More detailed results are shown in results section of this paper. Our experiments reveal a weak correlation and similar trends between the Baidu index and hepatitis E incidence. Baidu index proves to be valuable for predicting hepatitis E incidence. Furthermore, stack layers and KAN can also improve the representational ability of LSTM models.

Mitigating the Impact of Lognormal Atmospheric Turbulence Channel Estimation on FSO Communication Systems Using Advanced Deep Learning Modules

ABSTRACTCurrently, researchers and commercial entities worldwide are highly interested in optical wireless communication links operating in terrestrial environments. These links offer the distinct advantage of enabling high‐speed data transmission while keeping operational and installation costs low, all without requiring licensing. Free‐space optical (FSO) communication has established itself as a reliable method for delivering ultra‐high data‐rate services. However, the presence of atmospheric turbulence‐induced fading poses a significant challenge for FSO communication systems, particularly when operating over channels affected by time‐varying turbulence. The effectiveness of FSO systems is greatly influenced by atmospheric conditions in a specific area because the laser beam propagates through the atmosphere. As a consequence, this can lead to a significant degradation such as high complexity, high estimation error, and high bit error rate (BER) in the performance of FSO systems. This paper presents a stacked dual attention LSTM network with layered neural Turing machine (SDALSTM‐LaNTM) for FSO channel estimation over lognormal turbulence‐induced fading channels. In this approach, the stacked structure ensures a robust feature extraction capacity of SDALSTM and enhances its ability to capture intricate relationships among multiple atmospheric variables. After employing the stacked LSTM networks, the extracted features are combined with the augmented features obtained through the dual attention (DAttn) mechanism by concatenation. Then the LaNTM architecture used external memory to solve the channel parameter estimation problem and update new set of hidden features for estimation task. The ability to access and update memory enables the model to capture long‐term dependencies and context, making it beneficial for channel prediction in FSO systems. Presently, we are in the process of verifying the channel estimation model using measured FSO channel data. Simulation results clearly demonstrate the outstanding estimation performance of the SDALSTM‐LaNTM model in FSO systems, specifically when dealing with lognormal turbulence‐induced fading channels. Moreover, we highlight the effectiveness of the SDALSTM‐LaNTM model by conducting a comprehensive comparison with existing models, considering factors such as average capacity performance, outage probability estimation, and BER.

Development of optimization control system for chiller plant based on a predictive model with Multi Stack LSTM and Deep Learning Neural Network Multi Output

Net-zero emissions become necessary for every country, implementing energy efficiency is the way to achieve it. Released report by the International Energy Agency in September 2022 stated that energy efficiency and electrification are the main priorities for Indonesia in achieving NZE. Currently, more than 50 % of energy consumption in buildings is intended for cooling systems (chillers plants). Thus, energy efficiency in buildings cooling systems has great potential to help achieve NZE and support SDGs. This research is intended to find an optimization control system for chiller plant in order to reduce energy consumption of cooling system in building. The development of this optimization control system is based on predictive model with Multi Stack LSTM and Deep Learning Neural Network. This research developed four different optimization control system frameworks. Every developed framework then will be tested by carrying out simulation with Chiller Plant model. The important parameter was found by using correlation matrix. Based on the correlation matrix, it was found that the most influence parameter that affect chiller plant performance are Tcws and Twb. It leads developed Frameworks 1 become the best compared with others developed frameworks in this research, because it used Twb as a variable input in parallel with performance prediction. This developed framework has deficient error MAE, MSE, RMSE respectively 0.8079, 0.6527, 0.8079 and able to reduce energy consumption by 10.72 %.

A stacked LSTM model for day-ahead solar irradiance forecasting under tropical seasons in Java-Bali

A stacked LSTM model for day-ahead solar irradiance forecasting under tropical seasons in Java-Bali

Multivariate Deep Learning Long Short-Term Memory-Based Forecasting for Microgrid Energy Management Systems

In the scope of energy management systems (EMSs) for microgrids, the forecasting module stands out as an essential element, significantly influencing the efficacy of optimal solution policies. Forecasts for consumption, generation, and market prices play a crucial role in both day-ahead and real-time decision-making processes within EMSs. This paper aims to develop a machine learning-based multivariate forecasting methodology to account for the intricate interplay pertaining to these variables from the perspective of day-ahead energy management. Specifically, our approach delves into the dynamic relationship between load demand variations and electricity price fluctuations within the microgrid EMSs. The investigation involves a comparative analysis and evaluation of recurrent neural networks’ performance to recognize the most effective technique for the forecasting module of microgrid EMSs. This study includes approaches based on Long Short-Term Memory Neural Networks (LSTMs), with architectures ranging from Vanilla LSTM, Stacked LSTM, Bi-directional LSTM, and Convolution LSTM to attention-based models. The empirical study involves analyzing real-world time-series data sourced from the Australian Energy Market (AEM), specifically focusing on historical data from the NSW state. The findings indicate that while the Triple-Stacked LSTM demonstrates superior performance for this application, it does not necessarily lead to more optimal operational costs, with forecast inaccuracies potentially causing deviations of up to forty percent from the optimal cost.

Forecasting of COVID-19 Cases Under Different Precaution Strategies in Turkey

The coronavirus disease started at the end of 2019 and affected all the countries in the world. In Turkey, the vaccination process started at the beginning of 2021 but performed in slow progress. Thus, the Turkish Government tried to implement precautions to control this virus's spread. In this study, we evaluated and compared five different forecasting models, ARIMA, Prophet, NARNN, Stacked LSTM, and Bidirectional LSTM, in order to show the effect of these precaution strategies on virus spread using a real-world data set. According to the test results, ARIMA and Prophet were found to be the most accurate models for small data sets that are split regarding precautions. Moreover, test results showed that when data size grows, LSTM model performance increases. However, these models' performance decreased when we fed these models by using the entire data set without splitting.

Potato Consumption Forecasting Based on a Hybrid Stacked Deep Learning Model

AbstractPotato consumption forecasting is crucial for several stakeholders in the food market. Due to the market flexibility, the farmers can manipulate the volumes planted for a given type of produce to reduce costs and improve revenue. Consequently, it means that establishing optimal inventories or inventory levels is possible and critical in that sense for the sellers to avoid either inadequate inventory or excessive inventories that may lead to wastage. In addition, governments can predict future food deficits and put measures in place to guarantee that they have a steady supply of food some of the time, especially in regions that involve the use of potatoes. Increased potato-eating anticipation has advantages for the sellers and buyers of the potatoes. The experiments of this study employed various machine learning and deep learning (DL) models that comprise stacked long short-term memory (Stacked LSTM), convolutional neural network (CNN), random forest (RF), support vector regressor (SVR), K-nearest neighbour regressor (KNN), bagging regressor (BR), and dummy regressor (DR). During the study, it was discovered that the Stacked LSTM model had superior performance compared to the other models. The Stacked LSTM model achieved a mean squared error (MSE) of 0.0081, a mean absolute error (MAE) of 0.0801, a median absolute error (MedAE) of 0.0755, and a coefficient of determination (R2) value of 98.90%. These results demonstrate that our algorithms can reliably forecast global potato consumption until the year 2030.

Multi-sensor signal fusion for tool wear condition monitoring using denoising transformer auto-encoder Resnet

Multi-sensor signal fusion is commonly used in associate with the artificial intelligence model to monitor tool wears. However, AI models equipped with limited multi-sensor training samples still exist problems: 1) The limitation of training samples may cause the AI model failure due to the intrinsic wear features contaminated by heavy noises. 2) The selection of multi-sensor signals as training samples is a difficult task for the negative impact on the recognition accuracy using inappropriate sensor features. Therefore, this paper proposes a denoise transformer Auto-Encoder (DTAE) as pre-processor for the tool condition monitoring (TCM) classifiers. The reconstruction task of the DTAE allows the model to pay more attention to the intrinsic wear features and the appropriate selection of them from the multi-sensor signals during feature extraction. Moreover, the loss function for DTAE ResNet is formed by summing the reconstruction loss from DTAE with the classification loss from ResNet. Compared DTAE ResNet to stacked sparse auto-encoder network, deep stacked auto-encoder network, ResNet-18, VGG-16, and LSTM, experiments demonstrated that the present method would attain the highest classification accuracies for tool wear suitable for TCM. And a comparative experiment was conducted to verify the effectiveness of the DTAE preprocessor in improving the anti-noise performance of the classifier.

Accurate detection of melanoma skin cancer using fuzzy based SegNet model and normalized stacked LSTM network

Accurate detection of melanoma skin cancer using fuzzy based SegNet model and normalized stacked LSTM network

Application of multi-source data fusion on intelligent prediction of photovoltaic power

Accurate photovoltaic power prediction is crucial for reducing the uncertainty of photovoltaic systems in grid operation. Variations in cloud cover are one of the primary factors leading to fluctuations in photovoltaic power generation. However, clouds possess highly complex three-dimensional structures. Existing photovoltaic power prediction methods typically rely on two-dimensional cloud images, which are insufficient for fully capturing the impact of clouds on photovoltaic power generation. To address these challenges, this paper proposes a Multi-source data Photovoltaic power Prediction Model (MPPM) based on satellite cloud images and meteorological data. MPPM mainly includes SpatioTemporal feature Conditional Diffusion Model (STCDM), Attention Stacked LSTM network (ASLSTM) and Multidimensional Feature Fusion Module (MFFM). STCDM model utilizes a diffusion model to accurately forecast two-dimensional satellite cloud imagery. ASLSTM extracts the features of three-dimensional meteorological elements. MFFM module integrates the two-dimensional satellite cloud imagery features with the three-dimensional meteorological element features. The two-dimensional satellite cloud imagery reflects the visible aspect of cloud layers, while the three-dimensional meteorological data, which includes cloud water and ice content correlated with altitude, mainly captures the invisible aspect of cloud layers. These two sets of information complement each other, enabling a more comprehensive capture of the three-dimensional characteristics of clouds. Satellite cloud image prediction experiment and photovoltaic power prediction experiment are carried out on STCDM and MPPM model respectively. The experimental results demonstrate that the STCDM model achieved a Structural Similarity index (SSIM) of 0.909 for predicting satellite cloud imagery within 1 h and 0.789 within 24 h. Meanwhile, the MPPM model attained a pearson Correlation coefficient (CORR) of 0.945 for predicting PV power within 1 h and 0.856 within 24 h. These findings indicate that both the STCDM and MPPM models outperform other comparative algorithms in forecasting satellite cloud imagery and PV power.

Predicting Energy Consumption Using Stacked LSTM Snapshot Ensemble

Predicting Energy Consumption Using Stacked LSTM Snapshot Ensemble

A novel multi-step-ahead approach for cloud server aging prediction based on hybrid deep learning model

Predicting software aging in cloud servers is essential for preventing cloud system breakdown and unexpected failures. However, the aging time series data in cloud servers often exhibits non-linearity and stochastic fluctuations, posing challenges for accurate prediction. To address this issue, this study proposes a novel multi-step ahead approach for cloud server aging prediction. Firstly, the original aging time series data is denoised using discrete wavelet transformation (DWT) and then reconstructed into multi-dimensional data by phase state reconstruction (PSR) to capture potential aging patterns. Subsequently, a deep long short-term memory network (DLSTM) is developed to predict the aging trend. Additionally, a stacked auto-encoder LSTM (SAE-LSTM) is designed to optimize the initial weight matrix of DLSTM to enhance prediction abilities. Finally, multi-step prediction experiments are conducted on our time series datasets from OpenStack cloud servers and a public dataset from Alibaba Cluster Trace Program. The comparative analysis of the proposed method with five baseline methods confirms its superiority in terms of prediction accuracy. For response time and free memory test sets, the range of root mean square error (RMSE) values are produced by the proposed method distributed in [0.1688–0.1931] and [139.05–146.05] respectively, with respect to the multi-step ahead prediction horizon from 1 up to 10. These results demonstrate that the proposed method can tackle the limitations of one-step ahead prediction, effectively extracting relevant aging features, and achieving low prediction accuracy. The study provides valuable insights into revealing future aging trends in cloud servers and offers a reference for implementing preventive maintenance and prognostics in cloud servers.

Application of Artificial Neural Network Methods to Anatolian Plate Earthquake Magnitude and Location Prediction

Same-region earthquakes usually have a pattern that is difficult to identify clearly. Therefore, time series analysis methods have been proposed for earthquake prediction. Our work attempts to predict three earthquake parameters in the Anatolian Peninsula using pure artificial neural network methods. An optimized BP-NN model and optimally hyper-parameterized LSTM Model have been designed to predict earthquake magnitude, latitude, and longitude. The two models are compared among each other and with previous works for their prediction performances, using four well-accepted metrics: Mean Squared Error, Mean Absolute Error, Median Absolute Error, and Standard Deviation. The time, depth, sun, and moon distances to Earth were identified as the most contributing factors in earthquake occurrence through analysis by five different feature extraction algorithms. The date harmed the prediction accuracy. The LSTM model outperformed the BP-NN Model in magnitude prediction with 0.062 MSE. Latitude predictions of both methods were satisfactory and close. However, BP-NN had lower error rates in latitude prediction. However, longitude prediction errors were large in both models. Therefore, our designs were not successful in predicting the exact location of the earthquakes. However, multi-variate, stacked LSTM models are promising in predicting Anatolian Peninsula earthquake magnitudes, but future work is necessary for location and timing predictions.

Stock Market Price Prediction and Forecasting Using Stacked LSTM

Stock price movement is non-linear and complex. Several research works have been carried out to predict stock prices. Traditional approaches such as Linear Regression and Support Vector Regression were used but accuracy was not adequate. Researchers have tried to improve stock price prediction using ARIMA. Due to very high variations in stock prices, deep learning techniques are applied due to its proven accuracy in various analytics fields. Artificial Neural Network was deployed to predict stock prices but as stock prices are time-series based, recurrent neural network was applied to further improve prediction accuracy. Therefore, data scientists and analysts found that Deep Learning outperformed Machine Learning which is also proofed by all the collected research papers, and it is the most suitable methodologies to apply to the stock market forecasting domain. This paper explores different stacked LSTM Models for non-stationary financial time series in stock price prediction. This study is to predict stock market prices to make more acquaint and precise investment decisions. The experimental result will show that, this method can get quite accurate result, particularly effective in stock prediction. The proposed LSTM model will be designed to overcome gradient explosion, gradient vanishing, and save long-term memory. Firstly, The Model will have a comparative analysis between different LSTM models and integrating the model based on the result obtained from the analysis. The results will suggest that the developed stacked LSTM produces better predictive power and generalization. Key Words: stock market prediction, stacked LSTM, Deep Learning, Data pre-processing techniques, Data normalization, Neural Networks, Data Visualization, Training and Testing Set, Time series analysis, Predictive models, Future Forecasting.

Forecasting surface movements based on PSI time series using machine learning algorithms

ABSTRACT Surface movements pose a critical issue requiring prompt detection and monitoring to ensure safety. To address this concern, the detection and continuous monitoring of surface deformations have gained importance. While numerous point-based surveying methods exist, multi-temporal interferometric synthetic aperture radar (InSAR) analysis has emerged as a powerful technique capable of detecting deformations across large areas with freely available SAR images and software. However, the significance of surface movement forecasting must be addressed, as it plays a significant role in preventing accidents and implementing precautionary measures. In light of this, a comprehensive study was conducted at the new Istanbul Airport in Türkiye, employing the Persistent Scatterer InSAR (PSI) method with a collection of 211 Sentinel-1 SAR images. The results obtained were investigated, and six test case regions were determined for the forecasting analysis in terms of time series movement type (subsidence, uplift, and stable) and structure type (runway and building) using various machine learning (ML) algorithms. To accomplish this, regression-based and sequential-based ML algorithms were employed and compared, showing the potential of cutting-edge techniques. The Stacked LSTM algorithm was the most effective in generating accurate forecasts. Furthermore, by incorporating exogenous variables into the forecasting analysis, the study improved the accuracy of the results. To gain deeper insights into the impact of these exogenous variables, feature importance analysis was conducted using the permutation feature importance method. The results obtained were examined, considering both the structure type and the characteristics of the time series data.

Emotion Detection using Stack Auto Encoder, Deep Learning and LSTM Model

Emotion Detection using Stack Auto Encoder, Deep Learning and LSTM Model

Stock price prediction and forecasting using stacked LSTM in a smart environment

Stock price prediction and forecasting using stacked LSTM in a smart environment

Research on the artistic aesthetic value of violin performance under the integration of information technology

Abstract This study utilizes the ERP model of aesthetic cognition to reveal the neural basis of aesthetic experience, pointing out the complex cognitive processes including emotional escalation. Advanced techniques are used to pre-process violin sound signals and multiple algorithms are applied to extract critical features for accurate emotion recognition. The developed DBM-LSTM model combines the advantages of multi-layer stacked RBM and LSTM, which substantially improves emotion recognition accuracy with a success rate of more than 0.85. Finally, through a questionnaire survey, it is found that the public’s aesthetic preference of violin performance is significantly correlated with emotion perception, indicating that the more the performance conforms to the public’s aesthetics, the more it can stimulate positive emotions. This study not only provides theoretical and practical guidance on the combination of violin performance art and information technology, but also opens up a new way for the emotional communication of artistic performances and enhancing public aesthetic experience.

Analyzing Sentiments using Optimized Novel Ensemble Fuzzy and DL based Approach with Efficient Feature Selection and Extraction Models

The most popular and active area of data mining study is sentiment analysis. Twitter is a crucial platform for collecting and distributing people’s thoughts, feelings, views, and attitudes regarding specific entities. There are several social media networks available today. In light of this, sentiment analysis in the Natural Language Processing (NLP) field became fascinating. Various methods for analyzing sentiment have been explored. However, improvements are still required regarding reliability and system efficacy. Additionally, user emotional expressions typically take the form of naturally occurring human-written textual data with numerous noises and ambiguities. The intricate contextual significance of sentiment expressions is difficult for present studies on sentiment analysis to precisely capture and interpret, particularly in linguistics with complex frameworks. To address these issues, we presented a new integrated fuzzy neural network. The proposed framework is developed for effective and efficient feature selection and hybrid approach based sentiment analysis. Ensemble of novel Deep Convolutional Neuro-Fuzzy Inference System (DCNFIS) and Deep Learning-based (DL) Long short-term memory neural network multilayer stacked bidirectional LSTM neural network analyzes the sentiments. The provided dataset is initially cleaned up and filtered out as part of preprocessing. Utilizing the preprocessed data, sentiment-based features are extracted using the inception-ResNet-V2 model. Then, the relevant features are selected by employing the Enhanced Reptile Search Algorithm (ERSA). The Al-Biruni Earth Radius (BER) optimization algorithm is used to optimize the hyperparameters of the ensemble approach, which analyzes the sentiment categories such as positive, negative, very positive, very negative, and neutral. Finally, an effectiveness assessment of the suggested and present classifiers is presented. Using three distinct research datasets, we conducted an experimental evaluation of the suggested model. While differentiating from the proposed approach, the proposed approach yields a greater performance of 98.97% recall, 99.06% precision, 99.13% accuracy and 99.01% F1-score. The experimental investigation analyzes that the proposed approach gains superior performance over existing approaches

Assessment of Stacked LSTM, Bidirectional LSTM, ConvLSTM2D, and Auto Encoders LSTM Time Series Regression Analysis at ADITYA-U Tokamak

Assessment of Stacked LSTM, Bidirectional LSTM, ConvLSTM2D, and Auto Encoders LSTM Time Series Regression Analysis at ADITYA-U Tokamak