LSTM Research Articles

DAPNet: A Dual-Attention Parallel Network for the Prediction of Ship Fuel Consumption Based on Multi-Source Data

The precise prediction of ship fuel consumption (SFC) not only serves to enhance energy efficiency to benefit shipping enterprises but also to provide quantitative foundations to aid in carbon emission reduction and ecological environment protection. On the other hand, SFC-related data represent typical multi-source characteristics and heterogeneous features, which lead to several methodological issues (e.g., feature alignment and feature fusion) in SFC prediction. Therefore, this paper proposes a dual-attention parallel network named DAPNet to solve the above issues. Firstly, we design a parallel network structure containing two kinds of long short-term memory (LSTM) and improved temporal convolutional networks (TCNs) for time-series analysis tasks so that different source data can be applied to suitable networks. Secondly, a local attention mechanism is included in each single parallel network so as to improve the ability of feature alignment from different-scale training data. Finally, global attention is employed for the fusion of all parallel networks, which can enrich representation features and simultaneously enhance the performance of SFC prediction. In experiments, DAPNet is compared with 10 methods, including baseline and attention models. The comparison results show that DAPNet and several of its variants obtain the highest accuracy in SFC prediction.

Multi-Step Ageing Prediction of NMC Lithium-Ion Batteries Based on Temperature Characteristics

The performance of lithium-ion batteries depends strongly on their ageing state; therefore, the monitoring and the prediction of the battery state of health (SoH) is necessary for an optimized and secured functioning of battery systems. This paper evaluates and compares three artificial neural network architectures for multi-step ageing prediction of lithium-ion cells: Recurrent Neural Network (RNN), Gated Recurrent Unit (GRU) and Long short-term memory (LSTM). These models use the features extracted from the cell’s temperature to predict the cell’s capacity. The features are extracted from experimental measurements of the cell’s surface temperature and selected based on Spearman correlation analysis. The prediction results were evaluated and compared considering three different percentages of the training dataset: 60%, 70%, and 80%. Training and testing data were generated experimentally based on accelerated ageing cycling tests. During these experiments, four Nickel Manganese Cobalt/Graphite (NMC) cells were cycled under a controlled temperature environment based on a dynamic current profile extracted from the Worldwide Harmonized Light Vehicles Test Cycles.

Detection of Android Malware Using Word2Vec and Deep Learning

To fortify Android devices against evolving threats, the project unfolds with a commitment to contribute to security endeavors significantly. The core purpose is to leverage machine-learning techniques, particularly deep-learning architectures, to construct robust mechanisms for identifying and classifying Android malware. A hybrid deep learning model combining Long Short-Term Memory (LSTM) networks with Convolutional Neural Networks (CNN) is employed to classify the applications as benign or malicious. The LSTM-CNN model is designed to effectively capture both temporal dependencies and spatial patterns within the feature vectors. Additionally, a Random Forest classifier is used to identify the most important features for classification, improving the performance and efficiency of the deep learning model. The proposed approach is evaluated on the CICMalDroid2020 dataset, demonstrating its ability to detect and classify Android malware accurately. This highlights the effectiveness of static feature analysis combined with advanced deep learning architectures for enhancing Android malware detection systems.

스마트팜 데이터를 활용한 오이 출하량 예측 시계열 모델 연구

This study utilizes data collected by the Rural Development Administration from smart farm sites to identify key variables affecting cucumber shipment and proposes the most accurate prediction model through comparative analysis of various forecasting models. The dataset includes daily weather conditions, cultivation environments, and management activities from 36 different crop seasons. The predictive models used in this study include Multiple Regression, ARIMA(Auto Regressive Integrated Moving Average), LSTM(Long Short-Term Memory), and SARIMA(Seasonal Auto Regressive Integrated Moving Average). Model performance was evaluated using RMSE and MAE, with SARIMA demonstrating the best results. By optimizing the hyperparameters, SARIMA's prediction accuracy improved significantly, effectively capturing the strong seasonality in cucumber shipments.

Enhancing Underwater SLAM Navigation and Perception: A Comprehensive Review of Deep Learning Integration

Underwater simultaneous localization and mapping (SLAM) is essential for effectively navigating and mapping underwater environments; however, traditional SLAM systems have limitations due to restricted vision and the constantly changing conditions of the underwater environment. This study thoroughly examined the underwater SLAM technology, particularly emphasizing the incorporation of deep learning methods to improve performance. We analyzed the advancements made in underwater SLAM algorithms. We explored the principles behind SLAM and deep learning techniques, examining how these methods tackle the specific difficulties encountered in underwater environments. The main contributions of this work are a thorough assessment of the research into the use of deep learning in underwater image processing and perception and a comparison study of standard and deep learning-based SLAM systems. This paper emphasizes specific deep learning techniques, including generative adversarial networks (GANs), convolutional neural networks (CNNs), long short-term memory (LSTM) networks, and other advanced methods to enhance feature extraction, data fusion, scene understanding, etc. This study highlights the potential of deep learning in overcoming the constraints of traditional underwater SLAM methods, providing fresh opportunities for exploration and industrial use.

Enhancing Regional Wind Power Forecasting through Advanced Machine-Learning and Feature-Selection Techniques

In this study, an in-depth analysis is presented on forecasting aggregated wind power production at the regional level, using advanced Machine-Learning (ML) techniques and feature-selection methods. The main problem consists of selecting the wind speed measuring points within a large region, as the wind plant locations are assumed to be unknown. For this purpose, the main cities (province capitals) are considered as possible features and four feature-selection methods are explored: Pearson correlation, Spearman correlation, mutual information, and Chi-squared test with Fisher score. The results demonstrate that proper feature selection significantly improves prediction performance, particularly when dealing with high-dimensional data and regional forecasting challenges. Additionally, the performance of five prominent machine-learning models is analyzed: Long Short-Term Memory (LSTM) networks, Artificial Neural Networks (ANNs), Support Vector Machines (SVMs), Convolutional Neural Networks (CNNs), and Extreme-Learning Machines (ELMs). Through rigorous testing, LSTM is identified as the most effective model for the case study in northern Italy. This study offers valuable insights into optimizing wind power forecasting models and underscores the importance of feature selection in achieving reliable and accurate predictions.

A parsimonious setup for streamflow forecasting using CNN-LSTM

ABSTRACT Significant strides have been made in advancing streamflow predictions, notably with the introduction of cutting-edge machine-learning models. Predominantly, long short-term memories (LSTMs) and convolution neural networks (CNNs) have been widely employed in this domain. While LSTMs are applicable in both rainfall-runoff and time-series settings, CNN–LSTMs have primarily been utilized in rainfall-runoff scenarios. In this study, we extend the application of CNN–LSTMs to time-series settings, leveraging lagged streamflow data in conjunction with precipitation and temperature data to predict streamflow. Our results show a substantial improvement in predictive performance in 21 out of 32 HUC8 basins in Nebraska, showcasing noteworthy increases in the Kling–Gupta efficiency values. These results highlight the effectiveness of CNN–LSTMs in time-series settings, particularly for spatiotemporal hydrological modeling, for more accurate and robust streamflow predictions.

Long-short-term memory (LSTM)-based modeling of the stiffness of 3D-printed PLA parts

This study applied a computationally efficient Taguchi-based long-short-term memory (LSTM) algorithm to predict the elastic modulus of 3D-printed polylactic acid (PLA) specimens. 128 data points were collected from the literature, and 80% were allocated for training and the rest for the validation of the LSTM algorithm. The results suggested that the LSTM algorithm, configured with 25 units in the first memory cell, 100 units in the second memory cell, the “selu” activation function in the first memory cell, the “elu” activation function in the second memory cell, the RMSprop optimizer, and a learning rate of 0.01, was precisely able to predict the elastic modulus of 3D-printed PLA parts.

Non-conventional feature-based LSTM model for prediction of bearing performance degradation

Abstract Mechanical bearings are critical in electrical machines, such as motors and generators. They provide support and facilitate the movement of rotating components in these machines. They are essential to the operation of electrical machinery cause they provide support, reduce friction, ensure proper alignment, and improve overall reliability and efficiency. The appropriate selection, installation, and maintenance of these bearings allow the longevity of such machines. The maintenance and the extent of usage determine the usefulness of the bearings. In predictive maintenance and condition monitoring, accurately predicting the level of bearing degradation holds significant importance for strategizing maintenance tasks, reducing downtime, and avoiding unforeseen breakdowns. This study centers on predicting the level of bearing degradation through the application of neural networks, focusing mainly on non-conventional features, rather than the usual features like kurtosis, and skewness. The dataset utilized is sourced from NASA and includes diverse time series signals that provide insights into the entire lifespan of the bearing. In this investigation, advanced machine learning techniques, long-short term memory (LSTM) in particular, are employed to harness the intricate patterns within the bearing dataset, aiming to improve the accuracy of the predictions.

Optimizing Precipitation Forecasting and Agricultural Water Resource Allocation Using the Gaussian-Stacked-LSTM Model

Our study investigates the use of machine learning models for daily precipitation prediction using data from 56 meteorological stations in Jilin Province, China. We evaluate Stacked Long Short-Term Memory (LSTM), Transformer, and Support Vector Regression (SVR) models, with Stacked-LSTM showing the best performance in terms of accuracy and stability, as measured by the Root Mean Square Error (RMSE). To improve robustness, Gaussian noise was introduced, particularly enhancing predictions for zero-precipitation days. Key predictors identified through variable attribution analysis include temperature, dew point, prior precipitation, and air pressure. Additionally, we demonstrate the practical benefits of precipitation forecasts in optimizing water resource allocation. A prediction-based strategy outperforms equal distribution in managing resources efficiently, as shown in a case study using 2022 Beidahu data. Overall, our research advances precipitation forecasting through deep learning and offers valuable insights for water resource management.

Developing a neural network model to predict the optimal minimum flow rate for effective hole cleaning

The object of the study is effective well cleaning during drilling. The subject of the study is the development of a machine learning model based on a neural network for predicting the optimal minimum drilling fluid flow rate. The challenge is the need to improve well cleaning efficiency to prevent stuck pipes and the associated downtime and costs. During the study, a neural network model was developed and tested to predict the minimum flow rate for cleaning wells. The model was trained and tested on data showing its high accuracy and reliability. The mean square error (MSE) reached 0.019169 for LSTM and 0.0828 for GRU, indicating the accuracy of the predictions. Neural network architectures such as Long-Short Term Memory (LSTM) and Gated Recurrent Unit (GRU) were used to efficiently process time series of data and consider long-term dependencies. The results are explained using advanced neural network architectures and machine learning algorithms, which made it possible to achieve good accuracy of predictions. These architectures enable efficient model training on large amounts of data, allowing complex dependencies and influencing factors to be considered. Distinctive features of the results include good accuracy of predictions and the ability to use the model in real-world conditions. The model demonstrates good performance and reliability in predicting the minimum flow rate. The results of the study can be used to optimize the processes of well drilling. Practical applications include using the model to predict the optimal minimum flow rate in various conditions, which will reduce the risks of stuck pipes and increase the efficiency of drilling operations. The model can be integrated into existing monitoring and control systems for drilling processes to improve their performance

Design and development of an ai-driven communication model for stimulating memory recall in patients with Alzheimer’s and other neurodegenerative diseases

This study presents the development and evaluation of an AI-driven communication tool designed to stimulate memory recall in patients with Alzheimer’s disease and other neurodegenerative disorders. The tool integrates machine learning algorithms, including Random Forest and Long Short-Term Memory (LSTM) networks, with mass communication theories to deliver personalized and adaptive communication strategies. The AI models were trained and tested on patient interaction data, enabling the tool to dynamically adjust its prompts based on real-time cognitive states. Performance metrics such as accuracy, precision, and AUC-ROC were used to assess model efficacy, with the Random Forest model achieving the highest performance across all metrics. Clinical trials demonstrated significant improvements in memory recall and emotional engagement in patients using the AI tool compared to standard cognitive stimulation therapy. Caregivers also reported higher satisfaction with the tool's usability and impact on patient interaction quality. These findings highlight the potential of AI-driven, personalized communication tools to revolutionize Alzheimer's care, offering scalable, adaptive interventions that improve cognitive and emotional health. Academically, this work advances the integration of AI and health communication, emphasizing culturally sensitive and patient-centered approaches. In healthcare, it presents a promising non-pharmacological intervention that can be easily scaled for widespread use, potentially reducing caregiver burden and improving patient outcomes.

Design of adaptive recommendation system for autism children using optimal feature selection-based adaptive dilated 1DCNN-LSTM with attention mechanism

One kind of neurological disorder is caused in the brain which is defined as Autism Spectrum Disorder (ASD). It has acquired the symptoms that appear in young children. In addition to that, it influences how the individual behaves and learns as well as communicates and interacts with others. More specifically, the term Autism is defined as a developmental disorder that impacts communication and social skills and it may vary from mental handicap cases to relieving superior cognitive abilities, intact, and the characteristic pattern of poor. Moreover, the school activities have acquired various difficulties to the given model that include changes in expected routines, intense sensory stimulation, noisy or disordered environments, and social interactions. Consequently, the conventional approaches face certain limitations like user privacy, scalability, and cold-start. Here, a novel suggestion system for autistic children is developed to detect distractions and anxious situations using deep learning and then treat the children based on their abilities. It has helped to prevent the risk to children. The data is given to the selection of the feature stage. The weight optimization is performed using the Modified Garter Snake Optimization Algorithm (MGSOA) during the selection of features. Then, the selected features are given to the Adaptive Dilated One Dimensional Conventional Neural Network (1DCNN) and Long Short-Term Memory (LSTM) with Attention Mechanism termed AD-1DCNN + LSTM-AMfor detecting the autism disorder for children. Here, the parameter optimization is performed using MGSOA optimization. It effectively forecasts the symptoms in a short time. This optimization helps to provide reliable and flexible outcomes for the developed recommendation system for autistic children. The developed recommendation system for autistic children is compared to baseline techniques with efficacy metrics to visualize elevated results.

Fortifying cloud environments against data breaches: A novel AI-driven security framework

As cloud computing continues to dominate the modern technological landscape, organizations face growing challenges in preventing data breaches and sophisticated cyber threats. The increasing complexity and scale of cloud environments require advanced security mechanisms to address evolving threats. This paper introduces "SecureCloudAI," a cutting-edge AI-driven security framework designed to fortify sensitive data within cloud infrastructures. SecureCloudAI leverages a hybrid approach that combines machine learning models like Random Forest and deep learning techniques, including Long Short-Term Memory (LSTM) networks, to detect, classify, and respond to potential security breaches in real-time. The system offers robust malware detection, network traffic analysis, and web intrusion detection while maintaining scalability and efficiency across large cloud environments. Experimental results demonstrate SecureCloudAI's high accuracy, with malware detection at 94.78% and network traffic classification at 90.92%, ensuring the system can handle both complex and emerging threats. This AI-driven solution marks a significant advancement in cloud security, providing organizations with an adaptive and scalable tool to safeguard their data against the ever-growing cyber threat landscape.

Enhancing Streamflow Prediction in Ungauged Basins Using a Nonlinear Knowledge‐Based Framework and Deep Learning

AbstractIn hydrology, a fundamental task involves enhancing the predictive power of a model in ungagged basins by transferring information on physical attributes and hydroclimate dynamics from gauged basins. Introducing an integrated nonlinear clustering framework, this study aims to develop a comprehensive framework that augments predictive performance in basins where direct measurements are sparse or absent. In this framework, uniform manifold approximation and projection (UMAP) is used as a nonlinear method to extract the essential features embedded in hydro‐climatological attributes and physical properties. Then, the Growing Neural Gas (GNG) clustering model is used to find the basins that potentially share similar hydro‐climatological behaviors. Besides UMAP‐GNG, the integration of Principal Component Analysis (PCA) as a linear method to reduce dimensionality with common clustering methods are also assessed to serve as benchmarks. The results reveal that the combination of clustering algorithms with the PCA method may lead to loss of information while the nonlinear method (UMAP) can extract more informative features. The efficacy of the proposed framework is assessed across the Contiguous United States (CONUS) by training a single Base Model using long short‐term memory (LSTM) for the centroids of all clusters and then, fine‐tuning the model on the centroids of each cluster separately to create a regional model. The results indicate that using the information extracted by the UMAP‐GNG method to guide a Base Model can significantly improve the accuracy in most of the clusters and enhance the median prediction accuracy within different clusters from 0.04 to 0.37 of KGE in ungauged basins.

LSTM‐based real‐time stress detection using PPG signals on raspberry Pi

AbstractStress, widely recognised for its profound adverse effects on both physical and mental health, necessitates the development of innovative real‐time detection methods. In this context, the escalating prevalence of wearable embedded systems, integrated with artificial intelligence (AI) for the continuous monitoring of critical physiological indicators like heart rate and blood pressure, accentuates their growing relevance in the efficient detection of stress. This article presents an innovative methodology employing deep learning algorithms on the Raspberry Pi 3, a platform distinguished by its cost‐effectiveness and limited resources. The authors have developed an advanced AI algorithm that achieves high accuracy in real‐time stress detection using photoplethysmography (PPG) sensors while significantly reducing computational demands. The authors’ method utilises an artificial neural network with long short‐term memory (LSTM) layers, proving highly effective in time‐series data analysis. In this study, the authors implement key TensorFlow toolkit optimisation techniques including quantisation aware training (QAT), Pruning and prune‐preserving quantisation aware training. These techniques are applied to refine the authors’ model, decreasing size and latency without sacrificing accuracy. The results highlight the LSTM‐based model's proficiency in accurately detecting stress using raw PPG sensor data on the Raspberry Pi 3, a comparatively affordable platform. The model attains an accuracy of 89.32% and an F1 score of 89.55% on the diverse wearable stress and affect detection stress‐level dataset. Additionally, the authors’ optimised model exhibits substantial reductions in both size and latency while maintaining high accuracy. This approach shows great potential for various applications, such as stress monitoring in healthcare, sports, and workplace settings. The use of the Raspberry Pi 3 makes the system portable, cost‐effective, and energy‐efficient, enhancing its potential impact and accessibility.

Sign language recognition using modified deep learning network and hybrid optimization: a hybrid optimizer (HO) based optimized CNNSa-LSTM approach.

Speech impairment limits a person's capacity for oral and auditory communication. Improvements in communication between the deaf and the general public can be progressed by a real-time sign language detector. Recent studies have contributed to make progress in motion and gesture identification processes using Deep Learning (DL) methods and computer vision. But the development of static and dynamic sign language recognition (SLR) models is still a challenging area of research. The difficulty is in obtaining an appropriate model that addresses the challenges of continuous signs that are independent of the signer. Different signers' speeds, durations, and many other factors make it challenging to create a model with high accuracy and continuity. This study mainly focused on SLR using a modified DL and hybrid optimization approach. Notably, spatial and geometric-based features are extracted via the Visual Geometry Group 16 (VGG16), and motion features are extracted using the optical flow approach. A new DL model, CNNSa-LSTM, is a combination of a Convolutional Neural Network (CNN), Self-Attention (SA), and Long-Short-Term Memory (LSTM) to identify sign language. This model is developed for feature extraction by combining CNNs for spatial analysis with SA mechanisms for focusing on relevant features, while LSTM effectively models temporal dependencies. The proposed CNNSa-LSTM model enhances performance in tasks involving complex, sequential data, such as sign language processing. Besides, a Hybrid Optimizer (HO) is proposed using the Hippopotamus Optimization Algorithm (HOA) and the Pathfinder Algorithm (PFA). The proposed model has been implemented in Python, and it has been evaluated over the existing models in terms of accuracy (98.7%), sensitivity (98.2%), precision (98.5%), Word Error Rate (WER) (0.131), Sign Error Rate (SER) (0.114), and Normalized Discounted Cumulative Gain (NDCG) (98%) as well. The proposed model has recorded the highest accuracy of 98.7%.

Financial Time Series Forecasting Based on Long-Short Term Memory, Complete Ensemble Empirical Mode Decomposition with Adaptive Noise and Batch Normalization

Long-short term memory (LSTM) is a state-of-art and widely used model to forecast financial time series. However, primitive LSTM networks do not perform well due to over-fitting problems of the deep learning model and nonlinear and non-stationary characteristics of financial time series data. In addition, complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) is an outstanding data frequency decomposition technique that can decompose original time series into several intrinsic mode functions and a residue. Thus, this paper proposed a novel hybrid network CEEMDAN-LSTM-BN based on LSTM. Specifically, to avoid over-fitting, the modified LSTM-BN network consists of two LSTM layers, two Batch Normalization (BN) layers following each LSTM layer, and a dropout layer. Each of the intrinsic mode functions and the residue would be processed by CEEMDAN-LSTM-BN and the final prediction results are obtained by reconstructing each predictive series. The advantages of the proposed CEEMDANLSTM-BN networks are verified by comparing them to primitive LSTM, other hybrid models, and some famous machine learning models. Moreover, the robustness of the networks is assessed by numerical experiments on different stock indices datasets.

Deep Learning Ensemble for Flood Probability Analysis

Predicting flood events is complex due to uncertainties from limited gauge data, high data and computational demands of traditional physical models, and challenges in spatial and temporal scaling. This research innovatively uses only three remotely sensed and computed factors: rainfall, runoff and temperature. We also employ three deep learning models—Feedforward Neural Network (FNN), Convolutional Neural Network (CNN), and Long Short-Term Memory (LSTM)—along with a deep neural network ensemble (DNNE) using synthetic data to predict future flood probabilities, utilizing the Savitzky–Golay filter for smoothing. Using a hydrometeorological dataset from 1993–2022 for the Nile River basin, six flood predictors were derived. The FNN and LSTM models exhibited high accuracy and stable loss, indicating minimal overfitting, while the CNN showed slight overfitting. Performance metrics revealed that FNN achieved 99.63% accuracy and 0.999886 ROC AUC, CNN had 95.42% accuracy and 0.893218 ROC AUC, and LSTM excelled with 99.82% accuracy and 0.999967 ROC AUC. The DNNE outperformed individual models in reliability and consistency. Runoff and rainfall were the most influential predictors, while temperature had minimal impact.

Text Comment Classification and Sentiment Analysis Model Based on LSTM

This study addresses the challenge of sentiment analysis and text classification in user-generated comments, an essential task for understanding public opinion in the digital age. With the widespread adoption of social media, the sheer volume of text data has increased exponentially, thereby necessitating advanced analytical tools. The study integrates Long Short-Term Memory (LSTM) networks with attention mechanisms to develop a model adept at both classifying and analyzing the sentiment of textual comments. The research methodology commences with data cleaning, tokenization, and feature extraction, subsequently followed by the implementation of a bidirectional LSTM architecture augmented with an attention mechanism. The model underwent rigorous training and testing on a comprehensive dataset, yielding high accuracy rates in sentiment analysis and text classification. The results underscore the model’s proficiency in capturing sentiment nuances and underscore its potential for deployment in e-commerce and content recommendation systems, emphasizing the practical implications of this research for enhancing decision-making processes in businesses and among policymakers.