Bidirectional Long Short-term Memory Research Articles

Hand Trajectory Recognition by Radar with a Finite-State Machine and a Bi-LSTM

Gesture plays an important role in human–machine interaction. However, the insufficient accuracy and high complexity of gesture recognition have blocked its widespread application. A gesture recognition method that combines state machine and bidirectional long short-term memory (Bi-LSTM) fusion neural network is proposed to improve the accuracy and efficiency. Firstly, gestures with large movements are categorized into simple trajectory gestures and complex trajectory gestures in advance. Afterwards, different recognition methods are applied for the two categories of gestures, and the final result of gesture recognition is obtained by combining the outputs of the two methods. The specific method used is a state machine that recognizes six simple trajectory gestures and a bidirectional LSTM fusion neural network that recognizes four complex trajectory gestures. Finally, the experimental results show that the proposed simple trajectory gesture recognition method has an average accuracy of 99.58%, and the bidirectional LSTM fusion neural network has an average accuracy of 99.47%, which can efficiently and accurately recognize 10 gestures with large movements. In addition, by collecting more gesture data from untrained participants, it was verified that the proposed neural network has good generalization performance and can adapt to the various operating habits of different users.

A new method for predicting precipitation δ18O distribution based on deep learning and spatio-temporal clustering

ABSTRACT Predicting precipitation δ18O accurately is crucial for understanding water cycles, paleoclimates, and hydrological applications. Yet forecasting its spatio-temporal distribution remains challenging due to complex climate interactions and extreme events. We developed a method combining spatio-temporal clustering and deep learning neural networks to improve multi-site, multi-year precipitation δ18O predictions. Using a comprehensive dataset from 33 German sites (1978–2012), our model considers precipitation δ18O and its controlling factors, including precipitation and temperature distribution. We applied the K-means ++ method for classification and divided data into training and prediction sets. The convolutional neural network (CNN) model extracted spatial features, while the bi-directional long short-term memory (Bi-LSTM) model focused on temporal features. Spatio-temporal clustering using K-means ++ improved forecast accuracy and reduced errors. This study highlights the potential of deep learning and clustering techniques for forecasting complex spatio-temporal data and offers insights for future research on isotope distributions.

Empowering aged persons care services: Leveraging data-driven BiLSTM-GRU integration with wearable devices

Wearable medical devices (WMDs) have emerged as a promising medical technology to enhance patient care from a variety of medical angles. However, due to inaccurate signal measurement in sensors, the conventional model-driven framework has problems with its limited reconstruction ratio and compression ratio. A growing need for effective and individualized aged care services is created by the world's population's increasing aging. To increase the system quality and overall performance, the collected data is preprocessed to normalized data by using Z score Normalization. This study proposes a novel approach that integrates wearable device data with Elderly people's health and wellbeing may be predicted and monitored using Gated Recurrent Unit (GRU) and Bidirectional Long Short-Term Memory (BiLSTM) models. This data-driven strategy enables caregivers to deliver tailored care plans, timely treatments and early identification of potential health problems, which improve the aged population's overall quality of life. The BiLSTM-GRU evaluates the effectiveness and efficiency of an approach by analyzing the performance of Accuracy (96%), Precision (93%), F1-score (95%), Sensitivity (94%), Specificity (90%) and MSE. By advancing data-driven techniques in aged care services, this research intends to pave the way for a more effective and long-lasting healthcare system that is designed to meet the needs of the senior population.

Transformer fault diagnosis based on DBO-BiLSTM algorithm and LIF technology

Abstract In response to the deficiencies of traditional power transformer fault detection techniques, such as low sensitivity and the inability for online monitoring, a novel transformer fault diagnosis model combining Laser-Induced Fluorescence (LIF) technology with deep learning is proposed. Initially, the spectral data of transformer insulation oil is acquired using LIF technology, yielding spectral data for various fault types. Subsequently, MinMaxScaler (MMS) and Standard Normalized Variate (SNV) methods are employed for denoising and preprocessing the spectral data. The preprocessed data is then subjected to dimensionality reduction using Linear Discriminant Analysis (LDA) and T-distributed Stochastic Neighbor Embedding (T-SNE) to ensure that the spectral data retains maximal feature information while minimizing its dimensionality. Following this, Long Short-Term Memory (LSTM), Bi-directional Long Short-Term Memory (BiLSTM), Dung Beetle Optimizer-Bi-directional Long Short Term Memory (DBO-BiLSTM), Convolutional Neural Network (CNN), and Support Vector Machine (SVM) models are constructed. The reduced-dimensional data is fed into each of the five models for training to facilitate transformer fault diagnosis. Through comparative analysis among the five models, the optimal model is selected. Experimental results indicate that the DBO-BiLSTM model is the most suitable for transformer fault diagnosis in this experiment, underscoring its significant implications for ensuring the safety of power systems.

Improved bidirectional long short term memory-based QRS complex detection using autoencoder

In this paper, we propose a new technique to improve QRS complex detection. This technique consists of incorporating an autoencoder and bidirectional long short term memory (BiLSTM). The autoencoder used is a stacked autoencoder and functions as signal filtering. Meanwhile, BiLSTM is used as a detector. Exploration of the effect of hyperparameter in the autoencoder was also carried out to determine the effect on QRS complex detection. Furthermore, the dataset used in this study is the MIT-BIH arrhythmia database. Based on the experimental results, the hyperparameter in the autoencoder that gives a better effect on QRS complex detection is 16-8. Finally, the proposed method out-of-perform state of the art algorithm with accuracy 99.94%.

Air quality forecasting using a spatiotemporal hybrid deep learning model based on VMD–GAT–BiLSTM

The precise forecasting of air quality is of great significance as an integral component of early warning systems. This remains a formidable challenge owing to the limited information of emission source and the considerable uncertainties inherent in dynamic processes. To improve the accuracy of air quality forecasting, this work proposes a new spatiotemporal hybrid deep learning model based on variational mode decomposition (VMD), graph attention networks (GAT) and bi-directional long short-term memory (BiLSTM), referred to as VMD–GAT–BiLSTM, for air quality forecasting. The proposed model initially employ a VMD to decompose original PM2.5 data into a series of relatively stable sub-sequences, thus reducing the influence of unknown factors on model prediction capabilities. For each sub-sequence, a GAT is then designed to explore deep spatial relationships among different monitoring stations. Next, a BiLSTM is utilized to learn the temporal features of each decomposed sub-sequence. Finally, the forecasting results of each decomposed sub-sequence are aggregated and summed as the final air quality prediction results. Experiment results on the collected Beijing air quality dataset show that the proposed model presents superior performance to other used methods on both short-term and long-term air quality forecasting tasks.

An efficient intrusion detection systems in fog computing using forward selection and BiLSTM

Intrusion detection systems (IDS) play a pivotal role in network security and anomaly detection and are significantly impacted by the feature selection (FS) process. As a significant task in machine learning and data analysis, FS is directed toward pinpointing a subset of pertinent features that primarily influence the target variable. This paper proposes an innovative approach to FS, leveraging the forward selection search algorithm with hybrid objective/fitness functions such as correlation, entropy, and variance. The approach is evaluated using the BoT-IoT and TON_IoT datasets. By employing the proposed methodology, our bidirectional long-short term memory (BiLSTM) model achieved an accuracy of 98.42% on the TON_IoT dataset and 98.7% on the BoT-IoT dataset. This superior classification accuracy underscores the efficacy of the synergized BiLSTM deep learning model and the innovative FS approach. The study accentuates the potency of the proposed hybrid approach in FS for IDS and highlights its substantial contribution to achieving high classification performance in internet of things (IoT) network traffic analysis.

A Novel Model Combining Transformer and Bi-LSTM for News Categorization

News categorization (NC), the aim of which is to identify distinct categories of news through analyzing the contents, has acquired substantial progress since deep learning was introduced into the natural language processing (NLP) field. As a state-of-art model, transformer’s classification performance is not satisfied compared with recurrent neural network (RNN) and convolutional neural network (CNN) if it does not get pretrained. Based on the transformer model, this article proposes a novel framework that combines bidirectional long short-term memory (Bi-LSTM) network and transformer to solve this problem. In the suggested framework, the self-attention mechanism is substituted with Bi-LSTM to capture the semantic information from sentences. Meanwhile, an attention mechanism model is applied to focus on those important words and adjust their weights to solve the problem of long-distance information loss. With pooling network, the network complexity can be reduced and the main features can be highlighted by halving the dimension of the hidden state. Finally, after acquiring the hidden representation by the above structures, we utilize a contraction network to further capture the long-range associations from a text. Experiments on three large-scale corpora were performed to evaluate the suggested framework, and the results demonstrate that our model outperforms other models such as deep pyramid CNN (DPCNN), transformer.

Intelligent waste sorting for sustainable environment: A hybrid deep learning and transfer learning model

The significance of waste disposal, classification, and monitoring has dramatically increased due to the increase in industrial development and the progress of intelligent urbanization. Since the last few decades, the utilization of Deep learning techniques has grown increasingly in waste management research. The efficiency of a waste reuse and recycling process relies on its capacity to restore resources to their original state, thereby minimizing pollution and promoting an ecologically sustainable framework. Selecting the optimal deep-learning method for classifying and predicting waste is challenging and time-consuming. This paper proposed intelligent garbage categorization using Bidirectional Long Short-Term Memory (Bi-LSTM) and CNN-based transfer learning to improve environmental sustainability. Organic and recyclable garbage are separated. To simplify trash categorization, a hybrid model combines TL-based CNN and Bi-LSTM. This study extensively examined the suggested technique with numerous CNN computational methods, including VGG-19, ResNet-34, AlexNet, ResNet-50, and VGG-16, using the ’TrashNet Waste’ database. Key findings show that our hybrid model outperforms existing models. Our classification accuracy is 96.78 %, 5.27 % higher than the best model. Our model also reduces misclassification by 7.25 %, proving its reliability. This comprehensive examination examined the computer models’ trash classification performance and provided specific viewpoints. The results explain each technique’s pros and cons and show how useful they are in real-world circumstances. Waste classification is practical and sophisticated with a hybrid model. The effectiveness and cleverness of this model improve sustainable environmental practices. The proposed method’s excellent performance suggests its seamless integration into practical waste management solutions.

Combined wavelet transforms and neural network feed-forward model for ECG peak detection and classification

We have focused on development of a combined approach for electrocardiogram (ECG) signal filtering and various ECG peak detection. The filtering model is based on the combination of wavelet transform and neural network where after computing the wavelet coefficients the neural network feed-forward model is used to update the weights. The filtered signal is processed through the convolution layers and bidirectional long short-term memory (Bi-LSTM) architecture to perform the ECG peak detection. Further, we apply a combined feature extraction strategy where wavelet transform and morphological feature are extracted to classify the ECG beats as classify 5 different types of heartbeats, including premature ventricular contraction (PVC), left bundle branch block (LBBB), right bundle branch block (RBBB), PACE, and atrial premature contraction (APC) to examine the heart condition. The feature extraction phase uses wavelet transform, morphological features and high-order statistics to generate the robust features. The obtained feature vector is processed through the principal component analysis (PCA) module to reduce the dimension of feature vector. These features are trained by using support vector machine (SVM) and k-nearest neighbor (KNN) supervised model. The proposed approach is tested on publicly available MIT-BIH dataset where performance analysis shows that the proposed approach obtained average precision, sensitivity and error as 99.98%, 99.96%, and 0.101 which outperforms the existing filtering and peak detection schemes.

Leveraging electrocardiography signals for deep learning-driven cardiovascular disease classification model

Electrocardiography (ECG) is the most non-invasive diagnostic tool for cardiovascular diseases (CVDs). Automatic analysis of ECG signals assists in accurately and rapidly detecting life-threatening arrhythmias like atrioventricular blockage, atrial fibrillation, ventricular tachycardia, etc. The ECG recognition models need to utilize algorithms to detect various kinds of waveforms in the ECG and identify complicated relationships over time. However, the high variability of wave morphology among patients and noise are challenging issues. Physicians frequently utilize automated ECG abnormality recognition models to classify long-term ECG signals. Recently, deep learning (DL) models can be used to achieve enhanced ECG recognition accuracy in the healthcare decision making system. In this aspect, this study introduces an automated DL enabled ECG signal recognition (ADL-ECGSR) technique for CVD detection and classification. The ADL-ECGSR technique employs three most important subprocesses: pre-processed, feature extraction, parameter tuning, and classification. Besides, the ADL-ECGSR technique involves the design of a bidirectional long short-term memory (BiLSTM) based feature extractor, and the Adamax optimizer is utilized to optimize the trained method of the BiLSTM model. Finally, the dragonfly algorithm (DFA) with a stacked sparse autoencoder (SSAE) module is applied to recognize and classify EEG signals. An extensive range of simulations occur on benchmark PTB-XL datasets to validate the enhanced ECG recognition efficiency. The comparative analysis of the ADL-ECGSR methodology showed a remarkable performance of 91.24 % on the existing methods.

An explainable Artificial Intelligence software system for predicting diabetes

Implementing diabetes surveillance systems is paramount to mitigate the risk of incurring substantial medical expenses. Currently, blood glucose is measured by minimally invasive methods, which involve extracting a small blood sample and transmitting it to a blood glucose meter. This method is deemed discomforting for individuals who are undergoing it. The present study introduces an Explainable Artificial Intelligence (XAI) system, which aims to create an intelligible machine capable of explaining expected outcomes and decision models. To this end, we analyze abnormal glucose levels by utilizing Bi-directional Long Short-Term Memory (Bi-LSTM) and Convolutional Neural Network (CNN). In this regard, the glucose levels are acquired through the glucose oxidase (GOD) strips placed over the human body. Later, the signal data is converted to the spectrogram images, classified as low glucose, average glucose, and abnormal glucose levels. The labeled spectrogram images are then used to train the individualized monitoring model. The proposed XAI model to track real-time glucose levels uses the XAI-driven architecture in its feature processing. The model's effectiveness is evaluated by analyzing the performance of the proposed model and several evolutionary metrics used in the confusion matrix. The data revealed in the study demonstrate that the proposed model effectively identifies individuals with elevated glucose levels.

STA-SST: Spatio-temporal time series prediction of Moroccan Sea surface temperature

Global Sea Surface Temperature (SST) trends have garnered significant attention in several ocean-related domains, including global warming, marine biodiversity, and environmental protection. This involves having an accurate and efficient forecast of future SST to ensure early detection and response in time to these events. Deep learning algorithms have become popular in SST prediction recently, although directly obtaining optimal prediction results from historical observation data is not simple. In this paper, we propose STA-SST, a new deep learning approach for forecasting SST, by combining the temporal dependencies of SST using the Bidirectional Long Short-Term Memory (BiLSTM) model, spatial features extracted from the convolution layer, and relevant information from the attention mechanism. To assess how well the Attention-BiLSTM with convolution layer predicts SST, we conducted a case study in the Moroccan Sea, concentrating on five different areas. The proposed model was compared against alternative forecasting models, including LSTM, XGBoost, Support Vector Regression (SVR), and Random Forest (RF). The experimental results show that STA-STT produces noticeably the best prediction results and is a solid choice for field implementation.

DeepEpi: Deep Learning Model for Predicting Gene Expression Regulation Based on Epigenetic Histone Modifications

Background: Histone modification is a vital element in gene expression regulation. The way in which these proteins bind to the DNA impacts whether or not a gene may be expressed. Although those factors cannot influence DNA construction, they can influence how it is transcribed. Objective: Each spatial location in DNA has its function, so the spatial arrangement of chromatin modifications affects how the gene can express. Also, gene regulation is affected by the type of histone modification combinations that are present on the gene and depends on the spatial distributional pattern of these modifications and how long these modifications read on a gene region. So, this study aims to know how to model Long-range spatial genome data and model complex dependencies among Histone reads. Methods: The Convolution Neural Network (CNN) is used to model all data features in this paper. It can detect patterns in histones signals and preserve the spatial information of these patterns. It also uses the concept of memory in long short-term memory (LSTM), using vanilla LSTM, Bi-Directional LSTM, or Stacked LSTM to preserve long-range histones signals. Additionally, it tries to combine these methods using ConvLSTM or uses them together with the aid of a self-attention. Results: Based on the results, the combination of CNN, LSTM with the self-attention mechanism obtained an Area under the Curve (AUC) score of 88.87% over 56 cell types. Conclusion: The result outperforms the present state-of-the-art model and provides insight into how combinatorial interactions between histone modification marks can control gene expression. The source code is available at https://github.com/RaniaHamdy/DeepEpi.

Prediction of global ionospheric TEC using attention based bidirectional long short-term memory and gated recurrent unit

An accurate prediction of ionospheric total electron content (TEC) at the primary stage is essential for applications related to global navigation satellite systems (GNSS) under varying weather conditions. The previous TEC prediction schemes contribute for each time step that increases the prediction time. The eye contact phenomenon establishes a metaphorical connection which intends to capture and emphasize the attention worthy elements in a sequence. This research introduces a deep learning approach which is a combination of attention-based bidirectional long short-term memory and gated recurrent unit (Bi-LSTM GRU) to predict TEC in the ionosphere. Bidirectional LSTM is the better option for achieving durability when combined with a gated recurrent unit (GRU) to predict TEC in the ionosphere. The proposed approach is evaluated with the existing LSTM approach for root mean square error (RMSE) during training and validation. The RMSE while predicting the global ionospheric delay using the existing LSTM for 20 epochs is seen to be 0.004, whereas the existing approach achieves a training error of 0.003.

Bidirectional Long Short-Term Memory Development for Aircraft Trajectory Prediction Applications to the UAS-S4 Ehécatl

The rapid advancement of unmanned aerial systems in various civilian roles necessitates improved safety measures during their operation. A key aspect of enhancing safety is effective collision avoidance, which is based on conflict detection and is greatly aided by accurate trajectory prediction. This paper represents a novel data-driven trajectory prediction methodology based on applying the Long Short-Term Memory (LSTM) prediction algorithm to the UAS-S4 Ehécatl. An LSTM model was designed as the baseline and then developed into a Staked LSTM to better capture complex and hierarchical temporal trajectory patterns. Next, the Bidirectional LSTM was developed for a better understanding of the contextual trajectories from both its past and future data points, and to provide a more comprehensive temporal perspective that could enhance its accuracy. LSTM-based models were evaluated in terms of mean absolute percentage errors. The results reveal the superiority of the Bidirectional LSTM, as it could predict UAS-S4 trajectories more accurately than the Stacked LSTM. Moreover, the developed Bidirectional LSTM was compared with other state-of-the-art deep neural networks aimed at aircraft trajectory prediction. Promising results confirmed that Bidirectional LSTM exhibits the most stable MAPE across all prediction horizons.

A novel approach for missing data recovery and fault nodes detection in wireless sensor networks

SummaryEnsuring data integrity in wireless sensor networks (WSNs) is crucial for accurate monitoring, yet missing data due to sensor faults present a significant challenge. This research introduces an innovative approach that integrates advanced data recovery techniques with leading‐edge methods to address this issue. The system begins by identifying and isolating fault nodes using a specialized algorithm that analyzes network behavior. By applying fuzzy density‐based spatial clustering of applications with noise (FDBSCAN), potential fault nodes are precisely located based on deviations from expected patterns. Subsequently, an intelligent missing data recovery mechanism powered by bidirectional long short‐term memory (Bi‐LSTM) networks takes action. The Bi‐LSTM model is trained on existing sensor data to capture intricate patterns and dependencies, enabling accurate prediction and reconstruction of missing values caused by identified faults. The synergy between Bi‐LSTM for missing data recovery and FDBSCAN for fault node detection comprehensively addresses the missing data problem in WSNs. In missing data recovery, it demonstrates low mean absolute deviation (MAD) ranging from 0.021 to 0.13 and mean squared deviation (MSD) ranging from 0.0025 to 0.05 across various missing data ratios. Data reliability remains consistently high at 96% to 98%, even with up to 80% missing data. For fault node detection, the approach achieves precision of 95.7%, recall of 96.3%, F1‐score of 96.1%, and accuracy of 97.4%, outperforming existing techniques. The computational cost during training is noted at 5.79 h, presenting a limitation compared to other methods. This research highlights the importance of integrating fault node detection into missing data recovery mechanisms, presenting an innovative solution for the advancement of WSNs.

Efficient state of charge estimation of lithium-ion batteries in electric vehicles using evolutionary intelligence-assisted GLA–CNN–Bi-LSTM deep learning model

The battery's performance heavily influences the safety, dependability, and operational efficiency of electric vehicles (EVs). This paper introduces an innovative hybrid deep learning architecture that dramatically enhances the estimation of the state of charge (SoC) of lithium-ion (Li-ion) batteries, crucial for efficient EV operation. Our model uniquely integrates a convolutional neural network (CNN) with bidirectional long short-term memory (Bi-LSTM), optimized through evolutionary intelligence, enabling an advanced level of precision in SoC estimation. A novel aspect of this work is the application of the Group Learning Algorithm (GLA) to tune the hyperparameters of the CNN–Bi-LSTM network meticulously. This approach not only refines the model's accuracy but also significantly enhances its efficiency by optimizing each parameter to best capture and integrate both spatial and temporal information from the battery data. This is in stark contrast to conventional models that typically focus on either spatial or temporal data, but not both effectively. The model's robustness is further demonstrated through its training across six diverse datasets that represent a range of EV discharge profiles, including the Highway Fuel Economy Test (HWFET), the US06 test, the Beijing Dynamic Stress Test (BJDST), the dynamic stress test (DST), the federal urban driving schedule (FUDS), and the urban development driving schedule (UDDS). These tests are crucial for ensuring that the model can perform under various real-world conditions. Experimentally, our hybrid model not only surpasses the performance of existing LSTM and CNN frameworks in tracking SoC estimation but also achieves an impressively quick convergence to true SoC values, maintaining an average root mean square error (RMSE) of less than 1 %. Furthermore, the experimental outcomes suggest that this new deep learning methodology outstrips conventional approaches in both convergence speed and estimation accuracy, thus promising to significantly enhance battery life and overall EV efficiency.

M5c-iDeep: 5-Methylcytosine sites identification through deep learning

5-Methylcytosine (m5c) is a modified cytosine base which is formed as the result of addition of methyl group added at position 5 of carbon. This modification is one of the most common PTM that used to occur in almost all types of RNA. The conventional laboratory methods do not provide quick reliable identification of m5c sites. However, the sequence data readiness has made it feasible to develop computationally intelligent models that optimize the identification process for accuracy and robustness. The present research focused on the development of in-silico methods built using deep learning models. The encoded data was then fed into deep learning models, which included gated recurrent unit (GRU), long short-term memory (LSTM), and bi-directional LSTM (Bi-LSTM). After that, the models were subjected to a rigorous evaluation process that included both independent set testing and 10-fold cross validation. The results revealed that LSTM-based model, m5c-iDeep, outperformed revealing 99.9 % accuracy while comparing with existing m5c predictors. In order to facilitate researchers, m5c-iDeep was also deployed on a web-based server which is accessible at https://taseersuleman-m5c-ideep-m5c-ideep.streamlit.app/.

Forecasting of COVID-19 Cases Under Different Precaution Strategies in Turkey

The coronavirus disease started at the end of 2019 and affected all the countries in the world. In Turkey, the vaccination process started at the beginning of 2021 but performed in slow progress. Thus, the Turkish Government tried to implement precautions to control this virus's spread. In this study, we evaluated and compared five different forecasting models, ARIMA, Prophet, NARNN, Stacked LSTM, and Bidirectional LSTM, in order to show the effect of these precaution strategies on virus spread using a real-world data set. According to the test results, ARIMA and Prophet were found to be the most accurate models for small data sets that are split regarding precautions. Moreover, test results showed that when data size grows, LSTM model performance increases. However, these models' performance decreased when we fed these models by using the entire data set without splitting.