Bidirectional Long Short-term Memory Model Research Articles

Review on Sanskrit Sandhi Splitting using Deep Learning Techniques

A procedure called sandhi is used in Sanskrit to join short words (morphemes) to create compound words. A composite word are broken down into their component morphemes by a process known as sandhi splitting. This study focuses on several performance technologies and methodologies used to perform the above operation on Sanskrit sentences. Various approaches were identified for the problem from the literature survey. Initial approaches involved use of Finite State Transducers. Earlier the approaches introduced to increase accuracy include use of mathematical models and various optimality theories. Graph based approaches and parser based techniques were introduced later. With the advancement of deep learning techniques Recurrent Neural Networks, Long-Short Term Memory models and Double decoder models were adopted which involved training machine learning models through neural networks and classifier algorithms. Bidirectional LSTM models with attention mechanism, transformer based models and large language models like BERT were the most recent methodologies adopted and proved to be of higher accuracy and performance.

AI Assisted Deceptive Content Analysis System Using Bi-LSTM

Abstract: In an age of widespread misinformation, creating accurate machine learning algorithms is vital for ensuring the integrity of information sharing. This project aims to develop a machine learning model capable of distinguishing between fake and true news articles. [1]The model utilizes a Bidirectional Long Short-Term Memory (Bi-LSTM) neural network architecture. Exploratory data analysis techniques are employed to gain in-sights into the characteristics and distributions within the dataset. Data visualization techniques aid in understanding patterns and relationships within the dataset. Additionally, unigram analysis is conducted to extract meaningful features from the text data. The datasets are then prepared for model training, involving preprocessing steps such as tokenization and vectorization. Fi-nally, the Bi-LSTM model is constructed, leveraging its ability to capture long-range dependencies in sequential data. The model is trained on the prepared datasets, optimized using appropri-ate techniques, and evaluated using metrics such as accuracy, precision, recall, and F1-score. The Bi-LSTM architecture offers the advantage of capturing long-range dependencies in sequential data, thereby enhancing the model’s ability to discern nuanced patterns in news articles. The primary objective of this project is to develop a robust and accurate system for automatically detecting fake news, thus playing a pivotal role in enhancing the dissemination of reliable information in the digital age.

Analytical Study for Prjice Prediction of Bitcoin Using Machine Learning and Artificial Intelligence

Abstract: Cryptocurrency transactions rely on encryption algorithms for security and decentralization. However, traditional machine learning algorithms often struggle with the dynamic cryptocurrency market, leading to inaccuracies. To address this, integrating Integrating sentiment analysis of Twitter data alongside Bidirectional Long Short-Term Memory (BiLSTM) and Bidirectional Gated Recurrent Unit (BiGRU) models enriches the analysis of cryptocurrency market dynamics. Twitter provides dataset from kaggle open source and the sentiment expressed by users on cryptocurrencies, enabling the prediction of tweet sentiment (positive, negative, or neutral) through Natural Language Processing (NLP). This integration enhances understanding of market sentiment's impact on cryptocurrency prices: positive sentiment may drive prices up, negative sentiment may lead to declines, and neutral sentiment may indicate stability. By analyzing sentiment alongside historical trends and emerging patterns, users gain a holistic view of cryptocurrency markets. This approach aids decision-making, improving transaction accuracy and efficiency. Ultimately, the combination of sentiment analysis with BiLSTM and BiGRU models advances the comprehension of cryptocurrency market dynamics, enhancing user insights and facilitating informed decisions in the volatile cryptocurrency ecosystem.

A comparative analysis of Silverkite and inter-dependent deep learning models for bitcoin price prediction

These days, there is a lot of demand for cryptocurrencies, and investors are essentially investing in them. The fact that there are already over 6,000 cryptocurrencies in use worldwide because of this, investors with regular incomes put money into promising cryptocurrencies that have low market values. Accurate pricing forecasting is necessary to build profitable trading strategies because of the unique characteristics and volatility of cryptocurrencies. For consistent forecasting accuracy in an unknown price range, a variation point detection technique is employed. Due to its bidirectional nature, a Bi-LSTM appropriate for recording long-term dependencies in data that is sequential. Accurate forecasting in the cryptocurrency space depends on identifying these connections, since values are subject to change over time due to a variety of causes. In this work, we employ four deep learning-based models that are LSTM, FB-Prophet, LSTM-GRU and Bidirectional-LSTM(Bi-LSTM) and these four models are compared with Silverkite. Silverkite is the main algorithm of the Python library Graykite by LinkedIn. Using historical bitcoin data from 2012 to 2021, we utilized to analyse the models’ mean absolute error (MAE) and root mean square error (RMSE). The Bi-LSTM model performs better than others, with a mean absolute error (MAE) of 0.633 and a root mean square error (RMSE) of 0.815. The conclusion has significant ramifications for bitcoin investors and industry experts.

A novel bidirectional LSTM model for network intrusion detection in SDN-IoT network

A novel bidirectional LSTM model for network intrusion detection in SDN-IoT network

Soutcom: Real‐time sentiment analysis of Arabic text for football fan satisfaction using a bidirectional LSTM

AbstractIn the last few years, various topics, including sports, have seen social media platforms emerge as significant sources of information and viewpoints. Football fans use social media to express their opinions and sentiments about their favourite teams and players. Analysing these opinions can provide valuable information on the satisfaction of football fans with their teams. In this article, we present Soutcom, a scalable real‐time system that estimates the satisfaction of football fans with their teams. Our approach leverages the power of social media platforms to gather real‐time opinions and emotions of football fans and applies state‐of‐the‐art machine learning‐based sentiment analysis techniques to accurately predict the sentiment of Arabic posts. Soutcom is designed as a cloud‐based scalable system integrated with the X (formerly known as Twitter) API and a football data service to retrieve live posts and match data. The Arabic posts are analysed using our proposed bidirectional LSTM (biLSTM) model, which we trained on a custom dataset specifically tailored for the sports domain. Our evaluation shows that the proposed model outperforms other machine learning models such as Random Forest, XGBoost and Convolutional Neural Networks (CNNs) in terms of accuracy and F1‐score with values of 0.83 and 0.82, respectively. Furthermore, we analyse the inference time of our proposed model and suggest that there is a trade‐off between performance and efficiency when selecting a model for sentiment analysis on Arabic posts.

Well logs reconstruction of petroleum energy exploration based on bidirectional Long Short-term memory networks with a PSO optimization algorithm

During petroleum energy exploration, estimating missing well logs from existing logging data is very meaningful. Due to a highly nonlinear relationship between various logging data and a challenge to express the complexity of underground geological conditions by deterministic functions, traditional methods are difficult to meet the need of accurate interpretations of log data and fine descriptions of reservoirs. Nevertheless, deep learning method provides an advanced means for reconstructing well logs, and can directly map existing logging data to missing well logs. In this paper, we adopt the PSO-BiLSTM network that combines the BiLSTM (Bidirectional Long Short-term Memory) network with the PSO (Particle Swarm Optimization) algorithm. BiLSTM is an excellent data-driven method that can extract bidirectional temporal well logging data. PSO algorithm enhances the performance of BiLSTM model in predicting missing well logs through hyperparameter optimization, global search capability, and adaptive learning. At the same time, RMSE, MAE, and MAPE are used as indicators to evaluate the performance of PSO-BiLSTM model. The results show that when a PSO-BiLSTM model is applied to well logs reconstruction experiments, the reconstructed value of a log curve is in good agreement with its real value. Compared to LSTM and BiLSTM models, a PSO-BiLSTM model provides the best accuracy and stability in predicting missing well logs. The PSO-BiLSTM model strengthens the extraction of relevant logging information and reduces the error of parameter adjustment. It has an important reference significance for the reconstruction of well logs in complex formations.

Elevating Cryptocurrency Predictions: Bidirectional LSTM Methodology

The system proposed in this paper aims to predict cryptocurrency prices using Bi-Directional Long Short- Term Memory (LSTM), leveraging historical data obtained from Yahoo Finance and CoinGecko APIs. The goal is to assess LSTM models effectiveness in forecasting cryptocurrency prices and offer an interactive interface for users to visualize historical and forecasted prices. Several research works have been conducted on the prediction of cryptocurrency prices through various Deep Learning (DL) based algorithms. This project comprises two main approaches : one involves data analysis, LSTM modeling, and change point detection using Yahoo Finance data, while the other focuses on LSTM model training and price prediction using CoinGecko API data. The paper suggests that the prediction models it presents are useful for traders, investors, [6] and finance academics and are close to accurate at predicting the values of cryptocurrencies. Future research will examine more advanced deep learning architectures, primarily Transformer-based models like the GPT series, to improve pattern detection in bitcoin data. Integrating other data sources, such as sentiment analysis or blockchain measurements, may increase the accuracy of forecasting. With further research into cutting-edge techniques, cryptocurrency forecasting will get better and provide stakeholders with more information to help them make informed decisions. Keywords— Cryptocurrency ; forecasting ; Bi-Directional LSTM Model ; Time-series forecasting ; Machine learning

Early detection of chronic kidney disease using eurygasters optimization algorithm with ensemble deep learning approach

Chronic kidney disease (CKD) emerges as a global health problem with high morbidity and mortality rates, and it induces other diseases. Patients often fail to notice these diseases because there are no obvious symptoms during the earlier stage of CKD. Earlier diagnosis of CKD allows them to receive early medical intervention to improve the disease progression and outcome. Earlier stratification of CKD can affect the health care provided to patients through various options, such as kidney transportation, hemodialysis, or pharmacological care in milder cases. Recently, deep learning (DL) and machine learning (ML) approaches have gained significance in the domain of medical diagnoses due to their high prediction accuracy. DL and ML approaches can successfully aid physicians in achieving these goals due to their accurate and fast detection performance. The performance of the proposed technique mainly depends on selecting the suitable algorithms and appropriate features. Thus, the study introduces an Eurygasters Optimization Algorithm with an Ensemble DL CKD detection (EOAEDL-CKDD) method. The EOAEDL-CKDD method aims to detect and classify the presence of CKD using feature selection and hyperparameter tuning strategies. The EOAEDL-CKDD method applies a min-max scalar to convert the data into a uniform format to achieve this. The EOAEDL-CKDD technique exploits EOA to select features. This is followed by an ensemble of long short-term memory (LSTM), bidirectional gated recurrent unit (BiGRU), and bidirectional LSTM (BiLSTM) models that are used for the CKD detection process. Finally, a shuffled frog leap algorithm (SFLA) based hyperparameter selection process is carried out to choose the ensemble models' hyperparameter values optimally. The empirical assessment of the EOAEDL-CKDD method is tested on the benchmark CKD dataset. The experimental values highlighted that the EOAEDL-CKDD technique gains an optimal detection rate compared to existing models.

Machine learning parameterization of the multi-scale Kain–Fritsch (MSKF) convection scheme and stable simulation coupled in the Weather Research and Forecasting (WRF) model using WRF–ML v1.0

Abstract. Warm-sector heavy rainfall along the south China coast poses significant forecasting challenges due to its localized nature and prolonged duration. To improve the prediction of such high-impact weather events, high-resolution numerical weather prediction (NWP) models are increasingly used to more accurately represent topographic effects. However, as these models' grid spacing approaches the scale of convective processes, they enter a “gray zone”, where the models struggle to fully resolve the turbulent eddies within the atmospheric boundary layer, necessitating partial parameterization. The appropriateness of applying convection parameterization (CP) schemes within this gray zone remains controversial. To address this, scale-aware CP schemes have been developed to improve the representation of convective transport. Among these, the multi-scale Kain–Fritsch (MSKF) scheme enhances the traditional Kain–Fritsch (KF) scheme, incorporating modifications that facilitate its effective application at spatial resolutions as high as 2 km. In recent years, there has been an increase in the application of machine learning (ML) models across various domains of atmospheric sciences, including efforts to replace conventional physical parameterizations with ML models. This work introduces a multi-output bidirectional long short-term memory (Bi-LSTM) model intended to replace the scale-aware MSKF CP scheme. This multi-output Bi-LSTM model is capable of simultaneously predicting the convection trigger while also modeling the associated convective tendencies and precipitation rates with a high performance. Data for training and testing the model are generated using the Weather Research and Forecast (WRF) model over south China at a horizontal resolution of 5 km. Furthermore, this work evaluates the performance of the WRF model coupled with the ML-based CP scheme against simulations with the traditional MSKF scheme. The results demonstrate that the Bi-LSTM model can achieve high accuracy, indicating the promising potential of ML models to substitute the MSKF scheme in the gray zone.

Deteksi Cyberbullying Menggunakan BERT dan Bi-LSTM

Cyberbullying is a digital problem that is not a new phenomenon. This existed before the advent of social networks, and cyberbullying has a wide impact, including a person's mental and physiological conditions such as sadness, anxiety and depression. The main objective of this research is to develop an effective cyberbullying detection system using natural language processing techniques. The method used in this research includes the application of the BERT (Bi-Directional Encoder Representations from Transformers) and Bi-LSTM (Bi-Directional Long Short-Term Memory) models as a deep learning approach to analyze text and detect cyberbullying behavior. This approach allows the system to understand complex language contexts and capture patterns that traditional methods may find difficult to identify. Testing was carried out using a dataset that included various types of Indonesian language texts containing cyber bullying acts. The research results show that the combination of BERT and Bi-LSTM is able to provide superior detection performance with a high accuracy rate of 90% and the ability to identify variations of cyber bullying. This research makes a significant contribution to efforts to protect individuals from the negative impacts of cyber bullying through the development of a sophisticated and adaptive detection system.

A Dynamics-Learning Multirate Estimation Approach for the Feeding Condition Perception of Complex Industry Processes.

In this study, we propose a dynamics-learning multirate estimation approach to perceive the quality-related indices (QRIs) of the feeding solution of a unit process. A quality-related index for estimation is an intermediate technical indicator between a unit process and a proceeding unit process; hence, the estimation problem is formulated as a two-stage estimation problem utilizing the production data of both unit processes. Dynamics-learning bidirectional long short-term memory (BiLSTM) with different inputs for the forward and backward layers is proposed to manage the input data from the different unit processes. In the dynamics-learning BiLSTM, a cycle control gate is added in the memory cell to learn the dynamics of the QRIs, thereby enabling a high-rate estimation under multirate conditions. A Bayesian estimation model is then combined with the dynamics-learning BiLSTM model to manage the process delay. Ablation and comparative experiments are conducted to evaluate the feasibility and effectiveness of the proposed estimation approach. The experimental results illustrate the performance and high-rate estimation ability of the proposed approach.

Ultra-short-term wind power prediction model based on fixed scale dual mode decomposition and deep learning networks

In recent years, decomposition-based combination models have been widely used in wind power prediction. This type of method decomposes the highly volatile wind power into some relatively smooth subsequences, which reduces the difficulty of modeling. However, this might use information from future data in advance, creating the illusion of high prediction accuracy. Therefore, this paper proposes a wind power ultra-short-term prediction model based on fixed scale dual mode decomposition (FSDMD) and deep learning networks. First, the wind power series after fixed scale blocking is decomposed using ensemble empirical mode decomposition (EEMD), and use the improved variational mode decomposition (VMD) based on Spearman rank order correlation coefficient (SROCC) to decompose the obtained high-frequency components twice. Then, the appropriate mode components were selected by calculating the SROCC and experimental analysis, and combined with the convolutional neural network (CNN) and the bidirectional long short-term memory (BiLSTM) network to train the model. Finally, the historical data of wind turbines in a wind farm in Northwest China is used for example verification, and the comparison with other models in the two scenarios of sufficient and insufficient features. The results show that the proposed FSDMD–CNN–BiLSTM model has high prediction accuracy in both scenarios. Especially in the scenario of insufficient features, compared with CNN-BiLSTM model, RMSE, MAE and MAPE are reduced by 8.20,14.24 and 0.15, respectively. In addition, this paper verifies that mode decomposition can improve the performance of prediction model without using future features, which provides ideas for solving similar problems.

Deep Learning Based Fall Recognition and Forecasting for Reconfigurable Stair-Accessing Service Robots

This paper presents a comprehensive study on fall recognition and forecasting for reconfigurable stair-accessing robots by leveraging deep learning techniques. The proposed framework integrates machine learning algorithms and recurrent neural networks (RNNs), specifically Long Short-Term Memory (LSTM) and Bidirectional LSTM (BiLSTM), for fall detection of service robots on staircases. The reconfigurable stair-accessing robot sTetro serves as the platform, and the fall data required for training models are generated in a simulation environment. The two machine learning algorithms are compared and their effectiveness on the fall recognition task is reported. The results indicate that the BiLSTM model effectively classifies falls with a median categorical accuracy of 94.10% in simulation and 90.02% with limited experiments. Additionally, the BiLSTM model can be used for forecasting, which is practically valuable for making decisions well before the onset of a free fall. This study contributes insights into the design and implementation of fall detection systems for service robots used to navigate staircases through deep learning approaches. Our experimental and simulation data, along with the simulation steps, are available for reference and analysis via the shared link.

An Evaluation of Bidirectional Long Short-Term Memory Model for Estimating Monthly Rainfall in India

Objectives: Predicting the amount of rainfall is difficult due to its complexity and non-linearity. The objective of this study is to predict the average rainfall one month ahead using the all-India monthly average rainfall dataset from 1871 to 2016. Methods: This study proposed a Bidirectional Long Short-Term Memory (LSTM) model to predict the average monthly rainfall in India. The parameters of the models are determined using the grid search method. This study utilized the average monthly rainfall as an input, and the dataset consists of 1752 months of rainfall data prepared from thirty (30) meteorological sub-divisions in India. The model was compiled using the Mean Square Error (MSE) loss function and Adam optimizer. The models' performances were evaluated using statistical metrics such as Mean Absolute Error (MAE) and Root Mean Squared Error (RMSE). Findings: This study discovered that the proposed Bidirectional LSTM model achieved an RMSE of 240.79 and outperformed an existing Recurrent Neural Network (RNN), Vanilla LSTM and Stacked LSTM by 8%, 4% and 2% respectively. The study also finds that increasing the input time step and increasing the number of cells in the hidden layer enhanced the prediction performance of the proposed model, and the Bidirectional LSTM converges at a lower epoch compared to RNN and LSTM models. Novelty: This study applied the Bidirectional LSTM for the first time in predicting all-India monthly average rainfall and provides a new benchmark for this dataset. Keywords: Deep Learning, LSTM, Rainfall prediction, Stacked LSTM, Bidirectional LSTM

Diabetic Drug ontology mapping for individual Diabetic Person and predict Insulin Dosage on Daily Basis

Managing diabetes requires a personalized treatment plan based on the patient's health records and drug usage effectively. In this paper, we have proposed accurate prediction of insulin dosage for diabetic patients daily by using ontology mapping with deep learning recurrent neural network models such as long short-term memory (LSTM), Gated recurrent unit( GRU), and Bidirectional long short-term memory(BiLSTM). The patient's information is arranged in a structured format. The structured ontology data provides a meaningful connection between patients' personal information, physical activity, insulin intake, carbohydrate intake and glucose level. The structured data is beneficial to take decisions effectively to recommend the insulin dosage level daily to avoid a sudden decrease in sugar level. The proposed LSTM model outperforms well on insulin prediction compared to GRU and BiLSTM models. The proposed model is very effective for diabetic personal care and improves patient outcomes and quality of life.

An investigation of multivariate data-driven deep learning models for predicting COVID-19 variants

The Coronavirus Disease 2019 (COVID-19) pandemic has swept almost all parts of the world. With the increasing number of COVID-19 cases worldwide, Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) has mutated into various variants. Given the increasingly dangerous conditions of the pandemic, it is crucial to predict the number of COVID-19 cases. Deep Learning and Long Short-Term Memory (LSTM) have predicted disease progress with reasonable accuracy and small errors. LSTM training is used to predict confirmed cases of COVID-19 based on variants identified using the European Centre for Disease Prevention and Control (ECDC) COVID-19 dataset containing confirmed cases identified from 30 European countries. Tests were conducted using the LSTM and Bidirectional LSTM (BiLSTM) models with the addition of Recurrent Neural Network (RNN) as comparisons on hidden size and layer size. The obtained result showed that in testing hidden sizes 25, 50, 75, and 100, the RNN model provided better results, with the minimum Mean Squared Error (MSE) value of 0.01 and the Root Mean Square Error (RMSE) value of 0.012 for B.1.427/B.1.429 variant with a hidden size of 100. Further testing layer sizes 2, 3, 4, and 5 shows that the BiLSTM model provided better results, with a minimum MSE value of 0.01 and an RMSE of 0.01 for the B.1.427/B.1.429 variant with a hidden size of 100 and layer size of 2.

Deep Learning Model for Tamil Part-of-Speech Tagging

Abstract Part-of-Speech (POS) tagging is one of the popular Natural Language Processing (NLP) tasks. It is also considered to be a preliminary task for other NLP applications such as speech recognition, machine translation, and sentiment analysis. A few works have been published on POS tagging for the Tamil language. However, the performance of the POS tagger with unknown words is not explored in the literature. The appearance of unknown words is a frequently occurring problem in POS tagging and makes it a challenging task. In this paper, we propose a deep learning-based POS tagger for Tamil using Bi-directional Long Short Term Memory (BLSTM). The performance of the POS tagger was evaluated using known and unknown words. The POS tagger with regular word-level embeddings produces 99.83 and 92.46% accuracies for all known and 63.21% unknown words. It clearly shows that the accuracy decreases when the number of unknown words increases. To improve the performance of the POS tagger with unknown words, the proposed BLSTM model that uses word-level, character-level and pre-trained word embeddings. Test results of this model show a 2.57% improvement for 63.21% of unknown words, with an accuracy of 95.03%.

GTFE-Net-BiLSTM-AM: An intelligent feature recognition method for natural gas pipelines

The recognition of pipeline features contributes to its safe management by preventing severe consequences such as leakage resulting from bending deformation and denting under external pressure. However, extracting features of such a facility is complex and challenging when machine learning techniques are applied to feature recognition. Hence, this paper proposes a feature recognition technique for gas pipelines based on Gramian Time Frequency Enhancement Net (GTFE-Net), Bi-directional Long Short-Term Memory (BiLSTM) and attention mechanism (AM), namely GTFE-Net-BiLSTM-AM. Specifically, GTFE-Net is applied to enhance the time-frequency input bending strain signal, which is subsequently incorporated with the BiLSTM model to extract spatio-temporal features. The attention mechanism computes the corresponding weight of output features. The results show that the proposed method's recognition accuracy reaches 93.7%. The comparison study with the existing models validates the proposed method's superiority and shows that its accuracy is higher than that of the existing models (more than 0.9%) or their combined models (more than 1.1%). Overall, the proposed method contributes to the safety, reliability, and operation of natural gas pipelines.

A self-attention-based CNN-Bi-LSTM model for accurate state-of-charge estimation of lithium-ion batteries

In the quest for clean and efficient energy solutions, lithium-ion batteries have emerged at the forefront of technological innovation. Accurate state-of-charge (SOC) estimation across a broad temperature range is essential for extending battery longevity, and enduring effective management of overcharge and over-discharge conditions. However, prevailing challenges persist in achieving precise SOC estimates and generalizing across a wide temperature range, particularly at lower temperatures. Our comparative analysis reveals that, while a single-layer bidirectional LSTM model with a self-attention mechanism achieves remarkable SOC estimation accuracy at room temperature, the intricacies of SOC estimation at lower temperatures necessitate the incorporation of more hidden layers and more complex network architecture to capture intricate features influencing battery dynamics. Hence, we propose a deep learning model, based on convolutional neural networks integrating bidirectional long short-term memory and self-attention mechanism (CNN-Bi-LSTM-AM), specifically designed to tackle the challenges of achieving accurate SOC estimations across a wide temperature range. The proposed model demonstrates proficiency in capturing both spatial and temporal dependencies critical for lithium-ion battery SOC estimation. Furthermore, the integration of a self-attention mechanism enhances the model’s adeptness to discern pertinent features and patterns within the dataset, thereby improving its overall performance and robustness, even in sub-room temperature environments.