RNN Methods Research Articles

Efficient Intrusion Detection in Patient Health Records Based on LSTM-Based RNN

Advancements in Information and Communication Technology applications play an important role in the field of healthcare and bio-medical engineering. The process of image processing and analysis starts from receiving visual information to giving out the description of the scene for improving the visual appearance of the human viewer and extract the features of the data. Moreover, IDS can be deployed along with other security mechanisms as a line of defence to ensure security of system and network resources. There have been various efforts in designing IDS using Machine Learning (ML) techniques. Additionally, by developing a hybrid strategy for intrusion detection and classification and using feature engineering approaches to extract significant features for learning, among other things, efforts have been made to improve the classification performance of ML-based IDS. However, as networking technology have advanced, attack types have evolved as well. For this reason, an efficient and successful intrusion detection and classification system must be created. To address the issue and achieve good generalization ability for intrusion detection and classification, the paper presents empirical analysis of LSTM based RNN classifiers. The suggested methods' effectiveness is assessed using a range of performance metrics, such as recall, f-score, accuracy, precision, and False Positive Rate (FPR). The LSTM based RNN method recognize attacks with 99.2% accuracy with minimum time complexity (5 s).

Chili Price Prediction One Year Ahead Using the Gated Recurrent Unit Method

Chili is an important commodity in the Indonesian economy, and it experiences significant price fluctuations. This is due to several factors, such as demand and supply in the market and climate and temperature factors. The prediction of chili prices is important to minimize the risk of loss to the community and the government. Previous studies have used ARIMA, SVR, MLP, and RNN methods to predict chili prices. However, these methods are still considered less effective, especially in processing large amounts of information. In this study, the Gated Recurrent Unit (GRU) method is used as an alternative, and this method is designed to overcome obstacles to remembering long information. The results show that GRU provides excellent prediction performance, with a MAPE value below 10% for all types of chili peppers. The test results that have been carried out show that the size of the window data affects the accuracy of predicting chili prices. In addition, the combination of hyperparameters, namely hidden neurons and epochs, also influences the accuracy of predicting chili prices. The lowest MAPE value is obtained in predicting large red chili pepper prices of 4.850% with 512 hidden neurons and 100 epochs. Then, a MAPE of 6.434% was obtained using 512 hidden neurons and 100 epochs to predict curly red chili pepper prices. In predicting the price of green bird's eye pepper, a MAPE of 7.288% is obtained with a combination of 512 hidden neurons and 150 epochs. Finally, the lowest MAPE value is obtained in predicting the price of red bird's eye pepper at 6.452% with a combination of 512 hidden neurons and 150 epochs.

Novel cloud-AIoT fault diagnosis for industrial diesel generators based hybrid deep learning CNN-BGRU algorithm

The industrial diesel generator is essential to provide electric power during emergencies and requires accurate failure diagnosis in preventative maintenance services. This research presents a novel AIoT system-based hybrid deep learning algorithm for online monitoring of the anomaly conditions of 125 kW/250 kW industrial generators. Firstly, the IoT modules with different precise sensors are developed to be installed on 125 kW and 250 kW industrial generators to simulate other faults conditions in the laboratory. Then, the supervised learning operations are deployed to train deep learning algorithms with collected labeled data. The proposed algorithm, a hybrid convolution neural network bidirectional gate recurrent unit (CNN-BGRU), is deployed to extract deep features from long sequential historical signals and classify the anomaly conditions. The experiments in different 10 s, 20 s, and 30 s sampling frequencies are performed to evaluate and analyze with various benchmarks, which demonstrate efficiencies of the proposed CNN-BGRU method with other traditional deep learning algorithms, including RNN, CNN, GRU, LSTM, BRNN, and BGRU methods. The proposed hybrid method accomplishes the supreme augmentation of 29.43 % loss, 36.55 % validating loss, 25.86 % MAE, 27.00 % validating MAE, 16.78 % MSE, 20.64 % validating MSE, 6.36 % Pre, 25.34 % validating Pre, 17.30 % Rec, and 26.91 % validating Rec compared with state-of-the-art approaches. The AIoT system-based hybrid CNN-BGRU algorithm provides better improvement and higher accuracy in fault diagnosis of firefighting pumps for maintenance service in Industry 4.0.

Intrusion Detection System Using Machine Learning by RNN Method

As computer networks continue to grow, network intrusions become more frequent, advanced, and volatile, making it challenging to detect them. This has led to an increase in illegal intrusions that current security tools cannot handle. NIDS is currently available and most reliable ways to monitor network traffic, identify unauthorized usage, and detect malicious attacks. NIDS can provide better visibility of network activity and detect any evidence of attacks and malicious traffic. Recent research has shown that machine learning-based NIDS, particularly with deep learning, is more effective in detecting variants of network attacks compared to traditional rule-based solutions. This proposed model that introduces novel deep learning methodologies for network intrusion detection. The model consists of three approaches: LSTM-RNN, various classifying methodology, and a hybrid Sparse autoencoder with DNN. The LSTM-RNN evaluated NSL-KDD dataset and classified as multi-attack classification. The model outperformed with Adamax optimizer in terms of accuracy, detection rate, and low false alarm rate.

RCUMP: Residual Completion Unrolling with Mixed Priors for Snapshot Compressive Imaging.

Deep unrolling-based snapshot compressive imaging (SCI) methods, which employ iterative formulas to construct interpretable iterative frameworks and embedded learnable modules, have achieved remarkable success in reconstructing 3-dimensional (3D) hyperspectral images (HSIs) from 2D measurement induced by coded aperture snapshot spectral imaging (CASSI). However, the existing deep unrolling-based methods are limited by the residuals associated with Taylor approximations and the poor representation ability of single hand-craft priors. To address these issues, we propose a novel HSI construction method named residual completion unrolling with mixed priors (RCUMP). RCUMP exploits a residual completion branch to solve the residual problem and incorporates mixed priors composed of a novel deep sparse prior and mask prior to enhance the representation ability. Our proposed CNN-based model can significantly reduce memory cost, which is an obvious improvement over previous CNN methods, and achieves better performance compared with the state-of-the-art transformer and RNN methods. In this work, our method is compared with the 9 most recent baselines on 10 scenes. The results show that our method consistently outperforms all the other methods while decreasing memory consumption by up to 80%.

Markov enhanced I-LSTM approach for effective anomaly detection for time series sensor data

Users could engage and interact with their immediate surroundings without effort in smart settings. The emergence of intelligent technologies along with software-based services has made this possible. It is clear that technical advancements have ushered in a new era for both computer processing and sensor technology, facilitating the concept of smart surroundings. Even though their implementation faces a number of obstacles, numerous expansive projects are working to advance their adoption. The problem of anomalies in the sensor data could result inappropriate decisions and could lead unamicable situations to the users. Many such algorithms are already there, which does not provide satisfactory predictions for the sensor data for the time series data. Time series anomaly detection problems are typically stated as finding outlier data points in comparison to some norm or typical signal. Better anomaly detection in time series data is provided by the proposed Markov and enhanced LSTM technique. The Markov model and the enhanced LSTM offer accurate predictions for extra- and short-term data, which is highly useful in situations involving intelligent environments. When compared to the KNN algorithm, the technique offers reduced MAE, RMSE, MSE and MAPE errors. The algorithm also performs better than other LSTM and RNN methods. The proposed algorithm provides 0.00047 reduced error in humidity data, 0.00416 reduced error in temperature and 0.01771 reduced MAE value in case of light intensity when comparing with the KNN algorithm.

Deep Learning-Based Feature Extraction for Speech Emotion Recognition

Emotion recognition from speech signals is an important and challenging component of Human-Computer Interaction. In the field of speech emotion recognition (SER), many techniques have been utilized to extract emotions from speech signals, including many well-established speech analysis and classification techniques. This model can be built by using various methods such as RNN, SVM, deep learning, cepstral coefficients, and various other methods, out of which SVM normally gives us the highest accuracy. We propose a model that can identify emotions present in the speech, which can be identified by various parameters such as pitch, speaking rate, speech time, and frequency patterns. Emotion detection in digitized speech contains 3 components: Signal processing, Feature extraction, and Classification. The model first tries to remove the background noises then extract the features present in the speech and classify it into a single emotion. This model is capable of identifying seven different emotions that can be found in human speech. We can use different classifiers like GMM and HMM to classify features such as Spectral Subtraction, Wiener Filtering, Adaptive Filtering, and Deep Learning Techniques. This model can be used in various fields such as healthcare, security, psychology, medicine, education, and entertainment.

Dual-attention-based recurrent neural network for hand-foot-mouth disease prediction in Korea

Hand–foot–mouth disease (HFMD) is a viral disease that occurs primarily in children. Meteorological factors have a significant impact on its popularity annually in Korea. This study proposes a new HFMD prediction model using a dual-attention-based recurrent neural network (DA-RNN) and important weather factors for HFMD in Korea. First, suspected cases of HFMD in each state were predicted using meteorological factors from the DA-RNN. Second, the weather factors were divided into six categories: temperature, wind, rainfall, day length, humidity, and air pollution to conduct sensitivity analysis. Because of this prediction, the proposed model showed the best performance in predicting the number of suspected HFMD cases in a week compared with other RNN methods. Sensitivity analysis showed that air pollution and rainfall play an important role in HFMD in Korea. This model provides information for HFMD prevention and control and can be extended to predict other infectious diseases.

Standardized precipitation evapotranspiration index (SPEI) estimated using variant long short-term memory network at four climatic zones of China

Although the accurate prediction of the Standardized Precipitation Evapotranspiration Index (SPEI) is considered meaningful in reducing drought losses, its wide applications are limited to substantial meteorological data requirements. Considering Long Short-Term Memory network (LSTM) has proved its potential in estimating drought index, the concern is justified regarding the performance of its variants for estimating SPEI using limited meteorological input at the national level. Therefore, this study established the SPEI models using empirical methods, SVM, RNN, LSTM, BiLSTM, and CNN-LSTM, respectively, to cope with different data-missing scenarios. Based on a comprehensive comparison among different methods for multiscale SPEI estimation at four climatic zones of China, the results showed that BiLSTM was the most recommended model for estimating SPEI at 3-month timescale, with R2, NSE, and RMSE ranging 0.916–0.997, 0.907–0.997, and 0.143–0.353, respectively. Whereas CNN-LSTM was more suitable for other timescales, with R2, NSE, and RMSE being 0.904–0.999, 0.858–0.989, and 0.145–0.365 for estimating SPEI at 6-month timescale, respectively, and 0.858–0.998, 0.795–0.991, and 0.081–0.568 for estimating SPEI at 12-month timescale. Generally, the accuracy performance of SPEI methods can be ranked from best to worst as LSTM-type models, SVM, RNN, and empirical methods. The exception was that H-S exceeded RNN3 in TCZ and MPZ by 4.1–30.0 % for R2, 4.1–65.0 % for NSE, and 2.3–19.6 % for RMSE, respectively. Moreover, this study found that the accuracy performance of machine learning models for SPEI estimation got worse with the number of independent variables decreased. Overall, the variants of LSTM exerted excellent performance for multiscale SPEI estimation, which provided the most accurate prediction of meteorological, agroecological, and hydrological droughts throughout China.

A novel bidirectional DiPLS based LSTM algorithm and its application in industrial process time series prediction

The development of industry has led to the big data revolution in manufacturing industry, which has greatly improved production quality and efficiency. A accuracy prediction model is established by using deep learning method, especially short and long term memory (LSTM). However, the application field of LSTM is usually very limited, and the interpretability of LSTM is weak. In this paper, a novel bidirectional DiPLS based LSTM algorithm (BiDiPLS-LSTM) is proposed to solve this problem. First, DiPLS is used to process the forward time series data to obtain the most predictable dynamic latent variable (DLV) of the target variable. At the same time, DiPLS method is also used to process the reverse time series data and extract the reverse DLV. Then, the forward and reverse dynamic features of the same location will form new input data, and this new input data will be input into the LSTM network to realize the prediction of time series data. In order to verify the effectiveness of the proposed BiDiPLS-LSTM method, the real 660 MW coal-fired boiler process data is used, and the emission of oxides of nitrogen (NOx) is regarded as the output. The results show that the extracted dynamic features can be used to build a very accuracy model, and the results outperform the traditional LSTM method, the PLS-LSTM method, the unidirectional DiPLS-LSTM method, and traditional RNN method in the comparison. For the first time, we used the bidirectional dynamic features of the input data as the real input to predict the output, which will obtain a good prediction effect. What is more, the use of dynamic latent variables made the result more explanatory.

PREDICTING BANKING STOCK PRICES USING RNN, LSTM, AND GRU APPROACH

In recent years, the implementation of machine learning applications started to apply in other possible fields, such as economics, especially investment. But, many methods and modeling are used without knowing the most suitable one for predicting particular data. This study aims to find the most suitable model for predicting stock prices using statistical learning with RNN, LSTM, and GRU deep learning methods using stock price data for 4 (four) major banks in Indonesia, namely BRI, BNI, BCA, and Mandiri, from 2013 to 2022. The result showed that the ARIMA Box-Jenkins modeling is unsuitable for predicting BRI, BNI, BCA, and Bank Mandiri stock prices. In comparison, GRU presented the best performance in the case of predicting the stock prices of BRI, BNI, BCA, and Bank Mandiri.

Accident detection using Automotive Smart Black-Box based Monitoring system

Autonomous vehicles want reliable and strong sensor suites and alert systems. This paper discusses the composition and performance of a sophisticated monitoring and alert system for automobile vehicle parameters. The number of automobiles has also grown quickly to meet the enormous population. Additionally, this resulted in an increase in accidents. The accident prevention strategies now in use are all static and dated. Additionally, there is no reliable accident detection system. Automobile vehicle parameters are continuously monitored by a micro-controller which stores the data logs containing vehicle parameter data into a sheltered digital memory card and in the cloud storage. The system doesn't solely record the vehicle parameters data of the automobile periodically, but also actively monitors for any sudden vehicle accident detection. The sensor may facilitate folks to analyze the accident quickly and lawfully when a collision happens to alert the emergency services to that location. The system will update the information whenever an abnormal system event happens. A black box in a vehicle gather driving information about the vehicle before, during and after a crash. The data gathered includes, speed, acceleration, braking, steering and air-bag deployment. The Automotive black box system can aid with vehicle safety, increase collision victim care, assist insurance corporations with vehicle crash investigations, and improve road conditions to reduce death rates. According to experimental findings, the proposed technique achieves 29.3103%, 22.70 %, 18.103% and 11.206 % higher accuracy compared to RFID, SVM,CNN and RNN Methods.

Research on abnormal data detection of gas boiler supply based on deep learning network

On the basis of YOLO deep network detection method, a new abnormal data detection method is proposed to meet the needs of gas boiler abnormal data detection. In the feature extraction layer, the SENet structure is embedded between DBL and Pooling. Through compression, excitation and recalibration, the feature extraction of data information is more accurate. After feature extraction layer, multi-scale pooling processing mechanism is introduced to improve the learning efficiency of YOLO network. The first group and the second group of experiments respectively proved that the introduction of SENet structure and multi-scale pooling mechanism improved the feature extraction accuracy of YOLO network and the convergence speed of iteration process. The third group of experimental results show that the detection accuracy of the detection method proposed in this paper is significantly higher than CNN method, RNN method and YOLO method, and it is more suitable for the detection of abnormal data of gas boilers.

Performance of Artificial Neural Network and Modified Gravitational Search Algorithm Models to Predict Vibration Response of Geocell Reinforced Based Weak Sand

The use of a fast evolving artificial intelligence technology (AIT) to forecast the vibration response of maritime soil based on geocells is explored in this research. The vibration response is represented by an indicator called peak particle velocity (PPV). For the purpose of predicting PPV, the artificial intelligence techniques Artificial Neural Network (ANN) and Modified Gravitational Search Algorithm (MGSA) are employed. To create the dataset for the model, a number of field vibration tests were first performed over the geocell-reinforced beds. PPV variation was investigated by varying the test variables—footing embedment, dynamic load, infill material modulus, width, and depth of geocell mattress placement—during the test performed. The various statistical indicators were determined in order to evaluate the prediction performance of a constructed model. Plate load results on geocell-reinforced foundation beds have been used to validate the proposed hybrid ANN-MGSA model. High accuracy and consistency were found when the findings of the ANN-EHO, JSA, MOA, and RNN method were compared, particularly at predicted and actual resolution levels. A parametric sensitivity has also been examined in order to better understand the behaviour of geocell-reinforced structures.

Automated Algorithm Selection: from Feature-Based to Feature-Free Approaches

We propose a novel technique for algorithm-selection, applicable to optimisation domains in which there is implicit sequential information encapsulated in the data, e.g., in online bin-packing. Specifically we train two types of recurrent neural networks to predict a packing heuristic in online bin-packing, selecting from four well-known heuristics. As input, the RNN methods only use the sequence of item-sizes. This contrasts to typical approaches to algorithm-selection which require a model to be trained using domain-specific instance features that need to be first derived from the input data. The RNN approaches are shown to be capable of achieving within 5% of the oracle performance on between 80.88 and 97.63% of the instances, depending on the dataset. They are also shown to outperform classical machine learning models trained using derived features. Finally, we hypothesise that the proposed methods perform well when the instances exhibit some implicit structure that results in discriminatory performance with respect to a set of heuristics. We test this hypothesis by generating fourteen new datasets with increasing levels of structure, and show that there is a critical threshold of structure required before algorithm-selection delivers benefit.

Performance of Artificial Neural Network and Modified Gravitational Search Algorithm Models to Predict Vibration Response of Geocell Reinforced Based Weak Sand

The use of a fast evolving artificial intelligence technology (AIT) to forecast the vibration response of maritime soil based on geocells is explored in this research. The vibration response is represented by an indicator called peak particle velocity (PPV). For the purpose of predicting PPV, the artificial intelligence techniques Artificial Neural Network (ANN) and Modified Gravitational Search Algorithm (MGSA) are employed. To create the dataset for the model, a number of field vibration tests were first performed over the geocell-reinforced beds. PPV variation was investigated by varying the test variables—footing embedment, dynamic load, infill material modulus, width, and depth of geocell mattress placement—during the test performed. The various statistical indicators were determined in order to evaluate the prediction performance of a constructed model. Plate load results on geocell-reinforced foundation beds have been used to validate the proposed hybrid ANN-MGSA model. High accuracy and consistency were found when the findings of the ANN-EHO, JSA, MOA, and RNN method were compared, particularly at predicted and actual resolution levels. A parametric sensitivity has also been examined in order to better understand the behaviour of geocell-reinforced structures

Graph-Based Semi-Supervised Deep Learning for Indonesian Aspect-Based Sentiment Analysis

Product reviews on the marketplace are interesting to research. Aspect-based sentiment analysis (ABSA) can be used to find in-depth information from a review. In one review, there can be several aspects with a polarity of sentiment. Previous research has developed ABSA, but it still has limitations in detecting aspects and sentiment classification and requires labeled data, but obtaining labeled data is very difficult. This research used a graph-based and semi-supervised approach to improve ABSA. GCN and GRN methods are used to detect aspect and opinion relationships. CNN and RNN methods are used to improve sentiment classification. A semi-supervised model was used to overcome the limitations of labeled data. The dataset used is an Indonesian-language review taken from the marketplace. A small part is labeled manually, and most are labeled automatically. The experiment results for the aspect classification by comparing the GCN and GRN methods obtained the best model using the GRN method with an F1 score = 0.97144. The experiment for sentiment classification by comparing the CNN and RNN methods obtained the best model using the CNN method with an F1 score = 0.94020. Our model can label most unlabeled data automatically and outperforms existing advanced models.

Complementary in Time and Space: Optimization on Cost and Performance with Multiple Resources Usage by Server Consolidation in Cloud Data Center

The recent COVID-19 pandemic has accelerated the use of cloud computing. The surge in the number of users presents cloud service providers with severe challenges in managing computing resources. Guaranteeing the QoS of multiple users while reducing the operating cost of the cloud data center (CDC) is a major problem that needs to be solved urgently. To solve this problem, this paper establishes a cost model based on multiple computing resources in CDC, which comprehensively considers the hosts’ energy cost, virtual machine (VM) migration cost, and SLAV penalty cost. To minimize this cost, we design the following solution. We employ a convolutional autoencoder-based filter to preprocess the VM historical workload and use an attention-based RNN method to predict the computing resource usage of the VMs in future periods. Based on the predicted results, we trigger VM migration before the host enters an overloaded state to reduce the occurrence of SLAV. A heuristic algorithm based on the complementary use of multiple resources in space and time is proposed to solve the placement problem. Simulations driven by the VM real workload dataset validate the effectiveness of our proposed method. Compared with the existing methods, our proposed method reduces the energy consumption of the hosts and SLAV and reduces the total cost by 26.1~39.3%.

Covid-19 Sentiment Analysis Using Convolutional Neural Network / Reccurent Neural Network Method

Social media is a very important tool in this modern era , one of which is namely twitter. Twitter allows user for give opinion / opinion to various issues and topics hot / viral trending . Trending on twitter is so so fast in the process of spreading so that Twitter becomes a medium of information that often become a media issue conspiracy . Covid-19 is a moderate epidemic / disease _ experienced the whole world when this . Issues circulating in the population , they believe that Covid-19 is a real pandemic and a conspiracy , issue this make population confused differentiate Among second issue that . Because of that required a fast and accurate analysis _ for produce valid results , that Covid-19 a real thing _ or conspiracy seen from opinion population and corner views written on Twitter. CNN/RNN or combined from RNN(LSTM) and CNN methods are method used _ for classify opinion population about Covid-19 issues . Study this also done with compare is correct RNN/CNN accuracy same like deep RNN even more fast for in the process . Research results state that accuracy from combined RNN/CNN no different remote , even RNN/CNN in the process more fast than deep RNNs. Research results about opinion / opinion residents on twitter who believe about Covid-19 is conspiracy more low than residents who have confidence about Covid-19 is something the real thing . Percentage classification opinion / opinion from sentiment positive by 63.15% and opinion / opinion sentiment negative by 28.60%, this is results calculation use RNN/CNN method , with accuracy reached 58%. Accuracy from method used _ make Covid-19 issues that exist in the population no Becomes hoax news so population more alert against the ongoing Covid-19 pandemic happen.

Covid-19 Sentiment Analysis Using Convolutional Neural Network / Reccurent Neural Network Method

Social media is a very important tool in this modern era , one of which is namely twitter. Twitter allows user for give opinion / opinion to various issues and topics hot / viral trending . Trending on twitter is so so fast in the process of spreading so that Twitter becomes a medium of information that often become a media issue conspiracy . Covid-19 is a moderate epidemic / disease _ experienced the whole world when this . Issues circulating in the population , they believe that Covid-19 is a real pandemic and a conspiracy , issue this make population confused differentiate Among second issue that . Because of that required a fast and accurate analysis _ for produce valid results , that Covid-19 a real thing _ or conspiracy seen from opinion population and corner views written on Twitter. CNN/RNN or combined from RNN(LSTM) and CNN methods are method used _ for classify opinion population about Covid-19 issues . Study this also done with compare is correct RNN/CNN accuracy same like deep RNN even more fast for in the process . Research results state that accuracy from combined RNN/CNN no different remote , even RNN/CNN in the process more fast than deep RNNs. Research results about opinion / opinion residents on twitter who believe about Covid-19 is conspiracy more low than residents who have confidence about Covid-19 is something the real thing . Percentage classification opinion / opinion from sentiment positive by 63.15% and opinion / opinion sentiment negative by 28.60%, this is results calculation use RNN/CNN method , with accuracy reached 58%. Accuracy from method used _ make Covid-19 issues that exist in the population no Becomes hoax news so population more alert against the ongoing Covid-19 pandemic happen.