Gated Recurrent Unit Model Research Articles

Innovative Framework for Thyroid Disease Detection by Leveraging Hybrid AGTEO Feature Selection and GRU Classification Model

Thyroid disease remains a significant health concern, necessitating advanced diagnostic tools for swift and accurate identification. The initial step involves preprocessing datasets, employing an Outlier Detection Method with Isolated Forest in conjunction with data normalization techniques to eliminate noise and standardize the data, laying a robust groundwork for subsequent analysis. Subsequently, feature extraction is conducted utilizing an Enhanced AlexNet architecture augmented by a more intricate Chameleon Swarm Algorithm (CSA) model to discern finer patterns within the data, enhancing the discriminative nature of the extracted features. Following this, a feature selection strategy employing hybrid optimization is deployed, amalgamating the strengths of Equilibrium Optimizer and Artificial Gorilla Troops Optimizer (AGTO) into a hybrid model named HAGTEO, aiming to identify the most informative features, thus reducing dimensionality and enhancing classifier efficiency. Ultimately, the Gated Recurrent Unit (GRU) classifier is employed for thyroid disease classification based on the extracted and selected features. Renowned for its capability to capture temporal dependencies, the GRU model further enhances classification accuracy. The proposed framework is subjected to testing on two distinct datasets, demonstrating its efficacy in thyroid disease detection. Experimental outcomes reveal superior performance compared to conventional methods, achieving accuracies of 98.07% and 98.00% for dataset 1 and dataset 2, respectively. As an advanced diagnostic solution for thyroid disease, it holds promising potential.

Cortical signals analysis to recognize intralimb mobility using modified RNN and various EEG quantities

Electroencephalogram (EEG) signals are critical in interpreting sensorimotor activities for predicting body movements. However, their efficacy in identifying intralimb movements, such as the dorsiflexion and plantar flexion of the foot, remains suboptimal. This study aims to explore whether various EEG signal quantities can effectively recognize intralimb movements to facilitate the development of Brain-Computer Interface (BCI) devices for foot rehabilitation. This research involved twenty-two healthy, right-handed participants. EEG data were collected using 21 electrodes positioned over the motor cortex, while two electromyography (EMG) electrodes recorded the onset of ankle joint movements. The study focused on analyzing slow cortical potential (SCP) and sensorimotor rhythms (SMR) in alpha and beta bands from the EEG. Five key features—fourth-order Autoregressive feature, variance, waveform length, standard deviation, and permutation entropy—were extracted. A modified Recurrent Neural Network (RNN) including Long Short-term Memory (LSTM) and Gated Recurrent Unit (GRU) algorithms was developed for movement recognition. These were compared against conventional machine learning algorithms, including nonlinear Support Vector Machine (SVM) and k Nearest Neighbourhood (kNN) classifiers. The performance of the proposed models was assessed using two data schemes: within-subject and across-subjects. The findings demonstrated that the GRU and LSTM models significantly outperformed traditional machine learning algorithms in recognizing different EEG signal quantities for intralimb movement. The study indicates that deep learning models, particularly GRU and LSTM, hold superior potential over standard machine learning techniques in identifying intralimb movements using EEG signals. Where the accuracies of LSTM for within and across subjects were 98.87 ± 1.80 % and 87.38 ± 0.86 % respectively. Whereas the accuracy of GRU within and across subjects were 99.18 ± 1.28 % and 86.44 ± 0.69 % respectively. This advancement could significantly benefit the development of BCI devices aimed at foot rehabilitation, suggesting a new avenue for enhancing physical therapy outcomes.

Sustainable energy transition in cities: A deep statistical prediction model for renewable energy sources management for low-carbon urban development

This study proposes a novel approach to sustainable energy transition in urban environments, focusing on the prediction and management of renewable energy outputs for low-carbon urban development. We introduce a new intelligent prediction model based on Gated Recurrent Unit (GRU) Networks to forecast the output power of both tidal and biomass units. The GRU model, known for its capability in capturing sequential dependencies, is employed to enhance the accuracy of renewable energy predictions in the context of urban sustainability. To address the interpretability challenges inherent in complex deep learning models, we leverage LIME (Local Interpretable Model-agnostic Explanations). By integrating LIME into our GRU-based prediction model, we enhance transparency and understandability. This approach facilitates the identification of key factors influencing predictions, providing stakeholders and decision-makers with valuable insights for effective sustainable energy management. The proposed hybrid model is applied to the digital model of real tidal and biomass sites in China, allowing for a statistical examination of renewable integration and energy management strategies. The results offer a comprehensive understanding of the dynamics between renewable energy sources and urban development, paving the way for informed decision-making in the pursuit of low-carbon and resilient cities. This research contributes to the broader discourse on sustainable urban development by offering a robust statistical framework for renewable energy integration and management in urban environments.

Unveiling Emotional Stress: Analyzing EEG Signals With Deep Learning Insights

This study focuses on a comprehensive exploration of EEG-based emotion recognition, with a particular focus on leveraging recurrent neural network (RNN) architectures, including long short-term memory (LSTM) and gated recurrent unit (GRU). The investigation is rooted in a publicly available EEG Brainwave Dataset, meticulously curated to capture human responses to emotional stimuli. The dataset features signals obtained from frontal and temporal brain lobes, categorized into distinct emotional states encompassing positive, neutral, and negative emotions. The analysis spans four distinct scenarios, each representing different combinations of features and preprocessing strategies. Notably primary emphasis is on LSTM and GRU architectures due to their proven effectiveness in sequential data processing tasks. In addition to evaluating the performance of LSTM and GRU models a thorough examination of all the four cases to assess their efficacy in accurately predicting emotional states from EEG signals. The study also emphasis on the importance of meticulous feature selection and preprocessing in optimizing model accuracy and robustness, highlighting the intricate interplay between data representation, model architecture, and task-specific requirements. Ultimately, the research findings contribute to advanced understanding of EEG-based emotion recognition and pave the way for further research in this exciting interdisciplinary field. Key Words: Electroencephalography(EEG), Long short-term memory (LSTM), Gated recurrent unit (GRU), Feature extraction, Preprocessing techniques, Statistical metrics, Frequency domain analysis.

Combined prediction model of joint opening-closing deformation of immersed tube tunnel based on SSA optimized VMD, SVR and GRU

Prediction of joint opening-closing deformation is crucial to ensure the operation safety of immersed tube tunnels. This paper proposes a novel deformation prediction model based on the framework of "decomposition-prediction-integration", which combines the Sparrow Search Algorithm (SSA), Variational Modal Decomposition (VMD), Support Vector Regression (SVR) and Gated Recurrent Unit (GRU). First, the deformation sequence is decomposed into trend, period, and residual components by VMD. In this process, a innovative evaluation index (EI) is proposed to guide the decomposition by combining the Root Mean Square Error (RMSE) and the Sample Entropy (SE), while the VMD is hyper-parametrically optimized by SSA under the EI to improve the decomposition quality. Secondly, the trend component is fitted and predicted using the Least Squares Method; the SSA-SVR model is used to establish the nonlinear response relationship between the period component and the influence factor; the GRU model optimized by SSA is applied to excavate the temporal characteristics within the residual component, which in turn achieves the prediction of the residual component. Finally, the opening-closing deformation prediction results are obtained by integrating the prediction results of each component. The application results demonstrate that the proposed model is excellent in terms of reliability and applicability, with smaller prediction errors and higher accuracy than the other six models. It provides an innovative method for joint opening-closing deformation prediction.

Using Data Augmentation to Improve the Accuracy of Blood Pressure Measurement Based on Photoplethysmography

Convenient and accurate blood pressure (BP) measurement is of great importance in both clinical and daily life. Although deep learning (DL) can achieve cuff-less BP measurement based on Photoplethysmography (PPG), the performance of DL is affected by few-shot data. Data augmentation becomes an effective way to enhance the size of the training data. In this paper, we use cropping, flipping, DTW barycentric averaging (DBA), generative adversarial network (GAN) and variational auto-encoder (VAE) for the data augmentation of PPG. Furthermore, a PE–CNN–GRU model is designed for cuff-less BP measurement applying position encoding (PE), convolutional neural networks (CNNs) and gated recurrent unit (GRU) networks. Experiment results based on real-life datasets show that VAE is the most suitable method for PPG data augmentation, which can reduce the mean absolute error (MAE) of PE–CNN–GRU when measuring systolic blood pressure (SBP) and diastolic blood pressure (DBP) by 18.80% and 19.84%. After the data augmentation of PPG, PE–CNN–GRU achieves accurate and cuff-less BP measurement, thus providing convenient support for preventing cardiovascular diseases.

Degradation prediction of proton exchange membrane fuel cell based on mixed gated units under multiple operating conditions

The aging process of proton exchange membrane fuel cell (PEMFC) is affected by different operating factors, and its practical application scenarios involve multiple operation conditions. To improve the accuracy and controllability of aging prediction, a mixed recurrent neural network (RNN) model based on Gated Recurrent Unit (GRU) and Minimal Gated Unit (MGU) is proposed. The model dynamically adjusts the mixed weights of GRU and MGU throughout the entire training process to obtain the optimal prediction network structure throughout the entire lifecycle. Furthermore, an attention mechanism is incorporated into the mixed gated unit (MIXGU) model. The effectiveness of the MIXGU model is evaluated by utilizing experimental data from static condition, quasi-dynamic condition, and dynamic load cycling conditions. The predictive performance of MGU, GRU, MIXGU, and MIXGU model with attention mechanism (AT-MIXGU) are compared under different operating conditions. The validation results indicate that MIXGU model exhibits superior predictive performance compared to single gated unit, the attention mechanism enhances prediction accuracy. And the AT-MIXGU model demonstrates strong generalization capabilities, and well-suited for accurately predicting PEMFC aging under diverse operating conditions.

A Comprehensive Review of Machine Learning Approaches for Anomaly Detection in Smart Homes: Experimental Analysis and Future Directions

Detecting anomalies in human activities is increasingly crucial today, particularly in nuclear family settings, where there may not be constant monitoring of individuals’ health, especially the elderly, during critical periods. Early anomaly detection can prevent from attack scenarios and life-threatening situations. This task becomes notably more complex when multiple ambient sensors are deployed in homes with multiple residents, as opposed to single-resident environments. Additionally, the availability of datasets containing anomalies representing the full spectrum of abnormalities is limited. In our experimental study, we employed eight widely used machine learning and two deep learning classifiers to identify anomalies in human activities. We meticulously generated anomalies, considering all conceivable scenarios. Our findings reveal that the Gated Recurrent Unit (GRU) excels in accurately classifying normal and anomalous activities, while the naïve Bayes classifier demonstrates relatively poor performance among the ten classifiers considered. We conducted various experiments to assess the impact of different training–test splitting ratios, along with a five-fold cross-validation technique, on the performance. Notably, the GRU model consistently outperformed all other classifiers under both conditions. Furthermore, we offer insights into the computational costs associated with these classifiers, encompassing training and prediction phases. Extensive ablation experiments conducted in this study underscore that all these classifiers can effectively be deployed for anomaly detection in two-resident homes.

Diabetic Drug ontology mapping for individual Diabetic Person and predict Insulin Dosage on Daily Basis

Managing diabetes requires a personalized treatment plan based on the patient's health records and drug usage effectively. In this paper, we have proposed accurate prediction of insulin dosage for diabetic patients daily by using ontology mapping with deep learning recurrent neural network models such as long short-term memory (LSTM), Gated recurrent unit( GRU), and Bidirectional long short-term memory(BiLSTM). The patient's information is arranged in a structured format. The structured ontology data provides a meaningful connection between patients' personal information, physical activity, insulin intake, carbohydrate intake and glucose level. The structured data is beneficial to take decisions effectively to recommend the insulin dosage level daily to avoid a sudden decrease in sugar level. The proposed LSTM model outperforms well on insulin prediction compared to GRU and BiLSTM models. The proposed model is very effective for diabetic personal care and improves patient outcomes and quality of life.

Price prediction of power transformer materials based on CEEMD and GRU

The rapid growth of the Chinese economy has fueled the expansion of power grids. Power transformers are key equipment in power grid projects, and their price changes have a significant impact on cost control. However, the prices of power transformer materials manifest as nonsmooth and nonlinear sequences. Hence, estimating the acquisition costs of power grid projects is difficult, hindering the normal operation of power engineering construction. To more accurately predict the price of power transformer materials, this study proposes a method based on complementary ensemble empirical mode decomposition (CEEMD) and gated recurrent unit (GRU) network. First, the CEEMD decomposed the price series into multiple intrinsic mode functions (IMFs). Multiple IMFs were clustered to obtain several aggregated sequences based on the sample entropy of each IMF. Then, an empirical wavelet transform (EWT) was applied to the aggregation sequence with a large sample entropy, and the multiple subsequences obtained from the decomposition were predicted by the GRU model. The GRU model was used to directly predict the aggregation sequences with a small sample entropy. In this study, we used authentic historical pricing data for power transformer materials to validate the proposed approach. The empirical findings demonstrated the efficacy of our method across both datasets, with mean absolute percentage errors (MAPEs) of less than 1% and 3%. This approach holds a significant reference value for future research in the field of power transformer material price prediction.

Prediction of rock mass classification in tunnel boring machine tunneling using the principal component analysis (PCA)–gated recurrent unit (GRU) neural network

Prediction of rock mass classification in tunnel boring machine tunneling using the principal component analysis (PCA)–gated recurrent unit (GRU) neural network

Comparison of time series temperature prediction with auto-regressive integrated moving average and recurrent neural network

The region of Beni Mellal, Morocco is heavily dependent on the agricultural sector as its primary source of income. Accurate temperature prediction in agriculture has many benefits including improved crop planning, reduced crop damage, optimized irrigation systems and more sustainable agricultural practices. By having a better understanding of the expected temperature patterns, farmers can make informed decisions on planting schedules, protect crops from extreme temperature events, and use resources more efficiently. The lack of data-driven studies in agriculture impedes the digitalization of farming and the advancement of accurate long-term temperature prediction models. This underscores the significance of research to identify the optimal machine learning models for that purpose. A 22-year time series dataset (2000-2022) is used in the study. The machine-learning model auto-regressive integrated moving average (ARIMA) and deep learning models simple recurrent neural network (SimpleRNN), gated recurrent unit (GRU), and long short-term memory (LSTM) were applied to the time series. The results are evaluated based on the mean absolute error (MAE). The findings indicate that the deep learning models outperformed the machine-learning model, with the GRU model achieving the lowest MAE.

AI-Based Holistic Model for Decision-Support System in Inventory Optimization using deep Learning

Abstract: This study introduces an innovative artificial intelligence-driven comprehensive model designed for a decision-support system in inventory optimization. This model was developed using advanced deep learning techniques. The model aims to surpass the constraints of typical inventory management systems by effectively capturing temporal correlations and nuanced patterns in the data. This is achieved by integrating Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) architectures. To navigate modern supply chains effectively, the primary focus should be on offering real-time decision support. The approach aims to enhance the decision-making processes in inventory management. This brief introduction offers insight into a distinctive method aimed at addressing the challenges of modern supply networks. The strategy focuses on providing realtime decision support and optimization strategies to enhance inventory management efficiency. The model's effectiveness is demonstrated by thorough performance evaluations, showing higher accuracy, precision, and recall compared to existing logistic regression models. The suggested LSTM model achieves an accuracy of 0.99, precision of 0.96, recall of 0.94, and an F1 Score of 0.97, surpassing existing models with higher scores in all metrics. The GRU model, albeit somewhat less effective than the LSTM, shows great overall performance, especially in recall with a score of 0.97. This investigation compares the effectiveness of different models, focusing on the potential advancements made possible by LSTM and GRU architectures in improving decision-support systems for inventory optimization. The AI-Based Holistic Model provided is at the forefront of technology advancements, offering a comprehensive solution for making educated decisions and optimizing inventories sustainably in today's highly competitive corporate climate.

Improved Hierarchical Temporal Memory for Online Prediction of Ocean Time Series Data

Time series prediction is an effective tool for marine scientific research. The Hierarchical Temporal Memory (HTM) model has advantages over traditional recurrent neural network (RNN)-based models due to its online learning and prediction capabilities. Given that the neuronal structure of HTM is ill-equipped for the complexity of long-term marine time series applications, this study proposes a new, improved HTM model, incorporating Gated Recurrent Units (GRUs) neurons into the temporal memory algorithm to overcome this limitation. The capacities and advantages of the proposed model were tested and evaluated on time series data collected from the Xiaoqushan Seafloor Observatory in the East China Sea. The improved HTM model both outperforms the original one in short-term and long-term predictions and presents results with lower errors and better model stability than the GRU model, which is proficient in long-term predictions. The findings allow for the conclusion that the mechanism of online learning has certain advantages in predicting ocean observation data.

A CNN-GRU Hybrid Model for Predicting Airport Departure Taxiing Time

Scene taxiing time is an important indicator for assessing the operational efficiency of airports as well as green airports, and it is also a fundamental parameter in flight regularity statistics. The accurate prediction of taxiing time can help decision makers to further optimize flight pushback sequences and improve airport operational efficiency while increasing flight punctuality. In this paper, we propose a hybrid deep learning model for departure taxiing time prediction based on the new influence factors of taxiing time. Taking Pudong International Airport as the research object, after analyzing the scene operation mode, we construct the origin–destination pairs (ODPs) with stand groups and runways and then propose two structure-related factors, corridor departure flow and departure flow proportion of ODP, as the new features. Based on the new feature set, we construct a departure taxiing dataset for training the prediction model. Then, a departure taxiing time prediction model based on convolutional neural networks (CNNs) and gated recurrent units (GRUs) is proposed, which uses a CNN model to extract the high-dimensional features from the taxiing data and then inputs them to a GRU model for taxiing time prediction. Finally, we conduct a series of comparison experiments on the historical taxiing dataset of Pudong Airport. The prediction results show that the proposed hybrid prediction model has the best performances compared with other deep learning models, and the proposed structure-related features have high correlations with departure taxiing time. The prediction results of taxiing time for different ODPs also verify the generalizability of the proposed model.

DDFC: deep learning approach for deep feature extraction and classification of brain tumors using magnetic resonance imaging in E-healthcare system

This research explores the use of gated recurrent units (GRUs) for automated brain tumor detection using MRI data. The GRU model captures sequential patterns and considers spatial information within individual MRI images and the temporal evolution of lesion characteristics. The proposed approach improves the accuracy of tumor detection using MRI images. The model’s performance is benchmarked against conventional CNNs and other recurrent architectures. The research addresses interpretability concerns by employing attention mechanisms that highlight salient features contributing to the model’s decisions. The proposed model attention-gated recurrent units (A-GRU) results show promising results, indicating that the proposed model surpasses the state-of-the-art models in terms of accuracy and obtained 99.32% accuracy. Due to the high predictive capability of the proposed model, we recommend it for the effective diagnosis of Brain tumors in the E-healthcare system.

Real-Time UAV Trajectory Prediction for UTM Surveillance Using Machine Learning

The Unmanned Aerial System (UAS) Traffic Management (UTM) surveillance plays an important role in monitoring the safety compliance of UAV flights within specific operational zones. However, the quality of data reception from UAVs depends on transmission signal quality, leading to variable data latency during flights. As a means of addressing this issue and improving UAV operational safety, trajectory prediction emerges as a promising solution. This study aims to implement real-time trajectory prediction through the integration of machine learning techniques within the UTM surveillance system using Broadcast Remote ID. To facilitate this, a homemade receiver for broadcast Remote ID is developed using the ESP32 microcontroller. Subsequently, two distinctive flight tests are executed using a DJI Phantom 4 UAV. In the first flight, UAV trajectory data are used to serve as training input for the machine learning algorithms. The second flight focuses on the implementation of real-time trajectory prediction. The trajectory prediction model uses inputs such as latitude, longitude, height, speed, direction, latency time, and the Received Signal Strength Indicator (RSSI). Through an analysis of the first flight’s offline data, the Gated Recurrent Unit (GRU) algorithm is preferred to the Long Short-Term Memory (LSTM) algorithm. The outcomes of the second flight test prove the feasibility of the GRU-based trajectory prediction. The GRU model successfully produces real-time predictions during UAV flight, showcasing accuracy levels similar to those derived from offline prediction analyses with short processing time. This real-time trajectory prediction could improve the safety of UAV operation by providing the estimated position when the latency time is higher than the threshold.

Modeling opening price spread of Shanghai Composite Index based on ARIMA-GRU/LSTM hybrid model.

In the dynamic landscape of financial markets, accurate forecasting of stock indices remains a pivotal yet challenging task, essential for investors and policymakers alike. This study is motivated by the need to enhance the precision of predicting the Shanghai Composite Index's opening price spread, a critical measure reflecting market volatility and investor sentiment. Traditional time series models like ARIMA have shown limitations in capturing the complex, nonlinear patterns inherent in stock price movements, prompting the exploration of advanced methodologies. The aim of this research is to bridge the gap in forecasting accuracy by developing a hybrid model that integrates the strengths of ARIMA with deep learning techniques, specifically Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) networks. This novel approach leverages the ARIMA model's proficiency in linear trend analysis and the deep learning models' capability in modeling nonlinear dependencies, aiming to provide a comprehensive tool for market prediction. Utilizing a comprehensive dataset covering the period from December 20, 1990, to June 2, 2023, the study develops and assesses the efficacy of ARIMA, LSTM, GRU, ARIMA-LSTM, and ARIMA-GRU models in forecasting the Shanghai Composite Index's opening price spread. The evaluation of these models is based on key statistical metrics, including Mean Squared Error (MSE) and Mean Absolute Error (MAE), to gauge their predictive accuracy. The findings indicate that the hybrid models, ARIMA-LSTM and ARIMA-GRU, perform better in forecasting the opening price spread of the Shanghai Composite Index than their standalone counterparts. This outcome suggests that combining traditional statistical methods with advanced deep learning algorithms can enhance stock market prediction. The research contributes to the field by providing evidence of the potential benefits of integrating different modeling approaches for financial forecasting, offering insights that could inform investment strategies and financial decision-making.

Music Generation Based on Bidirectional GRU Model

Lately, substantial advancements in the realm of deep learning have given rise to new approaches for autonomously generating music. This study has devised a generative framework intended to produce musical melodies. This framework capitalizes on bidirectional gated recurrent units (GRU) as its foundational architecture. To impart knowledge to the model, a collection of classical piano compositions in MIDI format has been employed as the training dataset. One implements a stacked architecture of bidirectional GRU layers to capture long-term musical patterns. The addition of dropout regularization prevents overfitting. Generated samples are evaluated both quantitatively through model loss, as well as qualitatively by manual listening tests. According to the analysis, the approach can produce coherent musical melodies with reasonable structure. This demonstrates the potential for deep bidirectional models to learn musical syntax and generate new compositions. Limitations include lack of long-term musical form and repetitive patterns. Future work should explore architectures to improve coherence over longer time spans, as well as integrate other modalities like rhythm and harmony. These results provide a strong foundation for automated music generation systems.

A predictive method for impedance estimation of triboelectric nanogenerators based on a gated recurrent unit model

Majorities of existing studies aim at investigating the influence of relevant parameters of triboelectric nanogenerators (TENGs) on their electrical output. However, few studies reported the relationship between these parameters and internal impedances of TENGs. In this work, we have firstly achieved accurate prediction for internal impedances of contact-separation TENGs (CS-TENGs) with different combinations of structural and motion parameters through a gated recurrent unit (GRU) model. Specifically, optimal impedances of CS-TENGs with different parameter combinations are obtained through experiments to construct a dataset. Furthermore, we build a novel GRU model with optimized hyperparameters for accurate prediction of internal impedances. Meanwhile, two other methods including back propagation (BP) neural network and convolution neural network (CNN) are used for comparison via two performance indexes of MAE and RMSE. Experimental results show that the built GRU model presents the lowest prediction error with MAE and RMSE being 0.45 and 0.52, respectively. Finally, we compare the extent of influence of these four parameters on internal impedances of CS-TENGs, showing an order as follows: contact area>speed>thickness>type. Summarily, this work is aimed at providing a convenient and reliable approach to achieve reasonable structural designs for TENGs according to the required external load in actuality.