Bidirectional Gated Recurrent Unit Research Articles

A Text-Inception-Based Natural Language Processing Model for Sentiment Analysis of Drug Experiences

The study of sentiment in Natural Language Processing (NLP) is among the most successful research areas because of the availability of millions of user opinions online since the turn of the century. The economic, political, and medical fields are just some of the many that have benefited from studies of sentiment research. While numerous studies have examined more mainstream topics like consumer electronics, movies, and restaurants, relatively few have examined health and medical concerns. Considerable insight into where to direct efforts to improve public health might be gained by a study of how people feel about healthcare as a whole and of individual drug experiences in particular. When it comes to medicine, automatic analysis of online user evaluations paves the way for sifting through massive amounts of user feedback to find information regarding medications' efficacy and side effects that might be used to enhance pharmacovigilance programs. Simple rules-based methods have given way to more complex machine learning approaches like deep learning, which is developing as a technology for many natural language processing jobs. The opensource datasets have been analyzed with models that use word embeddings and term frequency-inverse document frequency (TF-IDF). A feature-enhanced text-inception model for sentiment classification was presented to work in tandem with this approach. The model first employed a cutting-edge text-inception module to glean useful shallow features from the text. K-MaxPooling was subsequently employed to reduce the dimensionality of its shallow and deep includes as well as enhance the generalization of characteristics, and a deep feature extraction module was formed using the bidirectional gated recurrent unit (Bi-GRU) and the capsule neural network to comprehend the text's semantic data. By combining traditional methods with cutting-edge artificial intelligence techniques, this hybrid approach can revolutionize public health initiatives, decision-making, and pharmacovigilance in the healthcare industry. This model achieved an exceptional accuracy rate of 99%, underscoring its effectiveness in sentiment classification and demonstrating its potential to significantly contribute to advancing healthcare and medical research.

Integration of attention mechanism and CNN-BiGRU for TDOA/FDOA collaborative mobile underwater multi-scene localization algorithm

The aim of this study is to address the issue of TDOA/FDOA measurement accuracy in complex underwater environments, which is affected by multipath effects and variations in water sound velocity induced by the challenging nature of the underwater environment. To this end, a novel cooperative localisation algorithm has been developed, integrating the attention mechanism and convolutional neural network-bidirectional gated recurrent unit (CNN-BiGRU) with TDOA/FDOA and two-step weighted least squares (ImTSWLS). This algorithm is designed to enhance the accuracy of TDOA/FDOA measurements in complex underwater environments. The algorithm initially makes use of the considerable capacity of a convolutional neural network (CNN) to extract profound spatial and frequency domain characteristics from multimodal data. These features are of paramount importance for the characterisation of underwater signal propagation, particularly in complex environments. Subsequently, through the use of a bidirectional gated recurrent unit (BiGRU), the algorithm is able to effectively capture long-term dependencies in time series data. This enables a more comprehensive analysis and understanding of the changing pattern of signals over time. Furthermore, the incorporation of an attention mechanism within the algorithm enables the model to focus more on the signal features that have a significant impact on localisation, while simultaneously suppressing the interference of extraneous information. This further enhances the efficiency of identifying and utilising the key signal features. ImTSWLS is employed to resolve the position and velocity data following the acquisition of the predicted TDOA/FDOA, thereby enabling the accurate estimation of the position and velocity of the mobile radiation source. The algorithm was subjected to a series of tests in a variety of simulated underwater environments, including different sea states, target motion speeds and base station configurations. The experimental results demonstrate that the algorithm exhibits a deviation of only 2.88 m/s in velocity estimation and 2.58 m in position estimation when the noise level is 20 dB. The algorithm presented in this paper demonstrates superior performance in both position and velocity estimation compared to other algorithms.

A Novel Rational Medicine Use System Based on Domain Knowledge Graph

Medication errors, which could often be detected in advance, are a significant cause of patient deaths each year, highlighting the critical importance of medication safety. The rapid advancement of data analysis technologies has made intelligent medication assistance applications possible, and these applications rely heavily on medical knowledge graphs. However, current knowledge graph construction techniques are predominantly focused on general domains, leaving a gap in specialized fields, particularly in the medical domain for medication assistance. The specialized nature of medical knowledge and the distinct distribution of vocabulary between general and biomedical texts pose challenges. Applying general natural language processing techniques directly to the medical domain often results in lower accuracy due to the inadequate utilization of contextual semantics and entity information. To address these issues and enhance knowledge graph production, this paper proposes an optimized model for named entity recognition and relationship extraction in the Chinese medical domain. Key innovations include utilizing Medical Bidirectional Encoder Representations from Transformers (MCBERT) for character-level embeddings pre-trained on Chinese biomedical corpora, employing Bi-directional Gated Recurrent Unit (BiGRU) networks for extracting enriched contextual features, integrating a Conditional Random Field (CRF) layer for optimal label sequence output, using the Piecewise Convolutional Neural Network (PCNN) to capture comprehensive semantic information and fusing it with entity features for better classification accuracy, and implementing a microservices architecture for the medication assistance review system. These enhancements significantly improve the accuracy of entity relationship classification in Chinese medical texts. The model achieved good performance in recognizing most entity types, with an accuracy of 88.3%, a recall rate of 85.8%, and an F1 score of 87.0%. In the relationship extraction stage, the accuracy reached 85.7%, the recall rate 82.5%, and the F1 score 84.0%.

FFA-BiGRU: Attention-Based Spatial-Temporal Feature Extraction Model for Music Emotion Classification

Music emotion recognition is becoming an important research direction due to its great significance for music information retrieval, music recommendation, and so on. In the task of music emotion recognition, the key to achieving accurate emotion recognition lies in how to extract the affect-salient features fully. In this paper, we propose an end-to-end spatial-temporal feature extraction method named FFA-BiGRU for music emotion classification. Taking the log Mel-spectrogram of music audio as the input, this method employs an attention-based convolutional residual module named FFA, which serves as a spatial feature learning module to obtain multi-scale spatial features. In the FFA module, three group architecture blocks extract multi-level spatial features, each of which consists of a stack of multiple channel-spatial attention-based residual blocks. Then, the output features from FFA are fed into the bidirectional gated recurrent units (BiGRU) module to capture the temporal features of music further. In order to make full use of the extracted spatial and temporal features, the output feature maps of FFA and those of the BiGRU are concatenated in the channel dimension. Finally, the concatenated features are passed through fully connected layers to predict the emotion classification results. The experimental results of the EMOPIA dataset show that the proposed model achieves better classification accuracy than the existing baselines. Meanwhile, the ablation experiments also demonstrate the effectiveness of each part of the proposed method.

Adopting artificial intelligence algorithms for remote fetal heart rate monitoring and classification using wearable fetal phonocardiography

Fetal phonocardiography (FPCG) is a non-invasive Fetal Heart Rate (FHR) monitoring technique that can detect vibrations and murmurs in heart sounds. However, acquiring fetal heart sounds from a wearable FPCG device is challenging due to noise and artefacts. This research contributes a resilient solution to overcome the conventional issues by adopting Artificial Intelligence (AI) with FPCG for automated FHR monitoring in an end-to-end manner, named (AI-FHR). Four sequential methodologies were used to ensure reliable and accurate FHR monitoring. The proposed method removes low-frequency noises and high-frequency noises by using Chebyshev II high-pass filters and Enhanced Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (ECEEMDAN) in combination with Phase Shifted Maximal Overlap Discrete Wavelet Transform (PS-MODWT) filters, respectively. The denoised signals are segmented to reduce complexity, and the segmentation is performed using multi-agent deep Q-learning (MA-DQL). The segmented signal is provided to reduce the redundancies in cardiac cycles using the Artificial Hummingbird Optimization (AHBO) algorithm. The segmented and non-redundant signals are converted into 3D spectrograms using a machine learning algorithm called variational auto-encoder-general adversarial networks (VAE-GAN). The feature extraction and classification are carried out by adopting a hybrid of the bidirectional gated recurrent unit (BiGRU) and the multi-boosted capsule network (MBCapsNet). The proposed method was implemented and simulated using MATLAB R2020a and validated by adopting effective validation metrics. The results demonstrate that the proposed method performed better than the current method with accuracy (81.34%), sensitivity (72%), F1-score (83%), Energy (0.808 J), and complexity index (13.34). Like other optimization methods, AHO needs precise parameter adjustment in order to function well. Its performance may be greatly impacted by the selection of parameters, including population size, exploration rate, and learning rate.

An improved deep temporal convolutional network for new energy stock index prediction

Accurate prediction of the stock indexes in the new energy market is of significant importance to both investors and policymakers. However, in response to the volatility and uncertainty characteristic of the new energy market, most scholars currently focus on training prediction methods using features from a single time scale, which cannot capture the fluctuations of new energy stock indexes under different time scales. Therefore, in this paper, a hybrid deep learning model Multi-kernel Parallel TemporalNet (MKP-TemporalNet) is proposed for predicting new energy stock indexes. This model initially incorporates an attention mechanism to calibrate the feature importance of multivariate time series dynamically, and then combines the characteristics of improved Temporal Convolutional Networks (iTCN) and Bidirectional Gated Recurrent Units (BiGRU) to enhance prediction accuracy effectively. In particular, the novelty of the iTCN lies in the development of a multi-kernel parallel convolution structure within a residual layout at the core of the temporal convolution module, to address the low efficiency of traditional TCN's single kernel convolution in extracting temporal features from input sequences at different time scales. Results from evaluating MKP-TemporalNet against several popular machine learning models on six new energy stock indexes confirm its predictive effectiveness in the new energy sector.

Quantitative Soil Characterization for Biochar-Cd Adsorption: Machine Learning Prediction Models for Cd Transformation and Immobilization.

Soil pollution with cadmium (Cd) poses serious health and environmental consequences. The study investigated the incubation of several soil samples and conducted quantitative soil characterization to assess the influence of biochar (BC) on Cd adsorption. The aim was to develop predictive models for Cd concentrations using statistical and modeling approaches dependent on soil characteristics. The potential risk linked to the transformation and immobilization of Cd adsorption by BC in the soil could be conservatively assessed by pH, clay, cation exchange capacity, organic carbon, and electrical conductivity. In this study, Long Short-Term Memory (LSTM), Bidirectional Gated Recurrent Unit (BiGRU), and 5-layer CNN Convolutional Neural Networks (CNNs) were applied for risk assessments to establish a framework for evaluating Cd risk in BC amended soils to predict Cd transformation. In the case of control soils (CK), the BiGRU model showed commendable performance, with an R2 value of 0.85, indicating an approximate 85.37% variance in the actual Cd. The LSTM model, which incorporates sequence data, produced less accurate results (R2=0.84), while the 5-layer CNN model had an R2 value of 0.91, indicating that the CNN model could account for over 91% of the variation in actual Cd levels. In the case of BC-applied soils, the BiGRU model demonstrated a strong correlation between predicted and actual values with R2 (0.93), indicating that the model explained 93.21% of the variance in Cd concentrations. Similarly, the LSTM model showed a notable increase in performance with BC-treated soil data. The R2 value for this model stands at a robust R2 (0.94), reflecting its enhanced ability to predict Cd levels with BC incorporation. Outperforming both recurrent models, the 5-layer CNN model attained the highest precision with an R2 value of 0.95, suggesting that 95.58% of the variance in the actual Cd data can be explained by the CNN model's predictions in BC-amended soils. Consequently, this study suggests developing ecological soil remediation strategies that can effectively manage heavy metal pollution in soils for environmental sustainability.

Deep learning systems for forecasting the prices of crude oil and precious metals

Commodity markets, such as crude oil and precious metals, play a strategic role in the economic development of nations, with crude oil prices influencing geopolitical relations and the global economy. Moreover, gold and silver are argued to hedge the stock and cryptocurrency markets during market downsides. Therefore, accurate forecasting of crude oil and precious metals prices is critical. Nevertheless, due to the nonlinear nature, substantial fluctuations, and irregular cycles of crude oil and precious metals, predicting their prices is a challenging task. Our study contributes to the commodity market price forecasting literature by implementing and comparing advanced deep-learning models. We address this gap by including silver alongside gold in our analysis, offering a more comprehensive understanding of the precious metal markets. This research expands existing knowledge and provides valuable insights into predicting commodity prices. In this study, we implemented 16 deep- and machine-learning models to forecast the daily price of the West Texas Intermediate (WTI), Brent, gold, and silver markets. The employed deep-learning models are long short-term memory (LSTM), BiLSTM, gated recurrent unit (GRU), bidirectional gated recurrent units (BiGRU), T2V-BiLSTM, T2V-BiGRU, convolutional neural networks (CNN), CNN-BiLSTM, CNN-BiGRU, temporal convolutional network (TCN), TCN-BiLSTM, and TCN-BiGRU. We compared the forecasting performance of deep-learning models with the baseline random forest, LightGBM, support vector regression, and k-nearest neighborhood models using mean absolute error (MAE), mean absolute percentage error, and root mean squared error as evaluation criteria. By considering different sliding window lengths, we examine the forecasting performance of our models. Our results reveal that the TCN model outperforms the others for WTI, Brent, and silver, achieving the lowest MAE values of 1.444, 1.295, and 0.346, respectively. The BiGRU model performs best for gold, with an MAE of 15.188 using a 30-day input sequence. Furthermore, LightGBM exhibits comparable performance to TCN and is the best-performing machine-learning model overall. These findings are critical for investors, policymakers, mining companies, and governmental agencies to effectively anticipate market trends, mitigate risk, manage uncertainty, and make timely decisions and strategies regarding crude oil, gold, and silver markets.

Salmon origin traceability based on hyperspectral imaging data fusion strategy and improved deep learning method

Salmon is subject to significant fraudulent activities due to its high economic value, making it crucial to accurately determine its geographical origin for trade, consumers, and food safety. This study aims to explore the spectral and textural features in Hyperspectral Imaging (HSI) data of salmons and investigate the potential of deep learning methods and information fusion strategy in salmon origin traceability. Additionally, an improved dung beetle optimization algorithm optimized Bidirectional Gated Recurrent Unit (BiGRU) deep learning model (CNN-BiGRU) was constructed to handle high-dimensional data accurately in discerning the origin of salmon. On the other hand, an ensemble learning model was built by stacking three base models (Random Forest, LightGBM, and Gradient Boosting Decision Tree), and a comprehensive evaluation of the predictive performance between the ensemble learning model and the base models was conducted. The results indicate that the classification performance of the ensemble learning model consistently outperforms the base models. However, compared with traditional machine learning methods, deep learning models demonstrate superior performance in handling high-dimensional data, particularly exhibiting robustness in handling fused data. Notably, the MSADBO–CNN–BiGRU model stands out among all algorithms, showing an improvement of 0.8%–7% in accuracy on the test set compared to the pre-optimized CNN model, with the best model achieving a test set accuracy of 99.5%. Overall, this study demonstrates that combining deep learning with information fusion strategy can rapidly and accurately identify the geographical origin of salmon, providing methods and insights for future traceability of agricultural products.

Enhancing Word Sense Disambiguation for Amharic homophone words using Bidirectional Long Short-Term Memory network

Given the Amharic language has a lot of perplexing terminology since it features duplicate homophone letters, fidel's ሀ, ሐ, and ኀ (three of which are pronounced as HA), ሠ and ሰ (both pronounced as SE), አ and ዐ (both pronounced as AE), and ጸ and ፀ (both pronounced as TSE). The WSD (Word Sense Disambiguation) model, which tackles the issue of lexical ambiguity in the context of the Amharic language, is developed using a deep learning technique. Due to the unavailability of the Amharic wordnet, a total of 1756 examples of paired Amharic ambiguous homophonic words were collected. These words were ድህነት(dhnet) and ድኅነት(dhnet), ምሁር(m'hur) and ምሑር(m'hur), በአል(be'al) and በዢል(be'al), አቢይ (abiy) and ዐቢይ(abiy), with a total of 1756 examples. Following word preprocessing, word2vec, fasttext, Term Frequency-Inverse Document Frequency (TFIDF), and bag of words (BoW) were used to vectorize the text. The vectorized text was divided into train and test data. The train data was then analysed using Naive Bayes (NB), K-nearest neighbour (KNN), logistic regression (LG), decision trees (DT), random forests (RF), and random oversampling technique. Bidirectional Gate Recurrent Unit (BiGRU) and Bidirectional Long Short-Term Memory (BiLSTM) improved to 99.99 % accuracy even with limited datasets.

Phishing Website Detection Using Bidirectional Gated Recurrent Unit Model and Feature Selection

Phishing attacks continue to be a significant threat to internet users, necessitating the development of advanced detection systems. This study explores the efficacy of a Bidirectional Gated Recurrent Unit (BiGRU) model combined with feature selection techniques for detecting phishing websites. The dataset used for this research is sourced from the UCI Machine Learning Repository, specifically the Phishing Websites dataset. This approach involves cleaning and preprocessing the data, then normalizing features and employing feature selection to identify the most relevant attributes for classification. The BiGRU model, known for its ability to capture temporal dependencies in data, is then applied. To ensure robust evaluation, we utilized cross-validation, dividing the data into five folds. The experimental results are highly promising, demonstrating a Mean Accuracy, Mean Precision, Mean Recall, Mean F1 Score, and Mean AUC of 1.0. These results indicate the model's exceptional performance distinguishing between phishing and legitimate websites. This study highlights the potential of combining BiGRU models with feature selection and cross-validation to create highly accurate phishing detection systems, providing a reliable solution to enhance cybersecurity measures.

Mining software insights: uncovering the frequently occurring issues in low-rating software applications.

In today's digital world, app stores have become an essential part of software distribution, providing customers with a wide range of applications and opportunities for software developers to showcase their work. This study elaborates on the importance of end-user feedback for software evolution. However, in the literature, more emphasis has been given to high-rating & popular software apps while ignoring comparatively low-rating apps. Therefore, the proposed approach focuses on end-user reviews collected from 64 low-rated apps representing 14 categories in the Amazon App Store. We critically analyze feedback from low-rating apps and developed a grounded theory to identify various concepts important for software evolution and improving its quality including user interface (UI) and user experience (UX), functionality and features, compatibility and device-specific, performance and stability, customer support and responsiveness and security and privacy issues. Then, using a grounded theory and content analysis approach, a novel research dataset is curated to evaluate the performance of baseline machine learning (ML), and state-of-the-art deep learning (DL) algorithms in automatically classifying end-user feedback into frequently occurring issues. Various natural language processing and feature engineering techniques are utilized for improving and optimizing the performance of ML and DL classifiers. Also, an experimental study comparing various ML and DL algorithms, including multinomial naive Bayes (MNB), logistic regression (LR), random forest (RF), multi-layer perception (MLP), k-nearest neighbors (KNN), AdaBoost, Voting, convolutional neural network (CNN), long short-term memory (LSTM), bidirectional long short term memory (BiLSTM), gated recurrent unit (GRU), bidirectional gated recurrent unit (BiGRU), and recurrent neural network (RNN) classifiers, achieved satisfactory results in classifying end-user feedback to commonly occurring issues. Whereas, MLP, RF, BiGRU, GRU, CNN, LSTM, and Classifiers achieved average accuracies of 94%, 94%, 92%, 91%, 90%, 89%, and 89%, respectively. We employed the SHAP approach to identify the critical features associated with each issue type to enhance the explainability of the classifiers. This research sheds light on areas needing improvement in low-rated apps and opens up new avenues for developers to improve software quality based on user feedback.

Advanced Explainable AI: Self Attention Deep Neural Network of Text Classification

The classification of texts is a crucial component of the data retrieval mechanism. By utilizing semantic details representation, and the text vector sequence is condensed, resulting in a reduction in the temporal and spatial order of the memory pattern. This process helps to clarify the context of the text, extract crucial feature information, and fuse these features to determine the classification outcome. This approach represents the preprocessed text data using character-level vectors. The self-attention mechanism is used to understand the interdependence of words in a text, allowing for the extraction of internal structure-related data. Furthermore, the semantic characteristics of text data have been extracted independently using Deep Convolutional Neural Network (DCNN) and Bi-directional Gated Recurrent Unit (BiGRU) using a Soft-Attention mechanism. These two distinct feature extraction outcomes are then merged. The Softmax layer is employed to categorize the deep-extracted attributes, hence enhancing the accuracy of the classification model. This improvement is achieved by including a uniform distribution component into the cross-entropy loss function. Our results demonstrate that our suggested method for explainability outperforms the model that was suggested in terms of accuracy and computing efficiency. For the purpose of assessing the effectiveness of our suggested approach, we developed many baseline models and performed an evaluation their studies.

Pedagogical sentiment analysis based on the BERT-CNN-BiGRU-attention model in the context of intercultural communication barriers.

Amid the wave of globalization, the phenomenon of cultural amalgamation has surged in frequency, bringing to the fore the heightened prominence of challenges inherent in cross-cultural communication. To address these challenges, contemporary research has shifted its focus to human-computer dialogue. Especially in the educational paradigm of human-computer dialogue, analysing emotion recognition in user dialogues is particularly important. Accurately identify and understand users' emotional tendencies and the efficiency and experience of human-computer interaction and play. This study aims to improve the capability of language emotion recognition in human-computer dialogue. It proposes a hybrid model (BCBA) based on bidirectional encoder representations from transformers (BERT), convolutional neural networks (CNN), bidirectional gated recurrent units (BiGRU), and the attention mechanism. This model leverages the BERT model to extract semantic and syntactic features from the text. Simultaneously, it integrates CNN and BiGRU networks to delve deeper into textual features, enhancing the model's proficiency in nuanced sentiment recognition. Furthermore, by introducing the attention mechanism, the model can assign different weights to words based on their emotional tendencies. This enables it to prioritize words with discernible emotional inclinations for more precise sentiment analysis. The BCBA model has achieved remarkable results in emotion recognition and classification tasks through experimental validation on two datasets. The model has significantly improved both accuracy and F1 scores, with an average accuracy of 0.84 and an average F1 score of 0.8. The confusion matrix analysis reveals a minimal classification error rate for this model. Additionally, as the number of iterations increases, the model's recall rate stabilizes at approximately 0.7. This accomplishment demonstrates the model's robust capabilities in semantic understanding and sentiment analysis and showcases its advantages in handling emotional characteristics in language expressions within a cross-cultural context. The BCBA model proposed in this study provides effective technical support for emotion recognition in human-computer dialogue, which is of great significance for building more intelligent and user-friendly human-computer interaction systems. In the future, we will continue to optimize the model's structure, improve its capability in handling complex emotions and cross-lingual emotion recognition, and explore applying the model to more practical scenarios to further promote the development and application of human-computer dialogue technology.

Classification of cotton crop disease using hybrid model and MDFC feature extraction method

AbstractA novel Modified Deep Fuzzy Clustering (MDFC) based classification model involves four major phases. They are preprocessing, segmentation, feature extraction and finally, detection and classification phase. To reduce noise and smooth the edges of the input image of the cotton crop, bilateral filtering is first used as a preprocessing approach. Next, a modified deep fuzzy clustering is suggested for the segmentation procedure that creates a collection of segments from the preprocessed image. The segmented image is then processed to extract relevant characteristics by using an enhanced Pyramid of Histogram Orientation Gradient (PHOG), Local Directional Ternary Pattern (LDTP), and statistical‐based features. In order to detect and classify cotton crop diseases more effectively, this paper proposes a hybrid system. Here, the features are put through a detection phase, after which the extracted features are trained in the Bidirectional Gated Recurrent Unit (Bi‐GRU) model to determine whether or not the cotton crop is infected. Once it is detected to be diseased, the type of disease is classified via an improved Recurrent Neural Network (RNN). In terms of several performance metrics, the proposed model is validated in comparison with the traditional approaches. The MDFC‐based classification model outperforms existing models with a specificity of 0.9687 at a learning rate of 90. In contrast, other models achieve lower specificities: Bi‐GRU (0.8436), RNN (0.8359), CNN (0.8654), LSTM (0.8769), SVM (0.7983), VGG16 (0.8619), DCNN (0.8725), BI‐RNN + BI‐LSTM (0.7869), and NN + CNN (0.85478).

Bi-GRU-APSO: Bi-Directional Gated Recurrent Unit with Adaptive Particle Swarm Optimization Algorithm for Sales Forecasting in Multi-Channel Retail

In the present scenario, retail sales forecasting has a great significance in E-commerce companies. The precise retail sales forecasting enhances the business decision making, storage management, and product sales. Inaccurate retail sales forecasting can decrease customer satisfaction, inventory shortages, product backlog, and unsatisfied customer demands. In order to obtain a better retail sales forecasting, deep learning models are preferred. In this manuscript, an effective Bi-GRU is proposed for accurate sales forecasting related to E-commerce companies. Initially, retail sales data are acquired from two benchmark online datasets: Rossmann dataset and Walmart dataset. From the acquired datasets, the unreliable samples are eliminated by interpolating missing data, outlier’s removal, normalization, and de-normalization. Then, feature engineering is carried out by implementing the Adaptive Particle Swarm Optimization (APSO) algorithm, Recursive Feature Elimination (RFE) technique, and Minimum Redundancy Maximum Relevance (MRMR) technique. Followed by that, the optimized active features from feature engineering are given to the Bi-Directional Gated Recurrent Unit (Bi-GRU) model for precise retail sales forecasting. From the result analysis, it is seen that the proposed Bi-GRU model achieves higher results in terms of an R2 value of 0.98 and 0.99, a Mean Absolute Error (MAE) of 0.05 and 0.07, and a Mean Square Error (MSE) of 0.04 and 0.03 on the Rossmann and Walmart datasets. The proposed method supports the retail sales forecasting by achieving superior results over the conventional models.

Exploring Anomaly Detection and Risk Assessment in Financial Markets Using Deep Neural Networks

In this paper, deep learning technology, along with a Gated Recurrent Unit (GRU) combined with an attention mechanism, is used to enhance the recognition ability and risk assessment accuracy of abnormal trading behavior in financial markets. The GRU effectively solves the problem of gradient vanishing in traditional recurrent neural networks through its unique gated structure, allowing the model to learn more stable and effective feature representations in long sequence data. On this basis, the contextual attention (CA) module in the attention mechanism is introduced, enabling the model to automatically learn and assign different weights to various parts of the input sequence. Combined with bidirectional GRU and the attention mechanism, the model can not only capture temporal dependencies in the sequence, but also highlight the key features that affect market anomalies, thus improving the model's ability to understand complex market dynamics.

Optimizing hybrid neural networks for precise COVID-19 mRNA vaccine degradation prediction

Conventional hybrid models often miss an essential factor that can lead to less effective performance: intrinsic sequence dependence when combining various neural network (NN) architectures. This study addresses this issue by highlighting the importance of sequence hybridization in NN architecture integration, aiming to improve model effectiveness. It combines NN layers—dense, long short-term memory (LSTM), and gated recurrent unit (GRU)—using the Keras Sequential API for defining the architecture. To provide better context, bidirectional LSTM (BiLSTM) and bidirectional GRU (BiGRU) replace their unidirectional counterparts, enhancing the models through bidirectional structures. Out of 25 NN models tested, 18 four-layer hybrid NN models consist of one-quarter dense layer and the rest BiLSTM and BiGRU layers. These hybrid NN models undergo supervised learning regression analysis, with mean column-wise root mean square error (MCRMSE) as the performance metric. The results show that each hybrid NN model produces unique outcomes based on its specific hybrid sequence. The Hybrid_LGSS model performs better than existing three-layer BiLSTM networks in predictive accuracy and shows lower overfitting (MCRMSEs of 0.0749 and 0.0767 for training and validation, respectively). This indicates that the optimal hybridization sequence is crucial for achieving a balance between performance and simplicity. In summary, this research could help vaccinologists develop better mRNA vaccines and provide data analysts with new insights for improvement.

Dual-market quantitative trading: The dynamics of liquidity and turnover in financial markets

Financial market liquidity is a popular research topic. Investor-driven research uses the turnover rate to measure liquidity and generally finds that the higher the stock turnover rate, the lower the returns. However, the traditional financial liquidity theory has been impacted by new machine-driven quantitative trading models. To explore high machine-driven liquidity and the impact of high turnover rates on returns, this study establishes a dual-market quantitative trading system, introduces a variational modal decomposition (VMD)-bidirectional gated recurrent unit (BiGRU) model for data prediction, and uses the back-end Hong Kong foreign exchange market to develop a quantitative trading strategy using the same rotating funds in the U.S. and Chinese stock markets. The experimental results show that given a principal amount of 210,000.00 CNY, the final predicted net return is 226,538.30 CNY, a net return of 107.86%, which is 40.6% higher than the net return of a single Chinese market. We conclude that, under machine-driven trading, increasing liquidity and turnover increase returns. This study provides a new perspective on liquidity theory that is useful for future financial market research and quantitative trading practices.

Named Entity Recognition for Chinese Texts on Marine Coral Reef Ecosystems Based on the BERT-BiGRU-Att-CRF Model

In addressing the challenges of non-standardization and limited annotation resources in Chinese marine domain texts, particularly with complex entities like long and nested entities in coral reef ecosystem-related texts, existing Named Entity Recognition (NER) methods often fail to capture deep semantic features, leading to inefficiencies and inaccuracies. This study introduces a deep learning model that integrates Bidirectional Encoder Representations from Transformers (BERT), Bidirectional Gated Recurrent Units (BiGRU), and Conditional Random Fields (CRF), enhanced by an attention mechanism, to improve the recognition of complex entity structures. The model utilizes BERT to capture context-relevant character vectors, employs BiGRU to extract global semantic features, incorporates an attention mechanism to focus on key information, and uses CRF to produce optimized label sequences. We constructed a specialized coral reef ecosystem corpus to evaluate the model’s performance through a series of experiments. The results demonstrated that our model achieved an F1 score of 86.54%, significantly outperforming existing methods. The contributions of this research are threefold: (1) We designed an efficient named entity recognition framework for marine domain texts, improving the recognition of long and nested entities. (2) By introducing the attention mechanism, we enhanced the model’s ability to recognize complex entity structures in coral reef ecosystem texts. (3) This work offers new tools and perspectives for marine domain knowledge graph construction and study, laying a foundation for future research. These advancements propel the development of marine domain text analysis technology and provide valuable references for related research fields.