Hybrid Deep Learning Approach Research Articles

Enhancing E-Learning Adaptability with Automated Learning Style Identification and Sentiment Analysis: A Hybrid Deep Learning Approach for Smart Education

In smart education, adaptive e-learning systems personalize the educational process by tailoring it to individual learning styles. Traditionally, identifying these styles relies on learners completing surveys and questionnaires, which can be tedious and may not reflect their true preferences. Additionally, this approach assumes that learning styles are fixed, leading to a cold-start problem when automatically identifying styles based on e-learning platform behaviors. To address these challenges, we propose a novel approach that annotates unlabeled student feedback using multi-layer topic modeling and implements the Felder–Silverman Learning Style Model (FSLSM) to identify learning styles automatically. Our method involves learners answering four FSLSM-based questions upon logging into the e-learning platform and providing personal information like age, gender, and cognitive characteristics, which are weighted using fuzzy logic. We then analyze learners’ behaviors and activities using web usage mining techniques, classifying their learning sequences into specific styles with an advanced deep learning model. Additionally, we analyze textual feedback using latent Dirichlet allocation (LDA) for sentiment analysis to enhance the learning experience further. The experimental results demonstrate that our approach outperforms existing models in accurately detecting learning styles and improves the overall quality of personalized content delivery.

A hybrid deep learning approach to predict hourly riverine nitrate concentrations using routine monitored data

With high-frequency data of nitrate (NO3–N) concentrations in waters becoming increasingly important for understanding of watershed system behaviors and ecosystem managements, the accurate and economic acquisition of high-frequency NO3–N concentration data has become a key point. This study attempted to use coupled deep learning neural networks and routine monitored data to predict hourly NO3–N concentrations in a river. The hourly NO3–N concentration at the outlet of the Oyster River watershed in New Hampshire, USA, was predicted through neural networks with a hybrid model architecture coupling the Convolutional Neural Networks and the Long Short-Term Memory model (CNN-LSTM). The routine monitored data (the river depth, water temperature, air temperature, precipitation, specific conductivity, pH and dissolved oxygen concentrations) for model training were collected from a nested high-frequency monitoring network, while the high-frequency NO3–N concentration data obtained at the outlet were not included as inputs. The whole dataset was separated into training, validation, and testing processes according to the ratio of 5:3:2, respectively. The hybrid CNN-LSTM model with different input lengths (1d, 3d, 7d, 15d, 30d) displayed comparable even better performance than other studies with lower frequencies, showing mean values of the Nash-Sutcliffe Efficiency 0.60–0.83. Models with shorter input lengths demonstrated both the higher modeling accuracy and stability. The water level, water temperature and pH values at monitoring sites were main controlling factors for forecasting performances. This study provided a new insight of using deep learning networks with a coupled architecture and routine monitored data for high-frequency riverine NO3–N concentration forecasting and suggestions about strategies about variable and input length selection during preprocessing of input data.

Disruption detection for a cognitive digital supply chain twin using hybrid deep learning

Recent disruptive events, such as COVID-19 and Russia–Ukraine conflict, had a significant impact of global supply chains. Digital supply chain twins have been proposed in order to provide decision makers with an effective and efficient tool to mitigate disruption impact. This paper introduces a hybrid deep learning approach for disruption detection within a cognitive digital supply chain twin framework to enhance supply chain resilience. The proposed disruption detection module utilises a deep autoencoder neural network combined with a one-class support vector machine algorithm. In addition, long-short term memory neural network models are developed to identify the disrupted echelon and predict time-to-recovery from the disruption effect. The obtained information from the proposed approach will help decision-makers and supply chain practitioners make appropriate decisions aiming at minimizing negative impact of disruptive events based on real-time disruption detection data. The results demonstrate the trade-off between disruption detection model sensitivity, encountered delay in disruption detection, and false alarms. This approach has seldom been used in recent literature addressing this issue.

A hybrid deep learning approach to integrate predictive maintenance and production planning for multi-state systems

This paper develops a data-driven approach to dynamically integrate tactical production and predictive maintenance planning for a multi-state system composed of several series-parallel machines. The objective is to determine an integrated lot-sizing and preventive maintenance strategy that will minimize the sum of maintenance and production costs, while satisfying the demand for all products over the entire horizon. A rolling horizon planning strategy is adopted to continuously update the production and maintenance plans based on new data obtained through sensors. Unlike the existing integrated models, we develop a hybrid deep learning (DL) approach to coordinate maintenance and production decisions for a multi-state system composed of multiple machines. To accurately predict the health condition of each machine, the developed hybrid DL method combines the powers of convolutional neural network (CNN), long-short-term memory (LSTM), and attention technique. We use multi-state reliability theory to estimate the production capacity. Furthermore, a genetic algorithm is developed to solve large-scale problems. Benchmarking data are used to compare the results of our data-driven approach with a model-based approach, a pure LSTM, and a CNN-LSTM approach. This comparison is based on prediction accuracy, solution quality, and computational time. The obtained results show the superiority of the suggested CNN-LSTM-attention data-driven framework integrating maintenance and production.

Automatic Classification of Stegano files using the Features of Natural Language Processing and Hybrid Deep Learning Algorithms

The corporate sector has adopted communication as its principal medium due to the improvements of the digital era. In the past, in-person meetings, purchases, settlements, business talks, and profile-taking were all done. However, everything has gone digital in the present period. Over the last several years, there has been a noticeable exponential rise in the amount of complicated texts and documents that require a deeper comprehension of machine learning techniques in order to recognize languages in a variety of applications. Outstanding results in the processing of natural languages have been obtained by a number of Artificial Intelligent techniques. A key component of machine learning and deep learning techniques' efficacy is their capacity to understand intricate models and non-linear connections in data. Choosing the right architecture, frameworks, and algorithms for classifying input, like text files, managing audio and video files, however, is a difficult undertaking. The proposed work's goal is to identify text, audio messages, chatbots, and smart records using natural language processing. Using a hybrid deep learning approach, text, voice, and video recordings are used as inputs to be classified. Problem Synopsis: With contact becoming more and more important to business, companies have created advanced NLP programs. Through chatbots, digital records, phone conversations, and messages, these NLP swiftly fulfil human desires. Customer preferences, desires, and demands have been found to be more strongly impacted by the ease of communication and connection. Today's service providers use chatbots, digital records, messaging apps, email, and phone conversations as their main methods of communication for almost all of their trade channels of preference, client queries, and transactions. Proposed Method: The study shows how input stegano file is processed automatically based on user reactions, text message replies, and audio record identification during communications using text content, voice messages, and audio using the features of Natural Language Processing and hybrid Deep Learning Algorithms

Hybrid Deep Learning Approach for Hydraulic Fracture Morphology Diagnosis in Coalbed Methane Wells

Hybrid Deep Learning Approach for Hydraulic Fracture Morphology Diagnosis in Coalbed Methane Wells

Empowering hate speech detection: leveraging linguistic richness and deep learning

Social media has become a vital part of most modern human personal life. Twitter is one of the social media that was formed from the development of communication technology. A lot of social media gives users the freedom to express themselves. This facility is misused by users, so hate speech is spread. Designing a system to detect hate speech intelligently is needed. This study uses the hybrid deep learning (HDL) and solo deep learning (SDL) approach with the convolutional neural networks (CNN) and bidirectional gated recurrent unit (Bi-GRU) algorithm. There are 4 models built, namely CNN, Bi-GRU, CNN+Bi-GRU, and Bi-GRU+CNN. Term frequency-inverse document frequency (TF-IDF) is used for feature extraction, which is to get linguistic features to be analyzed and studied. FastText is used to perform feature expansion to minimize mismatched vocabulary. Four scenarios are run. CNN with an accuracy of 87.63%, Bi-GRU produces an accuracy of 87.46%, CNN+Bi-GRU provides an accuracy of 87.47% and Bi-GRU+CNN provides an accuracy of 87.34%. The ability of this approach to understand the context is qualified. HDL outperforms SDL in terms of n-gram type, where HDL can understand sentences broken down by hybrid n-gram types, namely Unigram-Bigram-Trigram which is a complex n-gram hybrid.

A Novel Hybrid Unet-RBF and CNN-RBF Algorithm for Autism Spectrum Disorder Classification

The 2021 CDC report indicates that Autism Spectrum Disorder affects 1 in 44 children, necessitating advanced classification methods. This article proposes a hybrid deep learning approach for ASD classification, merging U-net and Radial Basis Functions for medical image segmentation and integrating Convolutional Neural Network with RBF for ASD classification. Achieving 94.79% accuracy surpasses previous studies, highlighting deep learning's potential in neuroscience. Future research should explore diverse algorithms, validating them across varied datasets with different hyperparameters to enhance ASD classification efficiency.

Efficient feature extraction and hybrid deep learning for early identification of uterine fibroids in ultrasound images

AbstractNon‐cancerous growths called uterine fibroids develop in the uterus. They can vary in size, location, and number, and can produce symptoms including excessive menstrual flow, pelvic discomfort, and reproductive problems. Early detection of uterine fibroids is important because it allows for timely intervention and appropriate management strategies. Extracting meaningful features from ultrasound (US) images requires robust and effective techniques. However, different feature extraction methods may yield varying results, and the choice of technique can influence the accuracy of fibroid detection. This paper presents an efficient approach for early detection of uterine fibroids in US images. Our proposed technique combines efficient feature extraction methods and a hybrid deep learning approach. Firstly, we employ the well‐known canny edge detection algorithm to accurately identify the edges of the fibroid region in the US images. This step helps in segmenting the target edge portion for further analysis. Additionally, we introduce an improved bird swarm optimization (IBSO) algorithm to extract a comprehensive set of features, utilizing both known features and newly obtained features. This approach enhances the accuracy of fibroid detection in uterine images. The proposed method uses a convolutional recurrent neural network (CRNN) to accurately detect and treat uterine fibroids, ensuring timely diagnosis and treatment. Our proposed IBSO‐CRNN model produces accuracy rates of 99.897% and 97.568% on the augmented and original datasets, respectively.

Automatic Classification of Stegano files using the features of Natural Language Processing and hybrid Deep Learning Algorithms

The corporate sector has adopted communication as its principal medium due to the improvements of the digital era. In the past, in-person meetings, purchases, settlements, business talks, and profile-taking were all done. However, everything has gone digital in the present period. Over the last several years, there has been a noticeable exponential rise in the amount of complicated texts and documents that require a deeper comprehension of machine learning techniques in order to recognize languages in a variety of applications. Outstanding results in the processing of natural languages have been obtained by a number of Artificial Intelligent techniques. A key component of machine learning and deep learning techniques' efficacy is their capacity to understand intricate models and non-linear connections in data. Choosing the right architecture, frameworks, and algorithms for classifying input, like text files, managing audio and video files, however, is a difficult undertaking. The proposed work's goal is to identify text, audio messages, chatbots, and smart records using natural language processing. Using a hybrid deep learning approach, text, voice, and video recordings are used as inputs to be classified. Problem Synopsis: With contact becoming more and more important to business, companies have created advanced NLP programs. Through chatbots, digital records, phone conversations, and messages, these NLP swiftly fulfil human desires. Customer preferences, desires, and demands have been found to be more strongly impacted by the ease of communication and connection. Today's service providers use chatbots, digital records, messaging apps, email, and phone conversations as their main methods of communication for almost all of their trade channels of preference, client queries, and transactions. Proposed Method: The study shows how input stegano file is processed automatically based on user reactions, text message replies, and audio record identification during communications using text content, voice messages, and audio using the features of Natural Language Processing and hybrid Deep Learning Algorithms

BioDeepfuse: a hybrid deep learning approach with integrated feature extraction techniques for enhanced non-coding RNA classification

ABSTRACT The accurate classification of non-coding RNA (ncRNA) sequences is pivotal for advanced non-coding genome annotation and analysis, a fundamental aspect of genomics that facilitates understanding of ncRNA functions and regulatory mechanisms in various biological processes. While traditional machine learning approaches have been employed for distinguishing ncRNA, these often necessitate extensive feature engineering. Recently, deep learning algorithms have provided advancements in ncRNA classification. This study presents BioDeepFuse, a hybrid deep learning framework integrating convolutional neural networks (CNN) or bidirectional long short-term memory (BiLSTM) networks with handcrafted features for enhanced accuracy. This framework employs a combination of k-mer one-hot, k-mer dictionary, and feature extraction techniques for input representation. Extracted features, when embedded into the deep network, enable optimal utilization of spatial and sequential nuances of ncRNA sequences. Using benchmark datasets and real-world RNA samples from bacterial organisms, we evaluated the performance of BioDeepFuse. Results exhibited high accuracy in ncRNA classification, underscoring the robustness of our tool in addressing complex ncRNA sequence data challenges. The effective melding of CNN or BiLSTM with external features heralds promising directions for future research, particularly in refining ncRNA classifiers and deepening insights into ncRNAs in cellular processes and disease manifestations. In addition to its original application in the context of bacterial organisms, the methodologies and techniques integrated into our framework can potentially render BioDeepFuse effective in various and broader domains.

A hybrid deep learning approach for streamflow prediction utilizing watershed memory and process-based modeling

Abstract Accurate streamflow prediction is essential for optimal water management and disaster preparedness. While data-driven methods’ performance often surpasses process-based models, concerns regarding their ‘black-box’ nature persist. Hybrid models, integrating domain knowledge and process modeling into a data-driven framework, offer enhanced streamflow prediction capabilities. This study investigated watershed memory and process modeling-based hybridizing approaches across diverse hydrological regimes – Korean and Ethiopian watersheds. Following watershed memory analysis, the Soil and Water Assessment Tool (SWAT) was calibrated using the recession constant and other relevant parameters. Three hybrid models, incorporating watershed memory and residual error, were developed and evaluated against standalone long short-term memory (LSTM) models. Hybrids outperformed the standalone LSTM across all watersheds. The memory-based approach exhibited superior and consistent performance across training, evaluation periods, and regions, achieving 17–66% Nash–Sutcliffe efficiency coefficient improvement. The residual error-based technique showed varying performance across regions. While hybrids improved extreme event predictions, particularly peak flows, all models struggled at low flow. Korean watersheds’ significant prediction improvements highlight the hybrid models’ effectiveness in regions with pronounced temporal hydrological variability. This study underscores the importance of selecting a specific hybrid approach based on the desired objectives rather than solely relying on statistical metrics that often reflect average performance.

Energy-driven TBM health status estimation with a hybrid deep learning approach

This study provides a hybrid deep learning approach that enables the researchers to estimate the Tunnel Boring Machine (TBM) health status during excavation process using energy consumption data. By analyzing the energy forms and paths in the tunneling process, the key energy factors' consumption performance behavior affecting TBM safety is identified. The Ensemble Empirical Mode Decomposition (EEMD) method and a Convolution neural network-Long short term memory-Depth Neural Network (CNN-LSTM-DNN, CLDNN) model are integrated for Health Performance Parameter (HPP) prediction. A classification method is constructed by the Generative Adversarial Imputation Networks (GAIN) model for health status estimation. The SHapley Additive exPlanations (SHAP) method is performed to quantify the relationships between energy consumption and system health status. A tunneling case in Singapore is used to test the effectiveness of the developed methodology. It is found that (1) the proposed method provides TBM cutter wear and cooling oil prediction with a R-square (R2) of 0.8591 and 0.8727, respectively, and (2) classification results indicate that the estimation F1-score of 0.9863 can be achieved based on health status evaluation indicator (HSEI). The novelty of the proposed approach lies in its capabilities of (1) fully extracting and utilizing the energy consumption information in every regard to predict TBM health performance; (2) providing a good one-step-ahead health status estimation for the TBM excavation process. Therefore, this study proposes a feasible direction for the application of energy consumption data in TBM health status estimation.

A hybrid deep learning approach for enhanced network intrusion detection

The contemporary era places paramount importance on network security and cloud environments, driven by increased data transmission demands, the flexibility of cloud services, and the prevalence of global resources. Addressing the escalating threat of computer malware, the development of efficient intrusion detection systems (IDS) is imperative. This research focuses on the challenges posed by imbalanced datasets and the necessity for unsupervised learning to enhance network security. The proposed hybrid deep learning method utilizes raw data from the CSE-CIC-IDS-2018 dataset, integrating imbalanced and unsupervised learning techniques. After preprocessing and normalization, feature extraction through principal component analysis (PCA) reduces dimensionality from seventy-eight fields to ten essential features. Clustering, employing the density-based spatial clustering of applications with noise (DBSCAN) algorithm optimized with particle swarm optimization (PSO), is applied to the extracted features, distinguishing between attack and non-attack packets. Addressing dataset imbalances, imbalanced learning techniques are employed, and unsupervised learning is exemplified through the AutoEncoder (AE) algorithm. The attack cluster’s data is input into AE, a deep learning-based approach, yielding outputs for attack classification. The proposed technique (PCA+DBSCANPSO+AE) achieves an impressive 99.19% accuracy in intrusion detection, surpassing contemporary methodologies and five existing techniques. This research not only enhances accuracy but also addresses imbalanced learning challenges, utilizing the power of unsupervised learning for robust network security.

Spatiotemporal Landsat-Sentinel-2 satellite imagery-based Hybrid Deep Neural network for paddy crop prediction using Google Earth engine

Rice is one of the predominant food sources to fulfill the dietary requirements of well-being in India. Therefore, accurate and timely paddy crop yield prediction is crucial to ensure the food security of the country. In this direction, the present study proposed a hybrid deep-learning method based on Conv-1D and LSTM layers using the classification-derived phenological with meteorological parameters for paddy crop yield prediction. The paddy crop classification has been conducted using high-resolution (10 m) multispectral imagery based on GPS coordinates collected during the paddy field visits to extract the phenological parameters for input to the prediction model. In this context, the efficiency of Random Forest, Naïve Bayes, SVM, and Gradient Tree boost classifiers was assessed. Furthermore, we have also analyzed the accuracy of Landsat-8, Sentinel-1 GRD, and Sentinel-2 satellite imagery in paddy crop classification based on area estimation. The Statistical Abstract of Haryana was utilized to validate the paddy crop area estimation and yield prediction. The classification outcomes showed that the Random Forest method attained the highest accuracy of 96.6 % compared to other GEE-based classifiers. The proposed Hybrid Deep learning approach achieved an RMSE value of 0.219 t/ha compared to CNN, LSTM, CNN-Bi-LSTM, and Regression techniques for crop yield prediction. The study conclusion highlighted that the sentinel-2 satellite imagery performed well and found that the proposed hybrid approach provided an alternative for paddy crop yield prediction.

Cyclone Prediction from Remote Sensing Images Using Hybrid Deep Learning Approach Based on AlexNet

Cyclone Prediction from Remote Sensing Images Using Hybrid Deep Learning Approach Based on AlexNet

Hybrid Deep Learning Approach for Classification and Analysis of X Posts on Russia Ukraine War

Hybrid Deep Learning Approach for Classification and Analysis of X Posts on Russia Ukraine War

Unveiling the prevalence and risk factors of early stage postpartum depression: a hybrid deep learning approach

Unveiling the prevalence and risk factors of early stage postpartum depression: a hybrid deep learning approach

Streaming traffic classification: a hybrid deep learning and big data approach

Streaming traffic classification: a hybrid deep learning and big data approach

An efficient automatic modulation recognition using time–frequency information based on hybrid deep learning and bagging approach

An efficient automatic modulation recognition using time–frequency information based on hybrid deep learning and bagging approach