Hybrid CNN-LSTM Research Articles

SQL injection attack: Detection, prioritization & prevention

Web applications have become central in the digital landscape, providing users instant access to information and allowing businesses to expand their reach. Injection attacks, such as SQL injection (SQLi), are prominent attacks on web applications, given that most web applications integrate a database system. While there have been solutions proposed in the literature for SQLi attack detection using learning-based frameworks, the problem is often formulated as a binary, single-attack vector problem without considering the prioritization and prevention component of the attack. In this work, we propose a holistic solution, SQLR34P3R, that formulates the SQLi attack as a multi-class, multi-attack vector, prioritization, and prevention problem. For attack detection and classification, we gathered 457,233 samples of benign and malicious network traffic, as well as 70,023 samples that had SQLi and benign payloads. After evaluating several machine-learning-based algorithms, the hybrid CNN-LSTM models achieve an average F1-Score of 97% in web and network traffic filtering. Furthermore, by using CVEs of SQLi vulnerabilities, SQLR34P3R incorporates a novel risk analysis approach which reduces additional effort while maintaining reasonable coverage to assist businesses in allocating resources effectively by focusing on patching vulnerabilities with high exploitability. We also present an in-the-wild evaluation of the proposed solution by integrating SQLR34P3R into the pipeline of known vulnerable web applications such as Damn Vulnerable Web Application (DVWA) and Vulnado and via network traffic captured using Wireshark from SQLi DNS exfiltration conducted with SQLMap for real-time detection. Finally, we provide a comparative analysis with state-of-the-art SQLi attack detection and risk ratings solutions.

Urban air quality index forecasting using multivariate convolutional neural network based customized stacked long short-term memory model

In the context of increasing urban pollution and its adverse health effects, this study focuses on enhancing the air quality prediction model by forecasting future concentrations of various Air Quality Index (AQI) levels to support the development of green smart cities. The primary objective of this study is to develop a robust multivariate time series forecasting model using a combination of Convolutional Neural Networks (CNN) and Customized Stacked-based Long Short-Term Memory (CSLSTM) networks, namely C2SLSTM. The proposed methodology involved preprocessing AQI and meteorological data, scaling the features, and employing a hybrid CNN-LSTM architecture to capture spatial and temporal dependencies in the data. Dynamic AQI pattern changes are computed using online learning. The proposed model was trained on a big dataset containing AQIs such as particulate matter (PM2.5), carbon monoxide (CO), and nitrogen dioxide (NO2), along with meteorological factors like weather count, temperature, wind, humidity, and pressure. Experimental results demonstrate that the model achieved a mean absolute error (MAE) of 0.25, mean square error (MSE) of 0.083, root mean square error (RMSE) of 0.289 and a R2-Score of 0.84 on the test set. Also, compared to Long Short-Term Memory (LSTM), Convolutional Neural Network (CNN), Stacked Long Short-Term Memory (SLSTM), and Multilayer Perceptron (MLP) models, the C2SLSTM model showcases a performance enhancement of 35 %, 50 %, 30 %, and 32 %. Notably, the CNN component effectively extracted spatial features, while the LSTM layers captured temporal patterns, leading to precise predictions. These results indicate that the proposed approach effectively captures temporal dependencies and improves forecasting performance, with R2-Score values tending towards 1 for 12-hour prediction intervals. This research demonstrates the potential of advanced SLSTM architectures in accurately predicting AQI metrics, which can aid in better environmental monitoring and management. Also, the spatiotemporal correlation analysis is done through the designed ir metric.

Forecasting and analyzing influenza activity in Hebei Province, China, using a CNN-LSTM hybrid model

BackgroundInfluenza, an acute infectious respiratory disease, presents a significant global health challenge. Accurate prediction of influenza activity is crucial for reducing its impact. Therefore, this study seeks to develop a hybrid Convolution Neural Network—Long Short Term Memory neural network (CNN-LSTM) model to forecast the percentage of influenza-like-illness (ILI) rate in Hebei Province, China. The aim is to provide more precise guidance for influenza prevention and control measures.MethodsUsing ILI% data from 28 national sentinel hospitals in the Hebei Province, spanning from 2010 to 2022, we employed the Python deep learning framework PyTorch to develop the CNN-LSTM model. Additionally, we utilized R and Python to develop four other models commonly used for predicting infectious diseases. After constructing the models, we employed these models to make retrospective predictions, and compared each model’s prediction performance using mean absolute error (MAE), root mean square error (RMSE), mean absolute percentage error (MAPE), and other evaluation metrics.ResultsBased on historical ILI% data from 28 national sentinel hospitals in Hebei Province, the Seasonal Auto-Regressive Indagate Moving Average (SARIMA), Extreme Gradient Boosting (XGBoost), Convolution Neural Network (CNN), Long Short Term Memory neural network (LSTM) models were constructed. On the testing set, all models effectively predicted the ILI% trends. Subsequently, these models were used to forecast over different time spans. Across various forecasting periods, the CNN-LSTM model demonstrated the best predictive performance, followed by the XGBoost model, LSTM model, CNN model, and SARIMA model, which exhibited the least favorable performance.ConclusionThe hybrid CNN-LSTM model had better prediction performances than the SARIMA model, CNN model, LSTM model, and XGBoost model. This hybrid model could provide more accurate influenza activity projections in the Hebei Province.

Prediction of novel malware using hybrid convolution neural network and long short-term memory approach

The rapid evolution of network communication technologies has led to the emergence of new forms of malware and cybercrimes, posing significant threats to user safety, network infrastructure integrity, and data privacy. Despite efforts to develop advanced algorithms for detecting malicious activity, constructing models that are both accurate and reliable remains a challenge, especially in handling vast and dynamically shifting data patterns. The prevalent bag-of-words (BOW) method, while widely used, falls short in capturing crucial spatial and sequence information vital for detecting malware patterns. To address this challenge, the work presented in this paper proposes hybrid convolution neural network-long short-term memory network (CNN-LSTM) combination models, leveraging CNN's spatial information extraction and LSTM's temporal modeling capabilities. Focused on predicting the infiltration of malicious software into personal computers, the proposed hybrid CNN-LSTM model considers factors such as location, firmware version, operating system, and anti-virus software. The proposed models undergo training and evaluation using Microsoft's malware dataset, demonstrating superior performance compared to traditional CNN and LSTM models. The CNN-LSTM model achieves an impressive accuracy of 95% on the Microsoft malware dataset, highlighting its effectiveness in malware detection.

Time Series Analysis for Air Pollution Prediction in High-Intensity Development Areas using Deep Learning

Objective: The purpose of this study is to design novel approach to predict air pollution indices accurately using hybrid approach in highly populated cities of the world. Methods: This study aimed to address the significant bottleneck of relying on a single model for time series analysis which we accomplished by developing a hybrid forecasting method. This blended method combines the advantages of CNN (Convolutional Neural Networks) and LSTM (Long Short Term Memory) hybrid model together, overcoming insufficiency of air pollution prediction. Findings: Due to the empirical operation that revealed in achieving proper predictions we have come to understand that relying on a single model for the estimation of time-series data results is inefficient and misleading, mostly due to the non-linear nature of raw data. On the other hand, by using this hybrid model forecasting, we can uncover more detailed patterns through longer period of time and predict them more accurate by using weather and air pollution related data.The hybrid CNN-LSTM Model achieved least values of 6.742 for MAE,12.921 for RMSE compared to other approaches, which indicatesmere perfection. Novelty: The novelty of our approach is to fuse LSTM and CNN models in order to perform exhaustive analysis on the dynamics of the air pollution throughout the entirety of the city. Through the combination of these two models, such a tool is made simpler to use, and there is an improved accuracy in predictions. This thus becomes a promising tool in the fight against air pollution in cities that have a very high population just like Delhi. Keywords: ­ Air Pollution, LSTM, CNN, Deep Learning, Time Series Analysis, Nonlinear Relationships

Monthly climate prediction using deep convolutional neural network and long short-term memory

Climate change affects plant growth, food production, ecosystems, sustainable socio-economic development, and human health. The different artificial intelligence models are proposed to simulate climate parameters of Jinan city in China, include artificial neural network (ANN), recurrent NN (RNN), long short-term memory neural network (LSTM), deep convolutional NN (CNN), and CNN-LSTM. These models are used to forecast six climatic factors on a monthly ahead. The climate data for 72 years (1 January 1951–31 December 2022) used in this study include monthly average atmospheric temperature, extreme minimum atmospheric temperature, extreme maximum atmospheric temperature, precipitation, average relative humidity, and sunlight hours. The time series of 12 month delayed data are used as input signals to the models. The efficiency of the proposed models are examined utilizing diverse evaluation criteria namely mean absolute error, root mean square error (RMSE), and correlation coefficient (R). The modeling result inherits that the proposed hybrid CNN-LSTM model achieves a greater accuracy than other compared models. The hybrid CNN-LSTM model significantly reduces the forecasting error compared to the models for the one month time step ahead. For instance, the RMSE values of the ANN, RNN, LSTM, CNN, and CNN-LSTM models for monthly average atmospheric temperature in the forecasting stage are 2.0669, 1.4416, 1.3482, 0.8015 and 0.6292 °C, respectively. The findings of climate simulations shows the potential of CNN-LSTM models to improve climate forecasting. Climate prediction will contribute to meteorological disaster prevention and reduction, as well as flood control and drought resistance.

A Hybrid Deep Learning Model to Estimate the Future Electricity Demand of Sustainable Cities

Rapid population growth, economic growth, and technological developments in recent years have led to a significant increase in electricity consumption. Therefore, the estimation of electrical energy demand is crucial for the planning of electricity generation and consumption in cities. This study proposes a hybrid deep learning model that combines convolutional neural network (CNN) and long short-term memory (LSTM) techniques, both of which are deep learning techniques, to estimate electrical load demand. A hybrid deep learning model and LSTM model were applied to a dataset containing hourly electricity consumption and meteorological information of a city in Türkiye from 2017 to 2021. The results were evaluated using mean absolute percent error (MAPE), root mean square error (RMSE), mean absolute error (MAE), and coefficient of determination (R2) metrics. The proposed CNN-LSTM hybrid model was compared to the LSTM model, with lower MAPE, MAE, and RMSE values. Furthermore, the CNN-LSTM model exhibited superior prediction performance with an R2 value of 0.8599 compared to the LSTM model with an R2 value of 0.8086. These results demonstrate the effectiveness of the proposed deep learning model in accurately estimating future electrical load demand to plan electricity generation for sustainable cities.

3D word embedding vector feature extraction and hybrid CNN-LSTM for natural disaster reports identification

3D word embedding vector feature extraction and hybrid CNN-LSTM for natural disaster reports identification

Balancing performance and efficiency: A CNN-LSTM hybrid model for sentiment analysis

In the era of rapid e-commerce and social networks, the recognition of textual emotion has garnered escalating interest in recent years. This area of study proves pivotal for applications such as content recommendation and human-robot interaction. Prominent models such as CNN, LSTM, and Roberta have been used in natural language processing to decipher the subtleties of textual emotion. Despite the commendable accuracy achieved by Roberta, its extensive model parameters come at the cost of sluggish training speeds. To address this issue, we propose a novel hybrid approach that integrates Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) networks. We employ this hybrid model to address the emotion classification problem using a dataset named "Emotion", and we compare its performance with that of individual models like Roberta, CNN, and LSTM. The new hybrid model exhibits a more compact architecture while maintaining a relatively high accuracy rate, boasting an impressive 91%. This hybrid architecture can provide a good compromise between efficiency and performance. This research contributes to the ongoing exploration of efficient and accurate models for textual emotion recognition, emphasizing the significance of balancing model complexity and training speed in practical applications.

NETWORK CYBERSECURITY INCIDENTS MULTICLASSIFICATION BASED ON DEEP LEARNING

The rapid increase in network traffic and the growing complexity of cyberattacks have rendered traditional cybersecurity monitoring methods insufficient for effectively detecting and classifying network incidents. To overcome these limitations, we present a deep learning-based approach that utilizes a hybrid architecture, combining Convolutional Neural Networks (CNNs) and Long Short-Term Memory (LSTM) models, for the multi-classification of cybersecurity incidents. Our model is trained on the CICIDS2017 dataset, which encompasses a wide range of attack types. The hybrid CNN-LSTM model achieved a classification accuracy of 96.76% and an error rate of 9.34%, showcasing its ability to accurately detect and classify various cybersecurity threats. This approach offers a robust solution for enhancing the detection and classification of network cybersecurity incidents.

Deep Learning-Based Red Blood Cell Classification for Sickle Cell Anemia Diagnosis Using Hybrid CNN-LSTM Model

Deep Learning-Based Red Blood Cell Classification for Sickle Cell Anemia Diagnosis Using Hybrid CNN-LSTM Model

A novel insight on input variable and time lag selection in daily streamflow forecasting using deep learning models

This study investigates the feasibility of using hybrid models namely Convolutional Neural Network (CNN)-Long Short-Term Memory (LSTM) and Convolutional Neural Network (CNN)-Gated Recurrent Unit (GRU), for short-to-medium range streamflow forecasting in the Mahanadi River basin in India. The performance of these hybrid models is compared with that of standalone models. It investigates the impact of selected parameters and associated time lags on the model performance and offers valuable insights into the use of hybrid models for runoff simulation. The hybrid CNN-LSTM model proves to be robust in capturing the overall time series and the typical high peak flows in both the correlation-based and constant lag cases. Also, the upstream discharges play a significant role in improving the streamflow forecasting. Furthermore, the consideration of all input variables with a constant time lag equal to the basin lag time may yield better flood forecasts, even in cases where computational resources are limited.

A Hybrid CNN–LSTM Model for Transaction Fee Forecasting in Post EIP-1559 Ethereum

A Hybrid CNN–LSTM Model for Transaction Fee Forecasting in Post EIP-1559 Ethereum

Weighted voting ensemble of hybrid CNN-LSTM Models for vision-based human activity recognition

Weighted voting ensemble of hybrid CNN-LSTM Models for vision-based human activity recognition

Hybrid CNN-LSTM model driven image segmentation and roughness prediction for tool condition assessment with heterogeneous data

Worn tools might lead to substantial detrimental implications on the surface integrity of workpieces for precision/ultra-precision machining. Most previous research has heavily relied on singular information, which might not be appropriate enough to ascertain tool conditions and guarantee the accuracy of workpieces. This paper proposes a CNN-LSTM hybrid model directly utilizing tool images to predict surface roughness on machined parts for tool condition assessment. This work first performs pruning based on UNet3+ architecture to eliminate redundant structures while integrating attention mechanisms to enhance the model's focus on the target region. On this basis, tool wear region information is intensely mined and heterogeneous data is optimized using Spearman correlation analysis. Subsequently, we innovatively proposed a hybrid model that integrates CNN and RNN, endowing the model with the ability to process spatial and sequential information. The effectiveness of the proposed methodology is validated using the practical data obtained from cutting experiments. The results indicate that the proposed tool condition assessment methodology significantly improves the segmentation accuracy of the tool wear region to 94.52 % (Dice coefficient) and predicts the surface roughness of machined parts with an accuracy exceeding 93.1 % (R2). It can be observed that the developed methodology may provide an effective solution for accurate tool condition assessment and the implementation of tool health management.

Algal blooms forecasting with hybrid deep learning models from satellite data in the Zhoushan fishery

Algal blooms are increasingly frequent in coastal areas, posing a significant threat to coastal ecosystems. The Zhoushan fishery, one of the most affected regions along the Chinese coast, faces severe challenges from algal blooms. In this study, Convolutional Neural Network (CNN), Long Short-term Memory (LSTM) and hybrid CNN-LSTM deep learning models were constructed to forecast chlorophyll (Chl) concentrations and algal blooms from satellite data. The hybrid CNN-LSTM model outperformed the individual models, achieving the highest determination coefficient and the lowest root mean square error for Chl concentration forecasts. It also excelled in predicting algal blooms, with the highest probability of detection and Heidke skill score, effectively capturing the trends in algal bloom development. In areas with high Chl concentration, the Chl parameter significantly influences model forecasts, while meridional wind and current are the main influence factors in the regions with medium and low Chl concentration. The powerful algal bloom forecast provided by the hybrid CNN-LSTM model offers valuable support for the efficient management and sustainable development of the Zhoushan fishery.

Power prediction using high-resolution SCADA data with a farm-wide deep neural network approach

Accurate loss estimation methods with a high level of temporal granularity are necessary to enable the implementation of efficient and adaptable control strategies for wind farms. Predictive models for the power of wind turbines within a wind farm are investigated using high-resolution SCADA data and deep learning methodologies. Traditional physical models offer detailed insights but are computationally expensive. Statistical models face limitations in handling wind energy variability. In this study, deep learning models are explored to capture spatial and temporal dynamics, with four models developed: Multi-Layer Perceptron (MLP), Convolutional Neural Network (CNN), Long Short-Term Memory network (LSTM), and a hybrid CNN-LSTM model. SCADA data from an offshore wind farm is preprocessed, anomalies removed, and annotated based on operational regions. The models are trained, validated, and tested, demonstrating improved accuracy over baseline methods. The hybrid model, incorporating spatial and temporal information, yields the highest predictive performance, showcasing the significance of these dimensions in wind power prediction.

Combating Misinformation: Leveraging Deep Learning for Hoax Detection in Indonesian Political Social Media

The rampant spread of hoax news in social media, especially in the political domain, poses a significant challenge that requires immediate attention. To address this issue, automatic hoax news detection using machine learning-based artificial intelligence has emerged as a promising approach. With the approaching presidential election in Indonesia in 2024, the need for effective detection methods becomes even more pressing.This research focuses on proposing an efficient deep learning model for detecting political hoax news on Indonesian social media. Word2vec feature representation and three deep learning models – LSTM, CNN, and Hybrid CNN-LSTM – are evaluated to determine the most effective approach. Experimental results reveal that the CNN-LSTM hybrid model outperforms the others, achieving an accuracy of 96% in detecting hoax news on Indonesian social media in the political domain. By leveraging state-of-the-art deep learning techniques, particularly the CNN-LSTM hybrid model, this study contributes to the advancement of hoax news detection in Indonesia's political landscape. The findings underscore the importance of utilizing sophisticated machine learning methods to combat the spread of misinformation, particularly during crucial political events such as elections.

Exposing Deep Fake Face Detection using LSTM and CNN

The rapid advancement of deep learning techniques, creating realistic multimedia content has become increasingly accessible, leading to the proliferation of DeepFake technology. DeepFake utilizes generative deep learning algorithms to produce or modify face features in a highly realistic manner, often making it challenging to differentiate between real and manipulated media. This technology, while beneficial in fields such as entertainment and education, also poses significant threats, including misinformation and identity theft. Consequently, detecting DeepFakes has become a critical area of research. In this paper, we propose a novel approach to DeepFake face detection by integrating Convolutional Neural Networks (CNN) with Long Short-Term Memory (LSTM) networks. Our method leverages the strengths of CNNs in spatial feature extraction and LSTMs in temporal sequence modeling to enhance detection accuracy. The CNN component captures intricate facial features, while the LSTM analyzes the temporal dynamics of video frames. We evaluate our model on several benchmark datasets, including Celeb-DF (v2), DeepFake Detection Challenge Preview, and FaceForensics++. Experimental results demonstrate that our hybrid CNN-LSTM model achieves state-of-the-art performance, surpassing existing methods in both accuracy and robustness. This study highlights the potential of combining CNN and LSTM architectures for effective DeepFake detection, contributing to the ongoing efforts to safeguard against digital media manipulation

Schlieren imaging and video classification of alphabet pronunciations: exploiting phonetic flows for speech recognition and speech therapy

Speech is a highly coordinated process that requires precise control over vocal tract morphology/motion to produce intelligible sounds while simultaneously generating unique exhaled flow patterns. The schlieren imaging technique visualizes airflows with subtle density variations. It is hypothesized that speech flows captured by schlieren, when analyzed using a hybrid of convolutional neural network (CNN) and long short-term memory (LSTM) network, can recognize alphabet pronunciations, thus facilitating automatic speech recognition and speech disorder therapy. This study evaluates the feasibility of using a CNN-based video classification network to differentiate speech flows corresponding to the first four alphabets: /A/, /B/, /C/, and /D/. A schlieren optical system was developed, and the speech flows of alphabet pronunciations were recorded for two participants at an acquisition rate of 60 frames per second. A total of 640 video clips, each lasting 1 s, were utilized to train and test a hybrid CNN-LSTM network. Acoustic analyses of the recorded sounds were conducted to understand the phonetic differences among the four alphabets. The hybrid CNN-LSTM network was trained separately on four datasets of varying sizes (i.e., 20, 30, 40, 50 videos per alphabet), all achieving over 95% accuracy in classifying videos of the same participant. However, the network’s performance declined when tested on speech flows from a different participant, with accuracy dropping to around 44%, indicating significant inter-participant variability in alphabet pronunciation. Retraining the network with videos from both participants improved accuracy to 93% on the second participant. Analysis of misclassified videos indicated that factors such as low video quality and disproportional head size affected accuracy. These results highlight the potential of CNN-assisted speech recognition and speech therapy using articulation flows, although challenges remain in expanding the alphabet set and participant cohort.