Convolutional Long Short-term Memory Layers Research Articles

Sentinel Shield: Leveraging ConvLSTM and Elephant Herd Optimization for Advanced Network Intrusion Detection

Given the escalating intricacy of network environments and the rising level of sophistication in cyber threats, there is an urgent requirement for resilient and effective network intrusion detection systems (NIDS). This document presents an innovative NIDS approach that utilizes Convolutional Long Short-Term Memory (ConvLSTM) networks and Elephant Herd Optimization (EHO) to achieve precise and timely intrusion detection. Our proposed model combines the strengths of ConvLSTM, which can effectively capture spatiotemporal dependencies in network traffic data, and EHO, which allow the model to focus on relevant information while filtering out noise. To achieve this, we first preprocess network traffic data into sequential form and use ConvLSTM layers to learn both spatial and temporal features. Subsequently, we introduce Elephant Herd Optimization that dynamically assigns different weights to different parts of the input data, emphasizing the regions most likely to contain malicious activity. To evaluate the effectiveness of our approach, we conducted extensive experiments on publicly available network intrusion CICIDS2017 Dataset. The experimental results demonstrate the efficacy of the proposed approach (Accuracy = 99.98%), underscoring its potential to revolutionize modern network intrusion detection and proactively safeguard digital assets.

A New Deep-Learning Method for Human Activity Recognition.

Currently, three-dimensional convolutional neural networks (3DCNNs) are a popular approach in the field of human activity recognition. However, due to the variety of methods used for human activity recognition, we propose a new deep-learning model in this paper. The main objective of our work is to optimize the traditional 3DCNN and propose a new model that combines 3DCNN with Convolutional Long Short-Term Memory (ConvLSTM) layers. Our experimental results, which were obtained using the LoDVP Abnormal Activities dataset, UCF50 dataset, and MOD20 dataset, demonstrate the superiority of the 3DCNN + ConvLSTM combination for recognizing human activities. Furthermore, our proposed model is well-suited for real-time human activity recognition applications and can be further enhanced by incorporating additional sensor data. To provide a comprehensive comparison of our proposed 3DCNN + ConvLSTM architecture, we compared our experimental results on these datasets. We achieved a precision of 89.12% when using the LoDVP Abnormal Activities dataset. Meanwhile, the precision we obtained using the modified UCF50 dataset (UCF50mini) and MOD20 dataset was 83.89% and 87.76%, respectively. Overall, our work demonstrates that the combination of 3DCNN and ConvLSTM layers can improve the accuracy of human activity recognition tasks, and our proposed model shows promise for real-time applications.

CL-Net: ConvLSTM-Based Hybrid Architecture for Batteries’ State of Health and Power Consumption Forecasting

Traditional power generating technologies rely on fossil fuels, which contribute to worldwide environmental issues such as global warming and climate change. As a result, renewable energy sources (RESs) are used for power generation where battery energy storage systems (BESSs) are widely used to store electrical energy for backup, match power consumption and generation during peak hours, and promote energy efficiency in a pollution-free environment. Accurate battery state of health (SOH) prediction is critical because it plays a key role in ensuring battery safety, lowering maintenance costs, and reducing BESS inconsistencies. The precise power consumption forecasting is critical for preventing power shortage and oversupply, and the complicated physicochemical features of batteries dilapidation cannot be directly acquired. Therefore, in this paper, a novel hybrid architecture called ‘CL-Net’ based on convolutional long short-term memory (ConvLSTM) and long short-term memory (LSTM) is proposed for multi-step SOH and power consumption forecasting. First, battery SOH and power consumption-related raw data are collected and passed through a preprocessing step for data cleansing. Second, the processed data are fed into ConvLSTM layers, which extract spatiotemporal features and form their encoded maps. Third, LSTM layers are used to decode the encoded features and pass them to fully connected layers for final multi-step forecasting. Finally, a comprehensive ablation study is conducted on several combinations of sequential learning models using three different time series datasets, i.e., national aeronautics and space administration (NASA) battery, individual household electric power consumption (IHEPC), and domestic energy management system (DEMS). The proposed CL-Net architecture reduces root mean squared error (RMSE) up to 0.13 and 0.0052 on the NASA battery and IHEPC datasets, respectively, compared to the state-of-the-arts. These experimental results show that the proposed architecture can provide robust and accurate SOH and power consumption forecasting compared to the state-of-the-art.

DeepYield: A combined convolutional neural network with long short-term memory for crop yield forecasting

Crop yield forecasting is of great importance to crop market planning, crop insurance, harvest management, and optimal nutrient management. Commonly used approaches for crop prediction include but are not limited to conducting extensive manual surveys or using data from remote sensing. Considering the increasing amount of data provided by remote sensing imagery, this approach is becoming increasingly important for the task of crop yield forecasting and there is a need for more sophisticated approaches to extract the inherent spatiotemporal patterns of these data. Although considerable progress has been made in this field by using Deep Learning (DL) methods such as Convolutional Neural Networks (CNN), no study before has investigated the use of Convolutional Long Short-Term Memory (ConvLSTM) for crop yield forecasting. Here, we propose DeepYield, a combined structure, that integrates the ConvLSTM layers with the 3-Dimensional CNN (3DCNN) for more accurate and reliable spatiotemporal feature extraction. The models are trained by using county-based historical yield data and MODIS Land Surface Temperature (LST), Surface Reflectance (SR), and Land Cover (LC) data over 1836 primary soybean growing counites in the Contiguous United States (CONUS). The forecasting performance of the developed models is compared against the competing approaches including Decision Trees, CNN + GP, and CNN-LSTM and results indicate that DeepYield significantly outperforms these techniques and also performs better than both ConvLSTM and 3DCNN.

An efficient deep learning framework to reconstruct the flow field sequences of the supersonic cascade channel

Accurate and comprehensive flow field reconstruction is essential for promptly monitoring the flow state of the supersonic cascade. This paper proposes a novel data-driven method for reconstructing the slices of the two-dimensional (2D) pressure field in three-dimensional (3D) flow of the supersonic cascade by using deep neural networks. Considering the complicated spatial effects of 2D pressure field slices, the architecture embeds the convolution into the long short-term memory (LSTM) network to realize the purpose of using the upstream pressure to reconstruct downstream pressure. Numerical simulations of the supersonic cascade under different back pressures are performed to establish the database capturing the complex relationship between the upstream and downstream flow. The pressure of different upstream slices can be used as a spatial-dependent sequence as the input of the model to reconstruct the pressure of different downstream slices. A deep neural network including special convolutional LSTM layers and convolutional layers is designed. The trained model is then tested under different back pressures. The reconstruction results are in good agreement with the computational fluid dynamics, especially for the identification of shock wave position changes and the recognition of complex curved shock waves in 3D flow with high accuracy. Moreover, analyzing the frequency distribution of reconstructed pressure at different positions can clearly distinguish the flow separated zone, which will further improve the accuracy of the state monitoring. Specifically, it is of great significance for identifying the stall of the flow field promptly.

CLSTM: Deep Feature-Based Speech Emotion Recognition Using the Hierarchical ConvLSTM Network

Artificial intelligence, deep learning, and machine learning are dominant sources to use in order to make a system smarter. Nowadays, the smart speech emotion recognition (SER) system is a basic necessity and an emerging research area of digital audio signal processing. However, SER plays an important role with many applications that are related to human–computer interactions (HCI). The existing state-of-the-art SER system has a quite low prediction performance, which needs improvement in order to make it feasible for the real-time commercial applications. The key reason for the low accuracy and the poor prediction rate is the scarceness of the data and a model configuration, which is the most challenging task to build a robust machine learning technique. In this paper, we addressed the limitations of the existing SER systems and proposed a unique artificial intelligence (AI) based system structure for the SER that utilizes the hierarchical blocks of the convolutional long short-term memory (ConvLSTM) with sequence learning. We designed four blocks of ConvLSTM, which is called the local features learning block (LFLB), in order to extract the local emotional features in a hierarchical correlation. The ConvLSTM layers are adopted for input-to-state and state-to-state transition in order to extract the spatial cues by utilizing the convolution operations. We placed four LFLBs in order to extract the spatiotemporal cues in the hierarchical correlational form speech signals using the residual learning strategy. Furthermore, we utilized a novel sequence learning strategy in order to extract the global information and adaptively adjust the relevant global feature weights according to the correlation of the input features. Finally, we used the center loss function with the softmax loss in order to produce the probability of the classes. The center loss increases the final classification results and ensures an accurate prediction as well as shows a conspicuous role in the whole proposed SER scheme. We tested the proposed system over two standard, interactive emotional dyadic motion capture (IEMOCAP) and ryerson audio visual database of emotional speech and song (RAVDESS) speech corpora, and obtained a 75% and an 80% recognition rate, respectively.

Using Deep Learning to Predict Fracture Patterns in Crystalline Solids

Summary Fracture is a catastrophic process whose understanding is critical for evaluating the integrity and sustainability of engineering materials. Here, we present a machine-learning approach to predict fracture processes connecting molecular simulation into a physics-based data-driven multiscale model. Based on atomistic modeling and a novel image-processing approach, we compile a comprehensive training dataset featuring fracture patterns and toughness values for different crystal orientations. Assessments of the predictive power of the machine-learning model shows excellent agreement not only regarding the computed fracture patterns but also the fracture toughness values and is examined for both mode I and mode II loading conditions. We further examine the ability of predicting fracture patterns in bicrystalline materials and material with gradients of microstructural crystal orientation. These results further underscore the excellent predictive power of our model. Potential applications of this model could be widely applied in material design.

Optical Flow Prediction for Blind and Non-Blind Video Error Concealment Using Deep Neural Networks

A novel optical flow prediction model using an adaptable deep neural network architecture for blind and non-blind error concealment of videos degraded by transmission loss is presented. The two-stream network model is trained by separating the horizontal and vertical motion fields which are passed through two similar parallel pipelines that include traditional convolutional (Conv) and convolutional long short-term memory (ConvLSTM) layers. The ConvLSTM layers extract temporally correlated motion information while the Conv layers correlate motion spatially. The optical flows used as input to the two-pipeline prediction network are obtained through a flow generation network that can be easily interchanged, increasing the adaptability of the overall end-to-end architecture. The performance of the proposed model is evaluated using real-world packet loss scenarios. Standard video quality metrics are used to compare frames reconstructed using predicted optical flows with those reconstructed using “ground-truth” flows obtained directly from the generator.