Long Short-term Memory Neural Network Research Articles

Disruption detection for a cognitive digital supply chain twin using hybrid deep learning

Recent disruptive events, such as COVID-19 and Russia–Ukraine conflict, had a significant impact of global supply chains. Digital supply chain twins have been proposed in order to provide decision makers with an effective and efficient tool to mitigate disruption impact. This paper introduces a hybrid deep learning approach for disruption detection within a cognitive digital supply chain twin framework to enhance supply chain resilience. The proposed disruption detection module utilises a deep autoencoder neural network combined with a one-class support vector machine algorithm. In addition, long-short term memory neural network models are developed to identify the disrupted echelon and predict time-to-recovery from the disruption effect. The obtained information from the proposed approach will help decision-makers and supply chain practitioners make appropriate decisions aiming at minimizing negative impact of disruptive events based on real-time disruption detection data. The results demonstrate the trade-off between disruption detection model sensitivity, encountered delay in disruption detection, and false alarms. This approach has seldom been used in recent literature addressing this issue.

Convolutional LSTM–LSTM model for predicting the daily number of influenza patients in South Korea using satellite images

ObjectivesInfluenza affects a considerable proportion of the global population each year, and meteorological conditions may have a significant impact on its transmission. In this study, we aimed to develop a prediction model for the number of influenza patients at the national level using satellite images and provide a basis for predicting influenza through satellite image data. Study designWe developed an influenza incidence prediction model using satellite images and influenza patient data. MethodsWe collected satellite images and daily influenza patient data from July 2014 to June 2019 and developed a convolutional long short-term memory (LSTM)–LSTM neural network model. The model with the lowest average of mean absolute error (MAE) was selected. ResultsThe final model showed a high correlation between the predicted and actual number of influenza patients, with an average MAE of 5.9010 per million population. The model performed best with a 2-week time sequence. ConclusionsWe developed a national-level prediction model using satellite images to predict influenza incidence. The model offers the advantage of nationwide analysis. These results may reduce the burden of influenza by enabling timely public health interventions.

Structural monitoring data repair based on a long short-term memory neural network.

As construction technology and project management develop, structural monitoring systems become increasingly important for ensuring large-span spatial structure safety during construction and operation. However, most of the sensors and monitoring equipment in monitoring systems are poorly serviced, resulting in frequent abnormal monitoring data, which directly leads to challenges in data analysis and structural safety assessment. In this paper, a structural response recovery method based on a long short-term memory (LSTM) neural network is proposed by studying the autocorrelation of data and the spatial correlations among data at multiple measurement points. The effectiveness and robustness of the proposed method are verified using the monitored stress data for a grid structure jacking construction process, and the influence of different data loss rates on the recovery accuracy is analysed. The recovery models are compared using a support vector machine and a Multi-Layer Perception (MLP) neural network. The proposed method can effectively restore missing data; notably, the MSE index is 0.6, and the MAPE is below 15%. The data restoration method based on the LSTM neural network is more accurate than the traditional method. Finally, the repair applicability of various types of monitored data is verified using the monitoring data from Hall F of Qingdao Jiao-dong International Airport under typhoon conditions.

Construction of Risk Prediction Model of Type 2 Diabetic Kidney Disease Based on Deep Learning.

This study aimed to develop a diabetic kidney disease (DKD) prediction model using long short term memory (LSTM) neural network and evaluate its performance using accuracy, precision, recall, and area under the curve (AUC) of the receiver operating characteristic (ROC) curve. The study identified DKD risk factors through literature review and physician focus group, and collected 7 years of data from 6,040 type 2 diabetes mellitus patients based on the risk factors. Pytorch was used to build the LSTM neural network, with 70% of the data used for training and the other 30% for testing. Three models were established to examine the impact of glycosylated hemoglobin (HbA1c), systolic blood pressure (SBP), and pulse pressure (PP) variabilities on the model's performance. The developed model achieved an accuracy of 83% and an AUC of 0.83. When the risk factor of HbA1c variability, SBP variability, or PP variability was removed one by one, the accuracy of each model was significantly lower than that of the optimal model, with an accuracy of 78% (P<0.001), 79% (P<0.001), and 81% (P<0.001), respectively. The AUC of ROC was also significantly lower for each model, with values of 0.72 (P<0.001), 0.75 (P<0.001), and 0.77 (P<0.05). The developed DKD risk predictive model using LSTM neural networks demonstrated high accuracy and AUC value. When HbA1c, SBP, and PP variabilities were added to the model as featured characteristics, the model's performance was greatly improved.

A survey on cryptocurrency price prediction

A type of digital currency known as a cryptocurrency allows all transactions to be completed online. There is no hard cash version of this soft currency. We highlight that a decentralized currency differs from a centralized currency in the any user of a virtual currency can purchase services without the need for third parties to get involved. Due to its extreme price volatility, using these cryptocurrencies has an impact on trade and international relations. Moreover, the constantly fluctuating oscillations indicate the urgent need for a more precise method of predicting this price. Deep learning techniques that use effective learning models for training data, including the LSTM, GRU, and Feedback Neural Network, can be used to do this. Benchmark datasets are used to test the suggested strategy. That brings us to the neural network, one of the clever data mining technologies that researchers in many domains have been using for the past ten years. In the current economy, stock market data is essential. There are two types of forecasting methodologies: nonlinear models (ARCH, GARCH, Neural Network) and linear models (AR, MA, ARIMA, ARMA). To forecast a company's stock price based on past prices, we employed the Box Jenkins Model also known as ARIMA, and Long Short-Term Memory (LSTM), and Feedback Neural Network also known as RNN.

Daily Streamflow Forecasting Using Networks of Real-Time Monitoring Stations and Hybrid Machine Learning Methods

Considering the increased risk of urban flooding and drought due to global climate change and rapid urbanization, the imperative for more accurate methods for streamflow forecasting has intensified. This study introduces a pioneering approach leveraging the available network of real-time monitoring stations and advanced machine learning algorithms that can accurately simulate spatial–temporal problems. The Spatio-Temporal Attention Gated Recurrent Unit (STA-GRU) model is renowned for its computational efficacy in forecasting streamflow events with a forecast horizon of 7 days. The novel integration of the groundwater level, precipitation, and river discharge as predictive variables offers a holistic view of the hydrological cycle, enhancing the model’s accuracy. Our findings reveal that for a 7-day forecasting period, the STA-GRU model demonstrates superior performance, with a notable improvement in mean absolute percentage error (MAPE) values and R-square (R2) alongside reductions in the root mean squared error (RMSE) and mean absolute error (MAE) metrics, underscoring the model’s generalizability and reliability. Comparative analysis with seven conventional deep learning models, including the Long Short-Term Memory (LSTM), the Convolutional Neural Network LSTM (CNNLSTM), the Convolutional LSTM (ConvLSTM), the Spatio-Temporal Attention LSTM (STA-LSTM), the Gated Recurrent Unit (GRU), the Convolutional Neural Network GRU (CNNGRU), and the STA-GRU, confirms the superior predictive power of the STA-LSTM and STA-GRU models when faced with long-term prediction. This research marks a significant shift towards an integrated network of real-time monitoring stations with advanced deep-learning algorithms for streamflow forecasting, emphasizing the importance of spatially and temporally encompassing streamflow variability within an urban watershed’s stream network.

Arctic short-term wind speed forecasting based on CNN-LSTM model with CEEMDAN

Accurate wind speed forecasting is of great significance for the utilization of Arctic wind energy resources. The traditional single model is difficult to fully depict the nonlinearity of wind speed and its wide range of variations. In this paper, a hybrid model is proposed for multi-step wind speed forecasting, which combined complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN), convolutional neural network (CNN) and long-short term memory neural network (LSTM). The wind speed series is firstly decomposed into several intrinsic mode functions (IMF) by CEEMDAN to provide more stable data. Secondly, four-step-ahead forecasts are realized using well-tuned CNN-LSTM model for each IMF. Finally, the forecasted wind speed is obtained by reconstruction. The effectiveness and feasibility of the proposed method is validated based on thorough evaluation and step-by-step analysis. The RMSE of the proposed model is 0.4046 m/s, which are reduced by 58 % compared with 7 benchmark models. Furthermore, the average prediction interval of the proposed model is also reduced by 20 %, 16 % and 7 % compared to CEEMDAN-FCNN, CEEMDAN-CNN and CEEMDAN-LSTM respectively. The results prove that all three parts of the proposed model contribute to a better performance in wind speed forecasting.

Fusing LSTM neural network and expanded disturbance Kalman filter for estimating external disturbing forces of ball screw drives

Monitoring external disturbing forces is of great significance for improving the control performance and interaction safety of ball screw drives. In consideration of the low cost in long-term use and the non-invasiveness to work space, estimating external disturbing forces using motor torque and motion states has been viewed as the solution that has great potential to be applied in real industry. However, the existing methods cannot efficiently establish accurate estimation models in a low-cost and general manner (i.e., not depend on specific work scenarios). To overcome this challenge, a novel hybrid-driven method that fuses Long Short-Term Memory (LSTM) Neural Network (NN) and Expanded Disturbance Kalman Filter (EDKF) is proposed. The motion state of the worktable is decoupled as the linear superposition of the outputs of two independent dynamic models, i.e., Ideal Dynamic Model (IDM) and Disturbance Dynamic Model (DDM). IDM predicts the motion state that is only driven by the motor torque, is modeled as an LSTM NN and trained by self-excitation experiments. DDM is equivalent to the disturbance transfer function and easily identified by impact tests. The motion state only driven by external disturbing forces is calculated by the predicted result of IDM and the monitored actual motion state, and then external disturbing forces are estimated by a DDM-based EDKF. The verifications in simulation and real environments both show that by the proposed method, accurate estimation models of external disturbing forces can be efficiently established through self-excitation experiments and impact tests.

Cross-Project Defect Prediction Based on Domain Adaptation and LSTM Optimization

Cross-project defect prediction (CPDP) aims to predict software defects in a target project domain by leveraging information from different source project domains, allowing testers to identify defective modules quickly. However, CPDP models often underperform due to different data distributions between source and target domains, class imbalances, and the presence of noisy and irrelevant instances in both source and target projects. Additionally, standard features often fail to capture sufficient semantic and contextual information from the source project, leading to poor prediction performance in the target project. To address these challenges, this research proposes Smote Correlation and Attention Gated recurrent unit based Long Short-Term Memory optimization (SCAG-LSTM), which first employs a novel hybrid technique that extends the synthetic minority over-sampling technique (SMOTE) with edited nearest neighbors (ENN) to rebalance class distributions and mitigate the issues caused by noisy and irrelevant instances in both source and target domains. Furthermore, correlation-based feature selection (CFS) with best-first search (BFS) is utilized to identify and select the most important features, aiming to reduce the differences in data distribution among projects. Additionally, SCAG-LSTM integrates bidirectional gated recurrent unit (Bi-GRU) and bidirectional long short-term memory (Bi-LSTM) networks to enhance the effectiveness of the long short-term memory (LSTM) model. These components efficiently capture semantic and contextual information as well as dependencies within the data, leading to more accurate predictions. Moreover, an attention mechanism is incorporated into the model to focus on key features, further improving prediction performance. Experiments are conducted on apache_lucene, equinox, eclipse_jdt_core, eclipse_pde_ui, and mylyn (AEEEM) and predictor models in software engineering (PROMISE) datasets and compared with active learning-based method (ALTRA), multi-source-based cross-project defect prediction method (MSCPDP), the two-phase feature importance amplification method (TFIA) on AEEEM and the two-phase transfer learning method (TPTL), domain adaptive kernel twin support vector machines method (DA-KTSVMO), and generative adversarial long-short term memory neural networks method (GB-CPDP) on PROMISE datasets. The results demonstrate that the proposed SCAG-LSTM model enhances the baseline models by 33.03%, 29.15% and 1.48% in terms of F1-measure and by 16.32%, 34.41% and 3.59% in terms of Area Under the Curve (AUC) on the AEEEM dataset, while on the PROMISE dataset it enhances the baseline models’ F1-measure by 42.60%, 32.00% and 25.10% and AUC by 34.90%, 27.80% and 12.96%. These findings suggest that the proposed model exhibits strong predictive performance.

Analysis and Prediction of Urban Surface Transformation Based on Small Baseline Subset Interferometric Synthetic Aperture Radar and Sparrow Search Algorithm-Convolutional Neural Network-Long Short-Term Memory Model.

With the acceleration of urbanisation, urban areas are subject to the combined effects of the accumulation of various natural factors, such as changes in temperature leading to the thermal expansion or contraction of surface materials (rock, soil, etc.) and changes in precipitation and humidity leading to an increase in the self-weight of soil due to the infiltration of water along the cracks or pores in the ground. Therefore, the subsidence of urban areas has now become a serious geological disaster phenomenon. However, the use of traditional neural network prediction models has limitations when examining the causal relationships between time series surface deformation data and multiple influencing factors and when applying multiple influencing factors for predictive analyses. To this end, Sentinel-1A data from March 2017 to February 2023 were used as the data source in this paper, based on time series deformation data acquired using the small baseline subset interferometric synthetic aperture radar (SBAS-InSAR) technique. A sparrow search algorithm-convolutional neural network-long short-term memory (SSA-CNN-LSTM) neural network prediction model was built. The six factors of temperature, humidity, precipitation, and ground temperature at three different depths below the surface (5 cm, 10 cm, and 15 cm) were taken as the input of the model, and the surface deformation data were taken as the output of the neural network model. The correlation between the spatial and temporal evolution characteristics of the ground subsidence in urban areas and various influencing factors was analysed using grey correlation analysis, which proved that these six factors contribute to some extent to the deformation of the urban surface. The main urban area of Hohhot City, Inner Mongolia Autonomous Region, was used as the study area. In order to verify the efficacy of this neural network prediction model, the prediction effects of the multilayer perceptron (MLP), backpropagation (BP), and SSA-CNN-LSTM models were compared and analysed, with the values of the correlation coefficients of the feature points of A1, B1, and C1 being in the range of 0.92, 0.83, and 0.93, respectively. The results show that compared with the traditional MLP and BP neural network models, the SSA-CNN-LSTM model achieves a higher performance in predicting time series surface deformation data in urban areas, which provides new ideas and methods for this area of research.

Leveraging a 7-Layer Long Short-Term Memory Model for Early Detection and Prevention of Diabetes in Oman: An Innovative Approach.

This study develops a 7-layer Long Short-Term Memory (LSTM) model to enhance early diabetes detection in Oman, aligning with the theme of 'Artificial Intelligence in Healthcare'. The model focuses on addressing the increasing prevalence of Type 2 diabetes, projected to impact 23.8% of Oman's population by 2050. It employs LSTM neural networks to manage factors contributing to this rise, including obesity and genetic predispositions, and aims to bridge the gap in public health awareness and prevention. The model's performance is evaluated through various metrics. It achieves an accuracy of 99.40%, specificity and sensitivity of 100% for positive cases, a recall of 99.34% for negative cases, an F1 score of 96.24%, and an AUC score of 94.51%. These metrics indicate the model's capability in diabetes detection. The implementation of this LSTM model in Oman's healthcare system is proposed to enhance early detection and prevention of diabetes. This approach reflects an application of AI in addressing a significant health concern, with potential implications for similar healthcare challenges relating to globally diagnostic capabilities, representing a significant leap forward in healthcare technology in Oman.

A predictive energy management strategy for plug-in hybrid electric vehicles using real-time traffic based reference SOC planning

The fuel economy of plug-in hybrid electric vehicles (PHEVs) is strongly affected by the battery state of charge (SOC) depletion pattern. This paper proposes and studies a real-time traffic-based SOC reference planning method. The method uses a dataset to collect and capture real traffic information and then enriches the dataset using a data augmentation method developed in this paper. The augmented dataset is optimized by dynamic programing (DP) algorithm to obtain the optimal reference SOC for model training. The traffic information and optimal reference SOC are processed and used to train a long-short term memory (LSTM) neural network, which is used for online reference SOC planning. Finally, a predictive energy management (PEM) strategy is adopted to follow the SOC reference by optimizing instantaneous power allocation with the predicted velocities. Simulation results show that the proposed method outperforms the linear reference SOC planning method in both smooth and congested traffic scenarios.

A novel prediction model for ship fuel consumption considering shipping data privacy: An XGBoost-IGWO-LSTM-based personalized federated learning approach

Due to the protection of shipping data privacy, shipping companies rarely share shipping raw data. Therefore, how to protect shipping data privacy is a crucial issue when predicting ship fuel consumption (SFC). To tackle such issues and guarantee prediction accuracy, a tailored personalized federated learning (PFL) approach is designed and proposed in this study. In the proposed PFL approach, an improved long short-term memory (LSTM) neural network is adopted as the Deep Learning (DL) model for each ship client, in which the improved Grey Wolf Optimization (IGWO) algorithm is juxtaposed to optimize the hyperparameter tuning process in LSTM neural network. In addition, considering that different ships have unique navigation environments and distinct ship characteristics, XGBoost is introduced to make feature selections before LSTM training. Given the personalized features of different ships after XGBoost selection, an FL with personalized layers (Fedper) is employed, where the personalized layers are trained on the client side respectively and the basic layers are uploaded to the central server. To validate the efficiency of the proposed approach, we collect datasets and conduct experiments on 18 bulk carriers. To further prove the superiority of XGBoost-IGWO-LSTM-based PFL, four kinds of comparative experiments are conducted. The results show that our proposed approach can make more accurate SFC prediction results while guaranteeing shipping data privacy. The research could provide meaningful suggestions for shipping companies that prioritize corporate data privacy to reduce SFC.

Reinforcement Learning for Dual-Control Aircraft Six-Degree-of-Freedom Attitude Control with System Uncertainty

This article proposes a near-optimal control strategy based on reinforcement learning, which is applied to the six-degree-of-freedom (6-DoF) attitude control of dual-control aircraft. In order to solve the problem that the existing reinforcement learning is difficult to apply to the high-dimensional multiple-input multiple-output (MIMO) systems, the Long Short-Term Memory (LSTM) neural network is introduced to replace the polynomial network in the adaptive dynamic programming (ADP) technique. Meanwhile, based on the Lyapunov method, a novel online adaptive updating law of LSTM neural network weights is given, and the stability of the system is verified. In the simulation process, the algorithm proposed in this article is applied to the six-degree-of-freedom attitude control problem of dual-control aircraft with system uncertainty. The simulation results show that the algorithm can achieve near-optimal control.

Regular paper Comparative Analysis of Deep Learning Models for Sentiment Analysis on IMDB Reviews

Within the domain of natural language processing, sentiment analysis assumes a fundamental position, facilitating the comprehension of societal perspectives and opinions, thereby playing a pivotal role in understanding public sentiment. In this study, an examination and comparison of deep learning architectures was conducted on IMDB movie reviews. We evaluated the performance of Basic Recurrent Neural Networks, Long Short-Term Memory (LSTM), Gated Recurrent Neural Unit (GRU), Bidirectional LSTM, Bidirectional GRU and 1D Convolutional Neural Networks (Conv1D) based on their training, validation, and testing accuracies. Our results indicate that while LSTM achieved the highest accuracy of 99.91% on the training data, GRU demonstrated superior performance (88.28%) on the validation dataset. Interestingly, Bidirectional GRU emerged as the top-performing model (87.54%) on the testing data, showcasing its robustness in generalizing to unseen instances. These findings highlight the importance of evaluating model performance across multiple datasets to assess their real-world effectiveness. Furthermore, our comparative analysis provides valuable understanding of the advantages and limitations of each model, offering practical guidance for selecting the optimal framework for sentiment analysis endeavors. Overall, this research contributes to the progress of such methodologies and deep learning approaches in natural language processing.

Environmentally Robust Triboelectric Tire Monitoring System for Self-Powered Driving Information Recognition via Hybrid Deep Learning in Time-Frequency Representation.

Developing a robust artificial intelligence of things (AIoT) system with a self-powered triboelectric sensor for harsh environment is challenging because environmental fluctuations are reflected in triboelectric signals. This study presents an environmentally robust triboelectric tire monitoring system with deep learning to capture driving information in the triboelectric signals generated from tire-road friction. The optimization of the process and structure of a laser-induced graphene (LIG) electrode layer in the triboelectric tire is conducted, enabling the tire to detect universal driving information for vehicles/robotic mobility, including rotation speeds of 200-2000 rpm and contact fractions of line. Employing a hybrid model combining short-term Fourier transform with a convolution neural network-long short-term memory, the LIG-based triboelectric tire monitoring (LTTM) system decouples the driving information, such as traffic lines and road states, from varied environmental conditions of humidity (10%-90%) and temperatures (50-70°C). The real-time line and road state recognition of the LTTM system is confirmed on a mobile platform across diverse environmental conditions, including fog, dampness, intense sunlight, and heat shimmer. This work provides an environmentally robust monitoring AIoT system by introducing a self-powered triboelectric sensor and hybrid deep learning for smart mobility.

The Use of AI to Analyze Social Media Attacks for Predictive Analytics

Social engineering, on the other hand, presents weaknesses that are difficult to directly quantify in penetration testing. The majority of expert social engineers utilize phishing and adware tactics to convince victims to provide information voluntarily. Social Engineering (SE) in social media has a similar structural layout to regular postings but has a malevolent intrinsic purpose. Recurrent Neural Network-Long Short-Term Memory (RNN-LSTM) was used to train a novel SE model to recognize covert SE threats in communications on social networks. The dataset includes a variety of posts, including text, images, and videos. It was compiled over a period of several months and was carefully curated to ensure that it is representative of the types of content that is typically posted on social media. First, by using domain heuristics, the social engineering assaults detection (SEAD) pipeline is intended to weed out social posts with malevolent intent. After tokenizing each social media post into sentences, each post is examined using a sentiment analyzer to determine whether it is a training data normal or an abnormality. Subsequently, an RNN-LSTM model is trained to detect five categories of social engineering assaults, some of which may involve information-gathering signals. Comparing the experimental findings to the ground truth labeled by network experts, the SEA model achieved 0.82 classification precision and 0.79 recall.

REALIZATION OF THE DECISION-MAKING SUPPORT SYSTEM FOR TWITTER USERS’ PUBLICATIONS ANALYSIS

Context. The paper emphasizes the need for a decision-making system that can analyze users’ messages and determine the sentiment to understand how news and events impact people’s emotions. Such a system would employ advanced techniques to analyze users’ messages, delving into the sentiment expressed within the text. The primary goal is to gain insights into how news and various events reverberate through people’s emotions.&#x0D; Objective. The objective is to create a decision-making system that can analyze and determine the sentiment of user messages, understand the emotional response to news and events, and distribute the data into clusters to gain a broader understanding of users’ opinions. This multifaceted objective involves the integration of advanced techniques in natural language processing and machine learning to build a robust decision-making system. The primary goals are sentiment analysis, comprehension of emotional responses to news and events, and data clustering for a holistic view of user opinions.&#x0D; Method. The use of long-short-term memory neural networks for sentiment analysis and the k-means algorithm for data clustering is proposed for processing large volumes of user data. This strategic combination aims to tackle the challenges posed by processing large volumes of user-generated data in a more nuanced and insightful manner.&#x0D; Results. The study and conceptual design of the decision-making system have been completed and the decision-making system was created. The system incorporates sentiment analysis and data clustering to understand users’ opinions and the sentiment value of such opinions dividing them into clusters and visualizing the findings.&#x0D; Conclusions. The conclusion is that the development of a decision-making system capable of analyzing user sentiment and clustering data can provide valuable insights into users’ reactions to news and events in social networks. The proposed use of longshort-term memory neural networks and the k-means algorithm is considered suitable for sentiment analysis and data clustering tasks. The importance of studying existing works and systems to understand available algorithms and their applications is emphasized. The article also describes created and implemented a decision-making system and demonstrated the functionality of the system using a sample dataset.

Daily Scale Air Quality Index Forecasting using Bidirectional Recurrent Neural Networks: Case Study of Delhi, India

This research was established to accurately forecast daily scale air quality index (AQI) which is an essential environmental index for decision-making. Researchers have projected different types of models and methodologies for AQI forecasting, such as statistical techniques, machine learning (ML), and most recently deep learning (DL) models. The modelling development was adopted for Delhi city, India which is a major city with air pollution issues simialir to entire urban cities of India especially during winter seasons. This research was predicted AQI using different versions of DL models including Long-Short Term Memory (LSTM), Bidirectional LSTM (Bi-LSTM) and Bidirectional Recurrent Neural Networks (Bi-RNN) in addition to Kernel Ridge Regression (KRR). Results indicated that Bi-RNN model consistently outperformed the other models in both training and testing phases, while the KRR model consistently displayed the weakest performance. The outstanding performance of the models development displayed the requirement of adequate data to train the models. The outcomes of the models showed that LSTM, BI-LSTM, KRR had lower performance compared with Bi-RNN models. Statistically, Bi-RNN model attained maximum determination coefficient (R2 = 0.954) and minimum root mean square error (RMSE = 25.755). The proposed model in this research revealed the robust predictable to provide a valuable base for decision-making in the expansion of combined air pollution anticipation and control policies targeted at addressing composite air pollution problems in the Delhi city.

CNN-LSTM based incremental attention mechanism enabled phase-space reconstruction for chaotic time series prediction

To improve the prediction accuracy of chaotic time series and reconstruct a more reasonable phase space structure of the prediction network, we propose a convoluted neural network-long short-term memory (CNN-LSTM) prediction model based on the incremental attention mechanism. Firstly, a traversal search is conducted through the traversal layer for finite parameters in the phase space. Then, an incremental attention layer is utilized for parameter judgment based on the dimension weight criteria (DWC). The phase space parameters that best meet DWC are selected and fed into the input layer. Finally, the constructed CNN-LSTM network extracts spatiotemporal features and provides the final prediction results. The model is verified using Logistic, Lorenz, and sunspot chaotic time series, and the performance is compared from the two dimensions of prediction accuracy and network phase space structure. Additionally, the CNN-LSTM network based on incremental attention is compared with LSTM, CNN, recurrent neural network (RNN), and support vector regression (SVR) for prediction accuracy. The experiment results indicate that the proposed composite network model possesses enhanced capability in extracting temporal features and achieves higher prediction accuracy. Also, the algorithm to estimate the phase space parameter is compared with the traditional CAO, false nearest neighbor, and C-C, three typical methods for determining the chaotic phase space parameters. The experiments reveal that the phase space parameter estimation algorithm based on the incremental attention mechanism is superior in prediction accuracy compared with the traditional phase space reconstruction method in five networks, CNN-LSTM, LSTM, CNN, RNN, and SVR.