Hybrid Long Short-term Memory Research Articles

Prediction of Losses Due to Dust in PV Using Hybrid LSTM-KNN Algorithm: The Case of Saruhanlı

Sustainable and renewable energy sources are of great importance in today’s world. In this respect, renewable energy sources are used in many fields of technology. In order to minimize dust on PV panels and ensure their sustainability, power losses due to dust must be estimated accurately. In this way, the efficiency of a sustainable energy source will increase and serious economic savings can be achieved. In this study, a hybrid deep learning model was designed to predict losses caused by dust in PV panels installed in the Manisa Saruhanlı district. The hybrid deep learning model consists of Long Short-Term Memory (LSTM) and K-Nearest-Neighbors (KNN) algorithms. The performance of the proposed hybrid deep learning model was compared with LSTM and KNN algorithms. Sensitivity analysis was performed to statistically evaluate the prediction results. The input variables of the models were time, sunshine duration, humidity, ambient temperature and solar radiation. The output variable was the losses caused by dust in the PV panels. Hybrid LSTM-KNN, LSTM and KNN models predicted losses caused by dust in PV panels with 98.22%, 95.51% and 61.49% accuracy. The hybrid LSTM-KNN model predicted losses caused by dust in PV panels with higher accuracy than other models. Using LSTM and KNN algorithms together improved the performance of the hybrid deep learning model. With sensitivity analysis, it was found that solar radiation is the most important variable affecting the losses caused by dust in PV panels.

Forecasting Model of Sustainable Financial Market Trend Based on Neural Network Algorithm

Recent advances in computer technology have resulted in the ongoing gathering of massive amounts of data and information. Because the financial market creates so much real-time data, including transaction records, we have a great potential to get important insights from analysing that data, especially in the banking industry. As a result, the goal of this work is to use the financial data that is now accessible to create a unique stock market prediction model. We employ the deep learning approach because of its exceptional capacity to learn from large datasets. This study proposes a hybrid approach that integrates the Archimedes optimisation algorithm (AOA) with a long short-term memory (LSTM) network. So far, heuristic-based trial and error has been extensively used to estimate the temporal window size and architectural components of long short-term memory networks. This paper investigates the temporal properties of financial market data by providing a systematic way to selecting the topology and time window size for the LSTM network. The experimental results demonstrate that the hybrid LSTM network and AOA model outperform the benchmark model.

A Hybrid Perspective on Threat Analysis and Activity-Based Attack Modeling for Strengthening Access Control in IoT

The rapid expansion of Internet of Things (IoT) devices has resulted in an unparalleled surge in the production of data and interconnectivity. Nevertheless, as IoT ecosystems become increasingly intricate, security concerns become of utmost importance, particularly in access control systems. The objective of this research is to improve the security of IoT access control by utilizing a hybrid model for analyzing threats and modeling attacks based on activities. This study has two primary objectives: a) A hybrid classification model is used to predict labels (attack or not) in binary classification with an impressive accuracy of 98.18%. b) Another hybrid classification model is employed to predict types of attacks in M2M communication, achieving a commendable accuracy of 90%. The primary goal is to create and assess a hybrid classification model for binary classification. This model will differentiate between regular system behavior and malicious attacks on access control schemes in the Internet of Things (IoT). The hybrid model, which combines the strengths of Gated Recurrent Units (GRU) and Long Short-Term Memory (LSTM) networks, achieves an exceptional accuracy rate of 98.18%. The model's high accuracy demonstrates its effectiveness in precisely detecting potential threats and minimizing false positives, thereby establishing a strong basis for improving access control security. The second objective focuses on the complex area of security, with the goal of categorizing distinct forms of attacks in Machine-to-Machine (M2M) communication within the Internet of Things (IoT) framework. The hybrid classification model, employing both GRU and LSTM networks, achieves a remarkable accuracy of 90%. This accomplishment showcases the model's aptitude in detecting and distinguishing different types of attacks, including Distributed Denial of Service (DDoS) and Man-in-the-Middle attacks. The hybrid model provides security professionals with valuable insights to proactively respond to diverse threats in M2M communication by accurately classifying attack types. This strengthens the overall security posture of IoT access control systems. Overall, this study offers a thorough and efficient combination of threat analysis and activity-based attack modeling to enhance access control in IoT. The obtained accuracies in binary classification and prediction of attack types highlight the practical usability of the suggested hybrid model, establishing a strong basis for improving the security of IoT access control systems against evolving cyber threats

Dissolved Oxygen Forecasting for Lake Erie’s Central Basin Using Hybrid Long Short-Term Memory and Gated Recurrent Unit Networks

Dissolved oxygen (DO) concentration is a pivotal determinant of water quality in freshwater lake ecosystems. However, rapid population growth and discharge of polluted wastewater, urban stormwater runoff, and agricultural non-point source pollution runoff have triggered a significant decline in DO levels in Lake Erie and other freshwater lakes located in populated temperate regions of the globe. Over eleven million people rely on Lake Erie, which has been adversely impacted by anthropogenic stressors resulting in deficient DO concentrations near the bottom of Lake Erie’s Central Basin for extended periods. In the past, hybrid long short-term memory (LSTM) models have been successfully used for the time-series forecasting of water quality in rivers and ponds. However, the prediction errors tend to grow significantly with the forecasting period. Therefore, this research aimed to improve the accuracy of DO forecasting models by taking advantage of Lake Erie’s real-time water quality (water temperature and DO concentration) monitoring network to establish temporal and spatial links between adjacent monitoring stations. We developed hybrid LSTM models that combine LSTM, convolutional neuron network LSTM (CNN-LSTM), hybrid CNN with gated recurrent unit (CNN-GRU) models, and convolutional LSTM (ConvLSTM) to forecast near-bottom DO concentrations in Lake Erie’s Central Basin. These hybrid LSTM models improve their capacity to handle complicated datasets with spatial and temporal variability. These models can serve as accurate and reliable tools for forecasting DO concentrations in freshwater lakes to help environmental protection agencies better access and manage the health of these vital ecosystems. Following analysis of a 21-site Lake Erie dataset for 2020 and 2021, the ConvLSTM model emerged as the most accurate and reliable, boasting an MSE of 0.51 mg/L, MAE of 0.42 mg/L, and an R-squared of 0.95 over the 12 h prediction range. The model foresees future hypoxia in Lake Erie. Notably, the temperature near site 713 holds significance for Central Basin DO forecasting in Lake Erie, as indicated by outcomes derived from the Shapley additive explanations (SHAP).

Deep hybrid modeling of a HEK293 process: Combining long short-term memory networks with first principles equations.

The combination of physical equations with deep learning is becoming a promising methodology for bioprocess digitalization. In this paper, we investigate for the first time the combination of long short-term memory (LSTM) networks with first principles equations in a hybrid workflow to describe human embryonic kidney 293 (HEK293) culture dynamics. Experimental data of 27 extracellular state variables in 20 fed-batch HEK293 cultures were collected in a parallel high throughput 250 mL cultivation system in an industrial process development setting. The adaptive moment estimation method with stochastic regularization and cross-validation were employed for deep learning. A total of 784 hybrid models with varying deep neural network architectures, depths, layers sizes and node activation functions were compared. In most scenarios, hybrid LSTM models outperformed classical hybrid Feedforward Neural Network (FFNN) models in terms of training and testing error. Hybrid LSTM models revealed to be less sensitive to data resampling than FFNN hybrid models. As disadvantages, Hybrid LSTM models are in general more complex (higher number of parameters) and have a higher computation cost than FFNN hybrid models. The hybrid model with the highest prediction accuracy consisted in a LSTM network with seven internal states connected in series with dynamic material balance equations. This hybrid model correctly predicted the dynamics of the 27 state variables (R2 = 0.93 in the test data set), including biomass, key substrates, amino acids and metabolic by-products for around 10 cultivation days.

A hybrid deep learning technique for spoofing website URL detection in real-time applications

Website Uniform Resource Locator (URL) spoofing remains one of the ways of perpetrating phishing attacks in the twenty-first century. Hackers continue to employ URL spoofing to deceive naïve and unsuspecting consumers into releasing important personal details in malicious websites. Blacklists and rule-based filters that were once effective at reducing the risks and sophistication of phishing are no longer effective as there are over 1.5 million new phishing websites created monthly. Therefore, research aimed at unveiling new techniques for detecting phishing websites has sparked a lot of interest in both academics and business with machine and deep learning techniques being at the forefront. Among the deep learning techniques that have been employed, Convolutional Neural Network (CNN) remains one of the most widely used with high performance in feature learning. However, CNN has a problem of memorizing contextual relationships in URL text, which makes it challenging to efficiently detect sophisticated malicious URLs in real-time applications. On the contrary, Long Short-Term Memory (LSTM) deep learning model has been successfully employed in complex real-time problems because of its ability to store inputs for a long period of time. This study experiments with the use of hybrid CNN and LSTM deep learning models for spoofing website URL detection in order to exploit the combined strengths of the two approaches for a more sophisticated spoofing URL detection. Two publicly available datasets (UCL spoofing Website and PhishTank Datasets) were used to evaluate the performance of the proposed hybrid model against other models in the literature. The hybrid CNN-LSTM model achieved accuracies of 98.9% and 96.8%, respectively, when evaluated using the UCL and PhishTank datasets. On the other hand, the standalone CNN and LSTM achieved accuracies of 90.4% and 94.6% on the UCL dataset, while their accuracies on the PhishTank dataset were 89.3% and 92.6%, respectively. The results show that the hybrid CNN-LSTM algorithm largely outperformed the standalone CNN and LSTM models, which demonstrates a much better performance. Therefore, the hybrid deep learning technique is recommended for detecting spoofing website URL thereby reducing losses attributed to such attacks.

Comparison of Hyperparameter Optimization Techniques in Hybrid CNN-LSTM Model for Heart Disease Classification

Heart disease, which causes the highest number of deaths worldwide, recorded about 17.9 million cases in 2019, or about 32% of total global deaths, according to the World Health Organization (WHO). The significance of early detection of heart disease drives research to develop effective diagnosis systems utilizing machine learning. The advancement of machine learning in healthcare currently primarily serves as a supporting role in the ability of clinicians or analysts to fulfill their roles, identify healthcare trends, and develop disease prediction models. Meanwhile, deep learning has experienced rapid development and has become the most popular method in recent years, one of which is detecting diseases. The main objective of this research is to optimize the hybrid convolutional neural network (CNN) and long short-term memory (LSTM) model for classifying heart disease by comparing hyperparameter optimization using grid search and random search. Although random search requires less time in hyperparameter tuning, the classification performance results of grid search show higher accuracy. In the test, the hybrid CNN and LSTM model with grid search achieved 91.67% accuracy, 89.66% recall (sensitivity), 93.55% specificity, 92.86% precision, 91.23% f1-score, and 0.9310 AUC value. These results confirm that using a hybrid CNN and LSTM model with a grid search approach is better suited for classifying heart disease.

Bidirectional Hybrid LSTM Based Recurrent Neural Network for Multi-view Stereo.

Recently, deep learning based multi-view stereo (MVS) networks have demonstrated their excellent performance on various benchmarks. In this paper, we present an effective and efficient recurrent neural network (RNN) for accurate and complete dense point cloud reconstruction. Instead of regularizing the cost volume via conventional 3D CNN or unidirectional RNN like previous attempts, we adopt a bidirectional hybrid Long Short-Term Memory (LSTM) based structure for cost volume regularization. The proposed bidirectional recurrent regularization is able to perceive full-space context information comparable to 3D CNNs while saving runtime memory. For post-processing, we introduce a visibility based approach for depth map refinement to obtain more accurate dense point clouds. Extensive experiments on DTU, Tanks and Temples and ETH3D datasets demonstrate that our method outperforms previous state-of-the-art MVS methods and exhibits high memory efficiency at runtime.

Visually Estimating and Forecasting PM2.5 Levels Using Hybrid Architecture Deep Neural Network

Air pollutants, particularly particulate matter with a diameter of less than 2.5 microns (PM2.5), have been linked to a number of negative climatic and health effects, including irritation and damage to internal organs in the short and long term. Knowing current and future levels of PM2.5 is therefore crucial for both public health and environmental management. Photos of the sky and buildings can aid in assessing visibility and air quality because PM2.5 alters the appearance of the sky and its surroundings. This research proposes a method that employs digital images to not only estimate but also forecast PM2.5 concentration levels using deep learning technologies. A convolutional neural network (CNN) was used as the base layer to automatically extract image features, while a long short-term memory (LSTM) network was used as the output layer to analyze the sequence of features. The sky and its surroundings were captured hourly from a high-rise building in Bangkok, Thailand, and the ground-truth PM2.5 data were obtained from the nearest monitoring station facing the same direction. The experimental results show that the hybrid CNN and LSTM model outperformed conventional CNN models in estimating and forecasting PM2.5 levels by 5% and 30%, respectively.

LSTM-MLP BASED UNCERTAINTY MODELLING APPROACH FOR COMPLEX HUMAN INDOOR TRAJECTORY

Abstract. Modelling the movement uncertainty of human indoor trajectory consist of an essential part in promoting the performance of smart city related applications. At this stage, the existing uncertainty modelling algorithms usually take the constant sampling error or measurement error into consideration and cannot adapt well to the changeable human motion modes and complex handheld modes of smartphones. To fill this gap, this paper applied the Long Short-Term Memory (LSTM) network for continuous prediction of uncertainty error of human indoor trajectory with complex motion modes and detected indoor landmark points. The human motion information including handheld modes, walking speed, and heading information in extracted and fused with detected landmark points for reconstruction of human indoor trajectory under large-scale areas using Gradient Descent (GD) algorithm. In addition, the hybrid LSTM and Multilayer Perceptron (MLP) network is adopted for uncertainty error prediction, by considering both sampling error and measurement error in a specific time period, and the reconstructed trajectory with human motion features are modelled as the input vector for model training with the ground-truth uncertainty error as reference. Comprehensive experiments on real-world collected dataset indicate that the proposed LSTM-assisted uncertainty modelling algorithm has robust outperformance in uncertainty error prediction and uncertainty region definition compared with traditional uncertainty modelling approaches.

Development of a hybrid LSTM with chimp optimization algorithm for the pressure ventilator prediction

The utilization of mechanical ventilation is of utmost importance in the management of individuals afflicted with severe pulmonary conditions. During periods of a pandemic, it becomes imperative to build ventilators that possess the capability to autonomously adapt parameters over the course of treatment. In order to fulfil this requirement, a research investigation was undertaken with the aim of forecasting the magnitude of pressure applied on the patient by the ventilator. The aforementioned forecast was derived from a comprehensive analysis of many variables, including the ventilator's characteristics and the patient's medical state. This analysis was conducted utilizing a sophisticated computational model referred to as Long Short-Term Memory (LSTM). To enhance the predictive accuracy of the LSTM model, the researchers utilized the Chimp Optimization method (ChoA) method. The integration of LSTM and ChoA led to the development of the LSTM-ChoA model, which successfully tackled the issue of hyperparameter selection for the LSTM model. The experimental results revealed that the LSTM-ChoA model exhibited superior performance compared to alternative optimization algorithms, namely whale grey wolf optimizer (GWO), optimization algorithm (WOA), and particle swarm optimization (PSO). Additionally, the LSTM-ChoA model outperformed regression models, including K-nearest neighbor (KNN) Regressor, Random and Forest (RF) Regressor, and Support Vector Machine (SVM) Regressor, in accurately predicting ventilator pressure. The findings indicate that the suggested predictive model, LSTM-ChoA, demonstrates a reduced mean square error (MSE) value. Specifically, when comparing ChoA with GWO, the MSE fell by around 14.8%. Furthermore, when comparing ChoA with PSO and WOA, the MSE decreased by approximately 60%. Additionally, the analysis of variance (ANOVA) findings revealed that the p-value for the LSTM-ChoA model was 0.000, which is less than the predetermined significance level of 0.05. This indicates that the results of the LSTM-ChoA model are statistically significant.

Hybrid model combining LSTM with discrete wavelet transformation to predict surface methane concentration in the Arctic Island Belyy

In this paper, we propose a hybrid model that combines wavelet transformation of the raw data and an artificial neural network with long short-term memory (LSTM). This model allows researchers to increase the accuracy of time series forecasting.The model is based on data from environmental monitoring of greenhouse gases on the Belyy Island of the Yamal-Nenets Autonomous Okrug, Russia.The raw data for building the proposed model were obtained in July–August 2016. The CH4 concentration time series was decomposed using a discrete wavelet transform into four components - one approximating and three detailing. These components, along with a timed temperature series, were used to train six ANNs—two exogenous input autoregressive networks (NAR) and four LSTM networks. The forecast was calculated as the sum of forecasts for each of the components. Forecast accuracy was assessed using several indices (mean absolute error (MAE), root mean square error (RMSE), mean square relative error (RMSRE), Willmott's agreement index (IA1, IA2)) and a Taylor diagram. The hybrid model based on LSTM showed the best accuracy. The hybrid model based on LSTM showed the best accuracy. MAE, RMSE, and RMSRE errors decreased by more than 70%. In terms of IA1 and IA2, the models improved by 11% and 30% (when comparing the best hybrid models LSTM and NAR. For the hybrid LSTM model errors RMSE, RMSRE, and MAE are more than 20% less than for the base LSTM model for training in which data without wavelet transform were used. Willmott agreement indices (IA1, IA2) rose from 32% to 59%, depending on the models being compared. So, the increase in accuracy after applying the described approach was up to 79% for models based on LSTM (more precisely, from 20% to 79%, depending on the indicator). Applying wavelet transform data to train the NAR-based model reduced MAE, RMSE, and RMSRE errors by 27%, 30%, and 31%, respectively. The Willmott agreement indices (IA1, IA2) rose from 41% to 45% respectively. The Taylor diagram also shows the advantage of the proposed approach.

Flood Forecasting Using Hybrid LSTM and GRU Models with Lag Time Preprocessing

Climate change and urbanization have increased the frequency of floods worldwide, resulting in substantial casualties and property loss. Accurate flood forecasting can offer governments early warnings about impending flood disasters, giving them a chance to evacuate and save lives. Deep learning is used in flood forecasting to improve the timeliness and accuracy of flood water level predictions. While various deep learning models similar to Long Short-Term Memory (LSTM) have achieved notable results, they have complex structures with low computational efficiency, and often lack generalizability and stability. This study applies a spatiotemporal Attention Gated Recurrent Unit (STA-GRU) model for flood prediction to increase the models’ computing efficiency. Another salient feature of our methodology is the incorporation of lag time during data preprocessing before the training of the model. Notably, for 12-h forecasting, the STA-GRU model’s R-squared (R2) value increased from 0.8125 to 0.9215. Concurrently, the model manifested reduced root mean squared error (RMSE) and mean absolute error (MAE) metrics. For a more extended 24-h forecasting, the R2 value of the STA-GRU model improved from 0.6181 to 0.7283, accompanied by diminishing RMSE and MAE values. Seven typical deep learning models—the LSTM, the Convolutional Neural Networks LSTM (CNNLSTM), the Convolutional LSTM (ConvLSTM), the spatiotemporal Attention Long Short-Term Memory (STA-LSTM), the GRU, the Convolutional Neural Networks GRU (CNNGRU), and the STA-GRU—are compared for water level prediction. Comparative analysis delineated that the use of the STA-GRU model and the application of the lag time pre-processing method significantly improved the reliability and accuracy of flood forecasting.

HY-LSTM: A new time series deep learning architecture for estimation of pedestrian time to cross in advanced driver assistance system

Advanced driver assistance systems (ADASs), particularly pedestrian protection systems (PPSs), have emerged as a hot research topic with the goal of enhancing traffic safety. The development of reliable on-board pedestrian detection systems is a critical problem for PPSs. It is extremely difficult to provide the required resilience of this type of system due to the fluctuating look of pedestrians (e.g., varied attire, changing size, aspect ratio, and dynamic shape) and the unstructured surroundings. The detection of pedestrians has gained huge focus among researchers because of its huge applications in the domain of automated vehicles. In the previous decades, the majority of examinations are done to obtain better solutions for detecting pedestrians, but fewer of them concentrated on determining the pedestrian. It is one of crucial interest to study regarding transport safety as it implies minimizing the count of traffic collisions and protecting pedestrians who are more susceptible to accidents. Predicting pedestrian conduct is critical for road safety, traffic management systems, ADAS, and autonomous vehicles in general. The fundamental problem in the field of self-driving and smart automobiles is identifying impediments, particularly people, and taking action to avoid collisions with them. Various studies have been conducted in this sector by many researchers, yet there are still many mistakes in the proper identification of pedestrians. Hence, this paper devises an approach to estimate pedestrian time for crossing in an advanced driving assistance system (ADAS). The inputted videos undergo keyframe extraction wherein crucial keyframes are extracted. The deep joint segmentation is further applied for identifying the pedestrian followed by intention classification. Then, the estimation of pedestrian time to cross is predicted using Hybrid-Long short term memory (HY-LSTM), and it is a new time series model obtained by unifying LSTM and Object-based convolution neural network (OCNN), where the layer and hyperparameters of OCNN are optimally derived using Gradient Chef Based Optimization (GCBO). The proposed GCBO-HY-LSTM outperformed showing the least Mean absolute error (MAE) of 0.038, Mean square error (MSE) of 0.029, and Root Mean square error (RMSE) of 0.170.

Prediction of ultimate bearing capacity of shallow foundations on cohesionless soil using hybrid LSTM and RVM approaches: An extended investigation of multicollinearity

This research presents the optimum performance model for predicting the shallow foundation ultimate bearing capacity (UBC). Twenty-one models are employed, trained, tested, and compared to find the best architecture computational model. Thirteen performance metrics, including three new index metrics, are used to calculate and analyze the model's performance. Five kernels, linear, polynomial, gaussian, laplacian, and exponential, have been implemented in RVM (mentioned by SRVM). These RVM models have been optimized by each particle swarm optimization (PSO) and genetic (GA) algorithm. Moreover, the kernel function of the higher-performance SRVM model has been used as kernel 1 to develop dual (parallel) kernel function-based RVM (mentioned by HRVM) models. Thus, four combinations have developed four HRVM models optimized by each GA and PSO algorithm. The Adam, root mean square propagation, and stochastic gradient descent with momentum algorithms have optimized long short-term memory (LSTM) models. The analysis of performance metrics reveals that (i) the GA-optimized laplacian SRVM model UBC3 has performed better than the PSO-optimized exponential SRVM model UBC10, (ii) PSO-optimized dual kernel-based HRVM model UBC18 has attained higher performance than GA-optimized dual kernel-based HRVM model UBC14, i.e., 0.9985. Adam-optimized model UBC19 based on the LSTM approach has gained higher performance (R = 0.9999) and the least residuals (RMSE = 5.9132 kPa, MAE = 3.7037 kPa, MAPE = 2.5314 kPa, and WMAPE = 0.0118 kPa). Also, model UBC19 has outperformed models UBC3, UBC10, UBC14, and UBC18 and published models available in the literature with higher index metrics. This study reveals that the HRVM models are less affected by multicollinearity.

Adaptive Grey Wolf Optimization Technique for Stock Index Price Prediction on Recurring Neural Network Variants

In this paper, we propose a Long short-term memory (LSTM) and Adaptive Grey Wolf Optimization (GWO)--based hybrid model for predicting the stock prices of the Major Indian stock indices, i.e., Sensex. The LSTM is an advanced neural network that handles uncertain, nonlinear, and sequential data. The challenges are its weight and bias optimization. The classical backpropagation has issues of dangling on local minima or overfitting the dataset. Thus, we propose a GWO-based hybrid approach to evolve the weights and biases of the LSTM and the dense layers. We have made the GWO more robust by introducing an approach to improve the best possible solution by using the optimal ranking of the wolves. The proposed model combines the GWO with Adam Optimizer to train the LSTM. Apart from the LSTM, we have also implemented the Adaptive GWO on other variants of Recurring Neural Networks (RNN) like LSTM, Bi-Directional LSTM, Gated Recurrent Units (GRU), and Bi-Directional GRU and computed the corresponding results. The Adaptive GWO here evolves the initial weights and biases of the above-discussed neural networks. In this research, we have also compared the forecasting efficiency of our proposed work with a particle-warm optimization (PSO) based hybrid LSTM model, simple Grey-wolf Optimization (GWO), and Adaptive PSO. According to the experimental findings, the suggested model has effectively used the best initial weights, and its results are the best overall.

Resource efficient PV power forecasting: Transductive transfer learning based hybrid deep learning model for smart grid in Industry 5.0

This paper presents an innovative approach for enhancing power output forecasting of Photovoltaic (PV) power plants in dynamic environmental conditions using a Hybrid Deep Learning Model (DLM). The hybrid DLM employs a synergy of Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM) network, and Bidirectional LSTM (Bi-LSTM), effectively capturing spatial and temporal dependencies within weather data crucial for accurate predictions. To optimize the DLM’s performance efficiently, a unique Kepler Optimization Algorithm (KOA) is introduced for hyperparameter tuning, drawing inspiration from Kepler’s laws of planetary motion. By leveraging KOA, the DLM attains optimal hyperparameter configurations, elevating power output prediction precision. Additionally, this study integrates Transductive Transfer Learning (TTL) with the deep learning models to enhance resource efficiency. By leveraging knowledge gained from previously learned tasks, TTL enables the DLM to improve its forecasting capabilities while minimizing resource utilization. Datasets encompassing environmental parameters and PV plant-generated power across diverse sites are employed for DLM training and testing. Three hybrid models, amalgamating KOA, CNN, LSTM, and Bi-LSTM techniques, are introduced and evaluated. Comparative assessment of these models across distinct PV sites yields insightful observations. Performance evaluation, focused on short-term PV power forecasting, underscores the hybrid DLM’s superiority over individual CNN and LSTM models. This hybrid approach achieves remarkable accuracy and resilience in predicting power output under varying weather conditions, showcasing its potential for efficient PV power plant management.

Modelling and forecasting high-frequency data with jumps based on a hybrid nonparametric regression and LSTM model

High-frequency financial data is more difficult to predict than low-frequency data because it possesses nonlinearity, nonstationarity, higher volatility, and long memory and is frequently accompanied by the jump phenomena. In this paper, the nonparametric regression (NR) model based on kernel function is used to fit the nonlinear relationship between the nonstationary series Yt and its lagging series to model the trend of high frequency financial time series. Furthermore, the deep learning LSTM (long short-term memory) model is applied to capture the high volatility and frequent jumps of high frequency financial data and to improve the forecasting accuracy of the residual series. The results demonstrate that the hybrid NR and LSTM model has greatly improved the forecasting accuracy in several evaluation criteria. In comparison to NR, support vector machine (SVM), LSTM, ARIMA and NR-SVM models, the mean absolute error (MAE) of NR-LSTM has reduced by 89.78%, 97.85%, 86.48%, 32.47% and 89%, respectively. In addition, we have constructed the trading strategy for the Shanghai-Shenzhen 300 index by using the NR-LSTM model. The NR-LSTM model can continue to provide good returns even during a bear market, which can serve as a guide for investors. Furthermore, the NR-LSTM model also exhibits the best forecasting effect when we model the high-frequency data of Ping An bank in China, the FTSE 100 index in the UK, and the S&P 500 index in the US.

Hybrid LSTM Model to Predict the Level of Air Pollution in Montenegro

Air pollution is a critical environmental concern that poses significant health risks and affects multiple aspects of human life. ML algorithms provide promising results for air pollution prediction. In the existing scientific literature, Long Short-Term Memory (LSTM) predictive models, as well as their combination with other statistical and machine learning approaches, have been utilized for air pollution prediction. However, these combined algorithms may not always provide suitable results due to the stochastic nature of the factors that influence air pollution, improper hyperparameter configurations, or inadequate datasets and data characterized by great variability and extreme dispersion. The focus of this paper is applying and comparing the performance of Support Vector Machine and hybrid LSTM regression models for air pollution prediction. To identify optimal hyperparameters for the LSTM model, a hybridization with the Genetic Algorithm is proposed. To mitigate the risk of overfitting, the bagging technique is employed on the best LSTM model. The proposed predicitive model aims to determine the Common Air Quality Index level for the next hour in Niksic, Montenegro. With the hybridization of the LSTM algorithm and by applying the bagging technique, our approach aims to significantly enhance the accuracy and reliability of hourly air pollution prediction. The major contribution of this paper is in the application of advanced machine learning analysis and the combination of the LSTM, Genetic Algorithm, and bagging techniques, which have not been previously employed in the analysis of air pollution in Montenegro. The proposed model will be made available to interested management structures, local governments, national entities, or other relevant institutions, empowering them to make effective pollution level predictions and take appropriate measures.

Novel Method for Sentiment Analysis in Social Media Data Using Hybrid Deep Learning Model

It is common practise to employ a contextual mining approach called sentiment analysis (SA) to glean subjective but potentially helpful information from textual data. In order to recognise, analyse, and extract answers, states, or emotions from the data, it employs Natural Language Processing (NLP), language understanding, forensics, and cognitive science. Significant progress towards a better SA model may be made using the features analysis method. In recent years, feature extractions have made extensive use of GloVe and Word2vec embedding models. They require a huge corpora of text data for training and creating accurate vectors, but they ignore emotional and contextual information in the text. Out-of-Vocabulary (OOV) words are not considered while creating these vectors, hence some information may be lost if these methods are used. The limited availability of annotated data is another obstacle to sentiment categorization. Misclassification may occur when there is a discrepancy between the review and the label. In this research, we offer a hybrid SA model capable of overcoming the challenges posed by missing ratings and reviews due to noise, out-of-context phrases, and context. To investigate and conduct sentiment and appropriate analysis, this study proposes an Autoencoder Bi-directional Recurrent Neural Network (ABRNN) based on Bi-directional Encoding from Transformers (BET). The reviews are initially categorised by their polarity ratings using the zero-shot categorization. Then, the data is fed into a pre-trained BET system to extract embeddings based on the semantics and context of sentences. The neural network, made up of expanded and hybrid LSTM, was then fed the acquired contextual embedded vectors. For extracting both global and local spatial contextual characteristics from the embedded data, this approach employs expanded approach in place of traditional approach. The complete phrase sequencing is performed with the help of Hybrid Long Short-Term Memory (HLSTM). Measures of accuracy, precision, recall, f1-score, and area under the curve (AUC) are used to assess the ABRNN model on four separate text datasets from different domains. Because of this, ABRNN may be utilised well for SA processes on social media evaluations, with no loss of data.