Term Memory Recurrent Neural Network Research Articles

Forecasting the trend of tuberculosis incidence in Anhui Province based on machine learning optimization algorithm, 2013–2023

Tuberculosis has been one of the most common communicable diseases raising global concerns. Accurately predicting the incidence of Tuberculosis remains challenging. Here we constructed a time-series analysis and fusion tool using multi-source data, and aimed to more accurately predict the incidence trend of tuberculosis of Anhui Province from 2013 to 2023. Random forest algorithm (RF), Feature Recursive Elimination (RFE) and Least absolute shrinkage and selection operator (LASSO) were implemented to improve the derivation of features related to infectious diseases and feature work. Based on the characteristics of infectious disease data, a model of RF-RFE-LASSO integrated particle swarm optimization multiple inputs long short term memory recurrent neural network (RRL-PSO-MiLSTM) was created to perform more accurate prediction. Results showed that the PSO-MiLSTM achieved excellent prediction results compared with common single-input and multi-input time-series models (test set MSE:42.3555, MAE: 59.3333, RMSE: 146.7237, MAPE: 2.1133, R2: 0.8634). PSO-MiLSTM enriches and complements the methodological research content of calibrating the time-series predictive analysis of infectious diseases using multi-source data, and can be used as a brand-new benchmark for the analysis of influencing factors and trend prediction of infectious diseases at the public health level in the future, as well as providing a reference for incidence rate prediction of infectious diseases.

Charging Station Power System Data Prediction Model Based on Deep Learning

The increase growth and adoption of electric vehicles (EVs) are playing a crucial role in advanced transportation system, helping to minimizing the emissions of harmful greenhouse gases and enhancing environmental sustainability. The need for EVs to be charged immediately has gained significant attention due to the rise in EVs sales over the last years. As a result of this, need for electric car charging is important to reducing the impact of electric network and providing minimum charging fares. In order to calculate the demand for charging EVs, a novel Deep Learning (DL)-based Long-Short Term Memory (LSTM) recurrent neural network predictor model is attempted to be developed in this research study. The Modified Aquilla Optimizer Algorithm (MAOA) is used to optimizing the parameter of the new Deep LSTM (DLSTM) neural predictor models and Independent Component Analysis (ICA) is utilized to solve the input time series data while conserving its properties. In this research, a novel ICA—AOA—DLSTM neural predictor model was developed to addressed the challenges of vanishing and exploding gradient in basic recurrent neural learnings. The predictor model was tested on the EV charging dataset from Georgia Tech, Atlanta, USA, indicating its performance. During simulation, the predictor achieved a prediction accuracies of 96.24% with a mean absolute errors of 0.1083 and a RMSE errors of 3.0629 × 10^-5, outperforming previous techniques. Additionally, the mean absolute error was found to be 0.2083, with a mean square error of 3.25516 × 10^-10. These results highlight the effectiveness of the novel deep learning LSTM neural predictor for this dataset compared to existing techniques.

Forecasting sea surface temperature during typhoon events in the Bohai Sea using spatiotemporal neural networks

Advanced neural network methods can effectively combine temporal and spatial information, allowing us to exploit complex relationships in the prediction of sea surface temperature (SST). Therefore, the authors have developed an attention-based context fusion network model recently, known as ACFN, to enhance the underlying spatiotemporal correlations in SST data. In a previous preliminary long-term evaluation, ACFN has demonstrated substantial improvements over several state-of-the-art baseline models, such as Convolutional Long-Short Term Memory (ConvLSTM) and Predictive Recurrent Neural Network (PredRNN). However, these methods have not been widely used for predicting SST during typhoons, and their performance has not been thoroughly evaluated. This study focuses on three specific typhoons, In-fa (2021), Lekima (2019), and Rumbia (2018), as case studies. The results show that ACFN consistently outperforms ConvLSTM and PredRNN, as demonstrated during Typhoon In-fa with a mean absolute error of 0.27 °C and a root-mean-square error of 0.33 °C for a 1-day forecast time. This study also examines the impact of forecast time on predictive skill, revealing that the performance of ACFN, as expected, gradually decreases with longer forecast times. This thorough evaluation of the ACFN model provides a valuable reference for using deep learning in predicting regional typhoon SST. Plain language summaryIn previous work, we developed an attention-based context fusion network model. This spatiotemporal neural network model has been successfully applied to short-term sea surface temperature (SST) prediction in the Bohai Sea, utilizing only current and previous 1- to 10-day SST data as input to forecast SST for the subsequent 1- to 10-day period. In this study, we further evaluated the capability of the model to predict SST during typhoons in the Bohai Sea, and the results were very promising. When predicting SST during Typhoon In-fa, the present spatiotemporal neural network model had a mean absolute error of only 0.27 °C for a 1-day forecast time, and a correlation coefficient of 0.74. On the other hand, comparison with baseline spatiotemporal neural network models shows that the present model is more effective in extracting input information. The current model has resolved the constraint that its predictive capability does not diminish as the forecast time increases, thereby enhancing the rationality of the prediction outcomes. In conclusion, the present spatiotemporal neural network model demonstrates its efficacy in forecasting typhoon-induced SST in the Bohai Sea, offering valuable insights for applications in meteorology and oceanography.

Daily scale air quality index forecasting using bidirectional recurrent neural networks: Case study of Delhi, India

This research was established to accurately forecast daily scale air quality index (AQI) which is an essential environmental index for decision-making. Researchers have projected different types of models and methodologies for AQI forecasting, such as statistical techniques, machine learning (ML), and most recently deep learning (DL) models. The modelling development was adopted for Delhi city, India which is a major city with air pollution issues simialir to entire urban cities of India especially during winter seasons. This research was predicted AQI using different versions of DL models including Long-Short Term Memory (LSTM), Bidirectional LSTM (Bi-LSTM) and Bidirectional Recurrent Neural Networks (Bi-RNN) in addition to Kernel Ridge Regression (KRR). Results indicated that Bi-RNN model consistently outperformed the other models in both training and testing phases, while the KRR model consistently displayed the weakest performance. The outstanding performance of the models development displayed the requirement of adequate data to train the models. The outcomes of the models showed that LSTM, BI-LSTM, KRR had lower performance compared with Bi-RNN models. Statistically, Bi-RNN model attained maximum cofficient of determination (R2 = 0.954) and minimum root mean square error (RMSE = 25.755). The proposed model in this research revealed the robust predictable to provide a valuable base for decision-making in the expansion of combined air pollution anticipation and control policies targeted at addressing composite air pollution problems in the Delhi city.

Evolution of Natural Language Processing: A Review

Over the years, Natural Language Processing (NLP) has evolved dramatically, moving from early rule based systems to the current era dominated by advanced deep learning models. An overview of the significant turning points and patterns that have influenced the development of NLP is given in this study. In the early days of Natural Language Processing (NLP), rule based methods were the main focus. Linguists would manually create rules to analyze and comprehend human language. Although these systems were somewhat successful, they were unable to handle the complexity and unpredictability of spoken language. A major change was brought about by the introduction of probabilistic models and machine learning techniques with the emergence of statistical approaches. The development of methods like n gram models and hidden Markov models during this time allowed computers to handle linguistic patterns. Large scale linguistic resources like word embeddings and annotated corpora started to appear, which further accelerated the development of NLP. Machine learning algorithms have led to notable advancements in tasks such as machine translation, named entity recognition, and part of speech tagging. NLP has seen a revolution in recent years thanks to deep learning, which uses neural networks to learn intricate language representations. Sequential dependencies in language can now be better understood because of models like Long Short Term Memory Networks (LSTMs) and Recurrent Neural Networks (RNNs). The addition of attention mechanisms, as demonstrated by Transformer and other models, improves the model's ability to manage long range dependencies and perform better on a variety of NLP tasks. In the future, NLP will develop in ways that go beyond performance measurements, exploring interpretability, ethical issues, and the incorporation of multimodal data. As the area develops, it becomes increasingly important to eliminate biases, ensure ethical AI deployment, and improve user centric experiences. This introduction lays the groundwork for an in depth examination of the development of NLP, highlighting significant turning points, difficulties, and potential future directions in this vibrant and quickly developing subject.

Predicting Model of Dual-Mode Shield Tunneling Parameters in Complex Ground Using Recurrent Neural Networks and Multiple Optimization Algorithms

Based on the left tunnel of the Liuxiandong Station to Baimang Station section of Shenzhen Metro Line 13 (China), a prediction model for the advanced rate of dual-mode shield tunneling in complex strata was established to explore intelligent tunneling technology in complex ground. Firstly, geological parameters of the complex strata and on-site monitoring parameters of EPB/TBM dual-mode shield tunneling were collected, with tunneling parameters, shield tunneling mode, and strata parameters selected as input features. Subsequently, the Isolation Forest algorithm was employed to remove outliers from the original advance parameters, and an improved mean filtering algorithm was applied to eliminate data noise, resulting in the steady-state phase parameters of the shield tunneling process. The base model was chosen as the Long-Short Term Memory (LSTM) recurrent neural network. During the model training process, particle swarm optimization (PSO), genetic algorithm (GA), differential evolution (DE), and Bayesian optimization (BO) algorithms were, respectively, combined to optimize the model’s hyperparameters. Via rank analysis based on evaluation metrics, the BO-LSTM model was found to have the shortest runtime and highest accuracy. Finally, the dropout algorithm and five-fold time series cross-validation were incorporated into the BO-LSTM model, creating a multi-algorithm-optimized recurrent neural network model for predicting tunneling speed. The results indicate that (1) the Isolation Forest algorithm can conveniently identify outliers while considering the relationship between tunneling speed and other parameters; (2) the improved mean filtering algorithm exhibits better denoising effects on cutterhead speed and tunneling speed; and (3) the multi-algorithm optimized LSTM model exhibits high prediction accuracy and operational efficiency under various geological parameters and different excavation modes. The minimum Mean Absolute Percentage Error (MAPE) prediction result is 8.3%, with an average MAPE prediction result below 15%.

Deep causal speech enhancement and recognition using efficient long-short term memory Recurrent Neural Network.

Long short-term memory (LSTM) has been effectively used to represent sequential data in recent years. However, LSTM still struggles with capturing the long-term temporal dependencies. In this paper, we propose an hourglass-shaped LSTM that is able to capture long-term temporal correlations by reducing the feature resolutions without data loss. We have used skip connections in non-adjacent layers to avoid gradient decay. In addition, an attention process is incorporated into skip connections to emphasize the essential spectral features and spectral regions. The proposed LSTM model is applied to speech enhancement and recognition applications. The proposed LSTM model uses no future information, resulting in a causal system suitable for real-time processing. The combined spectral feature sets are used to train the LSTM model for improved performance. Using the proposed model, the ideal ratio mask (IRM) is estimated as a training objective. The experimental evaluations using short-time objective intelligibility (STOI) and perceptual evaluation of speech quality (PESQ) have demonstrated that the proposed model with robust feature representation obtained higher speech intelligibility and perceptual quality. With the TIMIT, LibriSpeech, and VoiceBank datasets, the proposed model improved STOI by 16.21%, 16.41%, and 18.33% over noisy speech, whereas PESQ is improved by 31.1%, 32.9%, and 32%. In seen and unseen noisy situations, the proposed model outperformed existing deep neural networks (DNNs), including baseline LSTM, feedforward neural network (FDNN), convolutional neural network (CNN), and generative adversarial network (GAN). With the Kaldi toolkit for automated speech recognition (ASR), the proposed model significantly reduced the word error rates (WERs) and reached an average WER of 15.13% in noisy backgrounds.

Employing LSTMs for Music Remixing

Abstract: The Main Idea was to generate a mixed music from solo musical instrument. For carrying out this task there are various subtask to be carried from data collection to preprocessing the data to make it compatible with the Long Short Term Memory Recurrent Neural Network (LSTM RNNs) model. So, Music mp3 media was collected from melody loops and each one was trimmed down to 30 seconds. Conversion tool was used for segregating the Music into four different mp3 media file i.e. Bass.mp3, Drums.mp3, piano.mp3 and others.mp3. We prepared different models for accomplishing the task to get good results; therefore we preprocessed and transformed the data every time for the new Model architecture. We started with developing the most basic model architecture using Deep neural network (DNNs) and LSTM RNN, and this model architecture was so basic that it did not captures the dependencies within the music , although results was fine but music it generated does not make any sense. Than we tried experimenting by developing different model architectures which generates sensible music and we developed more complex architectures using LSTM RNNs which have the potential to make good results. But there is one disadvantage of it that it takes very long time to get fully trained. In order to reduce the training time and utilizing our resources properly we divided our model into 4 sub-models each for generating music of different musical instruments , These sub-models were trained in parallel on different Google Colaboratory notebook and their best model weights were stored for Reusing them for inference. These all were put into single notebook for predictions and each of these predictions are then combined to make the desired result

Active Rehabilitation Gloves Based on Brain-Computer Interfaces and Deep Learning

Cerebral stroke is the second leading cause of death and the third leading cause of death and disability in the world, and more than half of these patients have hand dysfunction, making hand rehabilitation an urgent challenge. In this study, a system for hand rehabilitation therapy for stroke patients was designed using novel human-computer interaction technology. The system combines a brain-computer interface, a deep learning algorithm and a rehabilitation glove, and designs an electroencephalogram (EEG) signal acquisition card and a rehabilitation glove to realise the application of motor imagery therapy to the active rehabilitation of patients' hands. On the brain-computer interface-based motor imagery experiments, the Long Short Term Memory (LSTM) recurrent neural network algorithm designed in this study achieves an average accuracy of 95.78% for the classification accuracy of mental tasks in seven motor imagery modes, which is important for the active rehabilitation of patients with hand function based on motor imagery-driven rehabilitation.

A model for multi-attack classification to improve intrusion detection performance using deep learning approaches

This proposed model introduces novel deep learning methodologies. The objective here is to create a reliable intrusion detection mechanism to help identify malicious attacks. Deep learning based solution framework is developed consisting of three approaches. The first approach is Long-Short Term Memory Recurrent Neural Network (LSTM-RNN) with seven optimizer functions such as adamax, SGD, adagrad, adam, RMSprop, nadam and adadelta. The model is evaluated on NSL-KDD dataset and classified multi attack classification. The model has outperformed with adamax optimizer in terms of accuracy, detection rate and low false alarm rate. The results of LSTM-RNN with adamax optimizer is compared with existing shallow machine and deep learning models in terms of accuracy, detection rate and low false alarm rate. The multi model methodology consisting of Recurrent Neural Network (RNN), Long-Short Term Memory Recurrent Neural Network (LSTM-RNN), and Deep Neural Network (DNN). The multi models are evaluated on bench mark datasets such as KDD’99, NSL-KDD, and UNSWNB15 datasets. The models self-learnt the features and classifies the attack classes as multi-attack classification. The models RNN, and LSTM-RNN provide considerable performance compared to other existing methods on KDD’99 and NSL-KDD dataset.

Time Series Analysis Based Air Pollution Level Prediction Using Long Short Term Memory Recurrent Neural Network with Attention Mechanism

Air pollution has grown significantly as a threat to the environment during the past few decades. It has had a profound effect on the ecosystem, public health, and safety. For government agencies to design plans for pollution prevention, predicting the extent of air pollution becomes essential for maintaining the environment and environmental protection. One of the efficient approaches to solving the problem of predicting the level of air pollutants is time series analysis. The drawbacks of conventional machine learning algorithms in time series analysis are solved by employing deep learning algorithms in a variety of ways. Deep Learning models learn features and dynamics exclusively and directly from the data, in contrast to Machine Learning models, such as autoregressive models (AR) or exponential smoothing, where feature engineering is conducted manually and frequently certain parameters are adjusted while taking domain expertise into account. To forecast the level of pollution in the following hour using the current hour's weather and pollution levels, a Recurrent Neural Network (RNN) model based on Long Short Term Memory (LSTM) units has been trained, tested, and optimized. The predictive model has been developed with both uni-variate, which takes into account only one feature, and multi-variate, which takes into account many features. To improve the performance of the model on long input sequences attention mechanism has been implemented.

Prediction of Bearing Vibration Fault State based on Fused Bi-LSTM and SVM

Machinery failure prediction and equipment health management is the key to reduce even prevent the occurrence of significant failures. In recent years, deep learning based intelligent fault diagnosis methods have become a hot topic of research in the field of machinery and equipment health management, especially the evaluation of the equipment health indicators and failure mode identification issues in complex environments. In this paper, a fused bidirectional long and short term memory (BiLSTM) and support vector machine (SVM) recurrent neural network deep learning algorithm is proposed to solve the problem of fast fault diagnosis of mechanical bearing vibration in complex environments. The algorithm uses a BiLSTM memory network as a feature extractor to capture fault features in the raw one dimensional (1-D) time series data, and then a SVM is used at the end of the network instead of the traditional softmax function as a classifier discriminator to further improve the accuracy of diagnosis. The experimental results indicate that the proposed algorithm model has higher diagnostic accuracy and faster diagnosis speed, and more suitable for fast diagnosis and real time detection of faults in complex environments.

Imagined Speech Classification Using EEG and Deep Learning.

In this paper, we propose an imagined speech-based brain wave pattern recognition using deep learning. Multiple features were extracted concurrently from eight-channel electroencephalography (EEG) signals. To obtain classifiable EEG data with fewer sensors, we placed the EEG sensors on carefully selected spots on the scalp. To decrease the dimensions and complexity of the EEG dataset and to avoid overfitting during the deep learning algorithm, we utilized the wavelet scattering transformation. A low-cost 8-channel EEG headset was used with MATLAB 2023a to acquire the EEG data. The long-short term memory recurrent neural network (LSTM-RNN) was used to decode the identified EEG signals into four audio commands: up, down, left, and right. Wavelet scattering transformation was applied to extract the most stable features by passing the EEG dataset through a series of filtration processes. Filtration was implemented for each individual command in the EEG datasets. The proposed imagined speech-based brain wave pattern recognition approach achieved a 92.50% overall classification accuracy. This accuracy is promising for designing a trustworthy imagined speech-based brain-computer interface (BCI) future real-time systems. For better evaluation of the classification performance, other metrics were considered, and we obtained 92.74%, 92.50%, and 92.62% for precision, recall, and F1-score, respectively.

Lung Image Classification Based On Long-Short Term Memory recurrent neural network

Due to various factors such as complicated lung imaging and rapidly growing amount of data, the task for imaging technicians is arduous. The emergence of artificial intelligence assisted diagnosis technology comes just in time.To effectively classify lung partial images and alleviate the burden of medical application, a deep learning method based on attention mechanism is therefore developed. The proposed model uses deep learning as the basic integrates Long-Shot term memory (LSTM) the recurrent neural network (RNN). Technology for lung imaging diagnosis based on artificial intelligence has evolved through time from combined diagnosis of multiple diseases to the diagnosis of a single specific disease. The suggested network’s overall classification accuracy, according to experiments, is 95.93%, which is 1.019% greater than that of the deep learning basic network. It also outperforms the VGG16 and VGG19 networks in terms of classification performance. Finally, the benefits and drawbacks of the suggested algorithm are explored, as well as the future development path.

Text Classification Based on CNN-BiGRU and Its Application in Telephone Comments Recognition

In this paper, we proposed a deep fusion model for telephone comments recognition, named CNN-BiGRU. Traditionally, the most used algorithms in text classification are Convolutional Neural Network (CNN), Long and Short Term Memory (LSTM) and Bi-Gated Recurrent Neural Network (BiGRU). For CNN, it can extract the feature form the neighbors, and a softmax layer is followed for classification. The global feature is not included in the CNN model. LSTM introduces the gate, which can capture the information before the node. BiGRU is developed from LSTM, and it can find the features in the context. So compared to LSTM, BiGRU not only includes the information before, but also can capture the following features. Thus, LSTM and BiGRU can extract the global features, but cannot capture the local features. In order to deal with this weakness, we proposed a fusion model for comments classification, which combines the CNN and BiGRU in our model. Different from other methods, CNN and BiGRU are parallelly connected. CNN model can extract the local feature, and BiGRU can find the global feature. Then we concatenate the two kinds of features and feed to recognition layer for classification. Then we use our model to classify the telephone comments; compared with the traditional machine SVM and tow deep neural models — CNN and BiGRU — our model performed better.

Unmanned aerial vehicles assisted rice seedling detection using shark smell optimization with deep learning model

Rice seedling classification using an unmanned aerial vehicle (UAV) images remains a challenging problem that needs to be addressed. It is still a difficult task because it is prone to low temporal and spatial resolution images. Recently, machine learning (ML) and deep learning (DL) models can be employed for several image preprocessing tasks such as classification, object detection, and segmentation. Therefore, this study focuses on the design of shark smell optimization with deep learning based rice seedling detection (SSODL-RSD) on UAV imagery. The presented SSODL-RSD technique recognizes the UAV images into arable land and rice seedlings. To achieve this, the SSODL-RSD technique employs the adaptive Wiener filtering (AWF) technique for the noise removal procedure. In addition, the SSODL-RSD technique exploits the NestNet feature extractor model. Moreover, the SSO algorithm is used for the hyperparameter tuning of the NestNet model. Finally, the long short term memory-recurrent neural network (LSTM-RNN) model is employed for the classification of rice seedlings. The extensive comparative study highlighted the improved outcomes of the SSODL-RSD technique over other existing models.

A multimodal human-robot sign language interaction framework applied in social robots.

Deaf-mutes face many difficulties in daily interactions with hearing people through spoken language. Sign language is an important way of expression and communication for deaf-mutes. Therefore, breaking the communication barrier between the deaf-mute and hearing communities is significant for facilitating their integration into society. To help them integrate into social life better, we propose a multimodal Chinese sign language (CSL) gesture interaction framework based on social robots. The CSL gesture information including both static and dynamic gestures is captured from two different modal sensors. A wearable Myo armband and a Leap Motion sensor are used to collect human arm surface electromyography (sEMG) signals and hand 3D vectors, respectively. Two modalities of gesture datasets are preprocessed and fused to improve the recognition accuracy and to reduce the processing time cost of the network before sending it to the classifier. Since the input datasets of the proposed framework are temporal sequence gestures, the long-short term memory recurrent neural network is used to classify these input sequences. Comparative experiments are performed on an NAO robot to test our method. Moreover, our method can effectively improve CSL gesture recognition accuracy, which has potential applications in a variety of gesture interaction scenarios not only in social robots.

Deep learning-based human action recognition to leverage context awareness in collaborative assembly

Human–Robot Collaboration is a critical component of Industry 4.0, contributing to a transition towards more flexible production systems that are quickly adjustable to changing production requirements. This paper aims to increase the natural collaboration level of a robotic engine assembly station by proposing a cognitive system powered by computer vision and deep learning to interpret implicit communication cues of the operator. The proposed system, which is based on a residual convolutional neural network with 34 layers and a long-short term memory recurrent neural network (ResNet-34 + LSTM), obtains assembly context through action recognition of the tasks performed by the operator. The assembly context was then integrated in a collaborative assembly plan capable of autonomously commanding the robot tasks. The proposed model showed a great performance, achieving an accuracy of 96.65% and a temporal mean intersection over union (mIoU) of 94.11% for the action recognition of the considered assembly. Moreover, a task-oriented evaluation showed that the proposed cognitive system was able to leverage the performed human action recognition to command the adequate robot actions with near-perfect accuracy. As such, the proposed system was considered as successful at increasing the natural collaboration level of the considered assembly station.

HH model based smart deep brain stimulator to detect, predict and control epilepsy using machine learning algorithm

BackgroundEpilepsy is the most common neurological disorder in the world. To control epilepsy, deep brain stimulation is one of the widely accepted treatment techniques. However, conventional deep brain stimulation technique provides continuous stimulation without optimizing the stimulation parameters, resulting in adverse side effects and unexpected death. Hence, understanding the dynamic behavior of brain neural networks at a cellular level is required for patient-specific epilepsy treatment. Considering the underlying mechanism of a single neuronal shift in the brain neural network, computational model-based techniques have a new face for healthcare, which aims to develop effective medical devices for preclinical investigations. New methodThis paper discusses the design of a Smart Deep Brain Stimulator (SDBS) using the Hodgkin-Huxley (HH) conductance-based cellular model of brain neurons to automatically detect, predict and regulate epilepsy against patient-specific conditions. Epileptic activity is simulated as a spike train of action potential due to sodium and potassium channel conductance variations in the single-neuron HH model. The proposed SDBS consists of three components:- i) seizure detection using bagging and boosting-based ensemble machine learning classifiers, ii) channel conductance prediction using Long Short Term Memory-Recurrent Neural Network (LSTM-RNN) based Deep Neural Network (DNN) for updating model parameters of brain neuron, and iii) model-based intelligent control of epileptic seizure with Nonlinear Autoregressive Moving Average-L2 (NARMA-L2) Controller and Nonlinear Model Predictive Controller (NMPC). ResultsFor effective treatment, improving the overall accuracy and efficiency of SDBS is essential. For epilepsy detection, the ensemble bagging machine learning algorithm provides better accuracy of 92.7% compared to the ensemble boosting algorithm. LSTM-RNN deep neural network model with four layers predicts the variations in channel conductance with Root Mean Square Error (RMSE) of 0.00568 and 0.009081 for sodium and potassium channel conductance, respectively. From the closed-loop performances of SDBS with an intelligent control scheme, it is observed that SDBS with NMPC provides efficient and accurate stimulation with minimum energy consumption. From a stability point of view, SDBS with NMPC provides better stability than SDBS with NARMA-L2 Controller. Comparison with existing methodThe proposed SDBS is designed to generate accurate stimulation pulses for epilepsy patients with specific conditions depending on the neuronal activity of a single neuron. Moreover, it will also adapt to the dynamic condition of epilepsy patients. The existing deep brain stimulator continuously provides stimulation pulses without adapting to the patient’s conditions. ConclusionThe proposed SDBS could provide patient-specific treatment based on sodium/potassium channel conductance variations of brain neurons. It will help increase the use of deep brain stimulation techniques and reduce sudden death. Furthermore, the proposed technique will be extended to neural network models with larger neuronal populations to improve the practical feasibility.

A Hybrid Model Based on CNN-LSTM to Detect and Forecast Harmonics: A Case Study of an Eskom Substation in South Africa

The ever-growing modern smart grid with more distributed energy resources is providing efficient energy supply while facing several challenges that include harmonics induced among many. Previous and present literature shows that various machine and deep learning models are superior and accurate as compared to the traditional and conventional signal processing techniques. Obtaining accurate results becomes extremely important especially the fact that harmonics are essentially nonlinear, nonparametric, and adaptive in nature. This paper proposes a novel forecasting model that aggregates two deep learning models: convolutional neural network (CNN) and long short term memory (LSTM) recurrent neural network (RNN) detect and forecast harmonics in a power system. CNN-LSTM hybrid forecasting model for harmonics in the power grid system has achieved significantly superior performance in collaborative data mining on spatiotemporal measurement data. Sample features are extracted using CNN before they are passed through LSTM for prediction. To show the superiority of the hybrid CNN-LSTM deep neural prediction network model, it is compared with CNN, LSTM and NARX (Non-Linear Autoregressive with External (Exogenous) Input). CNN-LSTM forecasting performance is superior as compared to the other four models. MSE and RMSE for CNN-LSTM are 0.00038 (〖3.8 × 10〗^ (−4)) and 0.0000014917 (1.4917 × 10^(−6)) respectively.