Weights Of Neural Network Research Articles

Integrated model construction for state of charge estimation in electric vehicle lithium batteries

This research addresses the issue of State of Charge (SOC) prediction for electric vehicle batteries by employing a dynamic Kalman neural network model. The model is optimized using a Genetic algorithm to adjust the neural network weights. Additionally, a strategy involving support vector machines for model optimization is proposed. This strategy involves preprocessing the data, selecting appropriate kernel functions for training, and merging prediction results to enhance the stability of the model. Results indicated that the Dynamic Genetic Kalman Neural Network (DGKNN) model achieved the minimum prediction error percentage of only 0.1529% when the correction coefficient was set to 0.7. The DGKNN model consistently exhibited the lowest error percentage, average absolute error, mean square error, and root mean square error when handling small, medium, and large datasets. For instance, in the small dataset, the error percentage was only 0.1518, and the root mean square error was only 0.0604. The research findings demonstrated that the proposed model exhibited high real-time accuracy in predicting battery SOC, enabling real-time monitoring of battery operating parameters. The method proposed in this study can accurately predict the state of battery charge, extend the life of battery packs, and improve the performance of electric vehicles. It has important significance for promoting the development of the electric vehicle industry.

Uncertainty quantified discovery of chemical reaction systems via Bayesian scientific machine learning

The recently proposed Chemical Reaction Neural Network (CRNN) discovers chemical reaction pathways from time resolved species concentration data in a deterministic manner. Since the weights and biases of a CRNN are physically interpretable, the CRNN acts as a digital twin of a classical chemical reaction network. In this study, we employ a Bayesian inference analysis coupled with neural ordinary differential equations (ODEs) on this digital twin to discover chemical reaction pathways in a probabilistic manner. This allows for estimation of the uncertainty surrounding the learned reaction network. To achieve this, we propose an algorithm which combines neural ODEs with a preconditioned stochastic gradient langevin descent (pSGLD) Bayesian framework, and ultimately performs posterior sampling on the neural network weights. We demonstrate the successful implementation of this algorithm on several reaction systems by not only recovering the chemical reaction pathways but also estimating the uncertainty in our predictions. We compare the results of the pSGLD with that of the standard SGLD and show that this optimizer more efficiently and accurately estimates the posterior of the reaction network parameters. Additionally, we demonstrate how the embedding of scientific knowledge improves extrapolation accuracy by comparing results to purely data-driven machine learning methods. Together, this provides a new framework for robust, autonomous Bayesian inference on unknown or complex chemical and biological reaction systems.

2:1 Multiplexer, 1:2 De-multiplexer,2:4 Decoder and 4:2 Encoder Circuit Design with CMOS Technology Implementing with Artificial Neural Network with Verilog HDL Code for Output

The goal of this project is to create a De-multiplexer gate using a complementary metal oxide semiconductor (CMOS) and an artificial neural network.When designing any COMS circuit, we always keep in mind that the lowest possible cost should be the aim.In this work, the circuit was designed using a multilayer artificial neural network. We utilize weights to alter the value and treat negative values as inverters and neurons as transistors in our work.We are also developing Verilog-HdL code to easily apply the De-multiplexer for experimenting with an artificial neural network and set weights to acquire the desired results. The purpose of this project is to use an artificial neural network and a complementary metal oxide semiconductor (CMOS) to develop a decoder gate.We constantly keep in mind that the goal should be to construct a COMS circuit at the lowest feasible cost.An artificial neural network with multiple layers was used to create the circuit in this work. In our study, we treat negative values as inverters and neurons as transistors, and we modify the value using weights.Additionally, we are creating Verilog-HdL code that will make it simple to use the Decoder to experiment with artificial neural networks and adjust weights to get the desired outcomes. The purpose of this project is to use an artificial neural network and a complementary metal oxide semiconductor (CMOS) to develop a decoder gate.We constantly keep in mind that the goal should be to construct a COMS circuit at the lowest feasible cost.An artificial neural network with multiple layers was used to create the circuit in this work. In our study, we treat negative values as inverters and neurons as transistors, and we modify the value using weights.Additionally, we are creating Verilog-HdL code that will make it simple to use the Decoder to experiment with artificial neural networks and adjust weights to get the desired outcomes. The purpose of this research is to use an artificial neural network and a complementary metal oxide semiconductor (CMOS) to produce a multiplexer gate.We always keep in mind that the lowest feasible cost should be the goal while designing any COMS circuit.This work used a multilayer artificial neural network to design the circuit. In our work, we treat neurons as transistors and negative values as inverters, and we use weights to adjust the value.In order to effortlessly apply the Multiplexer for experimenting with an artificial neural network and set weights to obtain the desired results, we are also building Verilog-HdL code.Keywords: Multiplexer, CMOS,ANN,Verilog-HDL. Keywords: Multiplexer De-multiplexer, Decoder, Encoder Verilog-HDL, CMOS, ANN, Verilog HDL

Adaptive neural network controller for the rotating SMA actuator

In this research, we present a new data-driven Adaptive Neural Network (ANN) controller designed for a unique arc-shaped Shape Memory Alloy (SMA) actuator. The actuator generates rotational motion through two-dimensional shape restoration, which is significantly different from traditional linear SMA actuators. The SMA in an arc-shaped pattern tries to recover its original shape when heated, ultimately leading to rotational motion. Due to complexity in SMA motion, it is difficult to apply conventional empirical modeling methods in this research. Given this modelling difficulty, a model-based control approach may not be promising. Thus, a data-driven ANN is adopted here to control the SMA actuator without relying on precise modelling. This controller adeptly learns the actuator's dynamic behavior in real-time, fine-tuning its neural network weights to ensure optimal control. To validate its efficacy, we compare performance of the ANN controller with that of the traditional Proportional-Integral-Derivative (PID) and sliding mode controllers across two reference inputs (sinusoidal and square) under four different disturbance scenarios (input-output, output-only, input-only, and no disturbance). Our experimental results show the ANN controller can provide similar or slightly better performance in terms of tracking accuracy and disturbance rejection without rigorous parameter or gain tuning compared to traditional controllers. Our results verify advanced learning capabilities of the ANN controller and its potential in control of the SMA actuator.

Attacks on Machine Learning Models Based on the PyTorch Framework

This research delves into the cybersecurity implications of neural network training in cloud-based services. Despite their recognition for solving IT problems, the resource-intensive nature of neural network training poses challenges, leading to increased reliance on cloud services. However, this dependence introduces new cybersecurity risks. The study focuses on a novel attack method exploiting neural network weights to discreetly distribute hidden malware. It explores seven embedding methods and four trigger types for malware activation. Additionally, the paper introduces an open-source framework automating code injection into neural network weight parameters, allowing researchers to investigate and counteract this emerging attack vector.

DESIGN NEURAL NETWORK-PID CONTROLLER FOR TRAJECTORY TRACKING OF DIFFERENTIAL DRIVE MOBILE ROBOT

This paper proposes the design of a neural network controller based on a sample controller for controlling the trajectory-tracking motion of a differential drive mobile robot (DDMR). Firstly, the trajectory tracking model for DDMR is established based on position error. Next, a perceptron neural network is designed with three hidden layers to control the trajectory tracking of DDMR. The backpropagation algorithm is used to train the neural network with training data obtained from the PID controller with time-varying parameters. The authors have developed this approach and experimentally verified it with minor tracking errors. The neural network's weight matrix (W) and bias vector (b) are updated in real-time, providing an advantage over other methods. The effectiveness of the proposed controller is demonstrated by the DDMR's NURBS trajectory tracking error, which does not exceed 2.17 cm, and the DDMR's motion error, with linear and angular velocities not exceeding 0.004 m/s and 0.0007 rad/s, respectively. The proposed controller can supplement traditional controllers in controlling the trajectory of autonomous mobile robots, thereby improving the ability to generate local trajectories to avoid dynamic obstacles by the neural network

Learning-Based Faulty State Estimation Using SOH-Coupled Model Under Internal Thermal Faults in Lithium-Ion Batteries

Estimating the state of charge (SOC), state of health (SOH), and core temperature under internal faults will significantly improve the battery management system’s (BMS’s) autonomy and accuracy in range prediction. This paper presents a neural network (NN) based state estimation scheme that can estimate the SOC, core temperature, and SOH under internal faults in lithium-ion batteries (LIBs). First, we propose a model-based internal fault detection scheme by employing a SOH-coupled electro-thermal-aging model (ETA) of the LIB. Then, a nonlinear observer is used to estimate the proposed SOH-coupled model’s healthy states for a residual generation. The fault diagnosis scheme compares the output voltage and surface temperature residuals against the designed adaptive threshold to detect thermal faults. The adaptive threshold effectively alleviates the false positives due to degradation and model uncertainties of the battery under no-fault conditions. Upon fault detection, we employ an additional NN-based observer in the second step to learn the faulty dynamics. A novel NN weight tuning algorithm is proposed using the measured voltage, surface temperature, and estimated healthy states. The convergence of the nonlinear and NN-based observer state estimation errors is proven using the Lyapunov theory. Finally, numerical simulation results are presented.

Cooperative Control of Multiagent Systems: A Quantization Feedback-Based Event-Triggered Approach.

This article addresses the synchronization tracking problem for high-order uncertain nonlinear multiagent systems via intermittent feedback under a directed graph. By resorting to a novel storer-based triggering transmission strategy in the state channels, we propose an event-triggered neuroadaptive control method with quantitative state feedback that exhibits several salient features: 1) avoiding continuous control updates by making the parameter estimations updated intermittently at the trigger instants; 2) resulting in lower-frequency triggering transmissions by using one event detector to monitor the triggering condition such that each agent only needs to broadcast information at its own trigger times; and 3) saving communication and computation resources by designing the intermittent updating of neural network weights using a dual-phase technique during the triggering period. Besides, it is shown that the proposed scheme is capable of steering the tracking/disagreement errors into an adjustable neighborhood close to the origin, and the existence of a strictly positive dwell time is proved to circumvent Zeno behavior. Both theoretical analysis and numerical simulation authenticate and validate the efficiency of the proposed protocols.

Image classification system for COVID-19 patient X-Ray results using median filter with deep learning method

An image is a representation of an object that is rewritten on a medium with specific values (intensity) and has x and y coordinates. X-ray images are one type of medical image that can be used to detect and study a disease. However, X-ray images can sometimes appear blurry, making interpretation a bit challenging. Furthermore, there is variation in X-ray attenuation between normal tissue and tissue affected by a disease. By using the median filter and implementing deep learning as a method for classifying images based on feature extraction and weights in artificial neural networks. The stages carried out include preprocessing, with training and testing, feature extraction using layers of artificial neural networks that have undergone the filtering process. Then, a custom classifier layer is created to train the classification of COVID and normal classes using data from bottleneck.npy. The results of training and testing yielded an average accuracy of 95%, while the F1 Score evaluation result was 0.9."

Neural network crossover in genetic algorithms using genetic programming

The use of genetic algorithms (GAs) to evolve neural network (NN) weights has risen in popularity in recent years, particularly when used together with gradient descent as a mutation operator. However, crossover operators are often omitted from such GAs as they are seen as being highly destructive and detrimental to the performance of the GA. Designing crossover operators that can effectively be applied to NNs has been an active area of research with success limited to specific problem domains. The focus of this study is to use genetic programming (GP) to automatically evolve crossover operators that can be applied to NN weights and used in GAs. A novel GP is proposed and used to evolve both reusable and disposable crossover operators to compare their efficiency. Experiments are conducted to compare the performance of GAs using no crossover operator or a commonly used human designed crossover operator to GAs using GP evolved crossover operators. Results from experiments conducted show that using GP to evolve disposable crossover operators leads to highly effectively crossover operators that significantly improve the results obtained from the GA.

Boosted dipper throated optimization algorithm-based Xception neural network for skin cancer diagnosis: An optimal approach

Skin cancer is a prevalent form of cancer that necessitates prompt and precise detection. However, current diagnostic methods for skin cancer are either invasive, time-consuming, or unreliable. Consequently, there is a demand for an innovative and efficient approach to diagnose skin cancer that utilizes non-invasive and automated techniques. In this study, a unique method has been proposed for diagnosing skin cancer by employing an Xception neural network that has been optimized using Boosted Dipper Throated Optimization (BDTO) algorithm. The Xception neural network is a deep learning model capable of extracting high-level features from skin dermoscopy images, while the BDTO algorithm is a bio-inspired optimization technique that can determine the optimal parameters and weights for the Xception neural network. To enhance the quality and diversity of the images, the ISIC dataset is utilized, a widely accepted benchmark system for skin cancer diagnosis, and various image preprocessing and data augmentation techniques were implemented. By comparing the method with several contemporary approaches, it has been demonstrated that the method outperforms others in detecting skin cancer. The method achieves an average precision of 94.936%, an average accuracy of 94.206%, and an average recall of 97.092% for skin cancer diagnosis, surpassing the performance of alternative methods. Additionally, the 5-fold ROC curve and error curve have been presented for the data validation to showcase the superiority and robustness of the method.

Quantum Neural Network model for Token allocation for Course Bidding

Quantum computer has shown the advantage over the classical computer to solve some problems using the laws of quantum mechanics. With a combination of knowledge of machine learning and quantum computing, Quantum neural networks adapted the concept from classical neural networks and apply parameterized quantum gates as neural network weights. In this paper, we present an application of quantum neural networks with real-world data to predict token price used in a course bidding system. The experiments were carried out on the Qiskit quantum simulator. The result shows that quantum neural networks can achieve a good prediction result compared to the classical neural network. The best model configuration has the lowest RMSE 6.38%. This approach opens an opportunity to explore the benefit of quantum machine learning in many research fields in the future.

Reinforcement learning‐based event‐triggered optimal control for unknown nonlinear systems with input delay

AbstractThe optimal control issue of discrete‐time nonlinear unknown systems with time‐delay control input is the focus of this work. In order to reduce communication costs, a reinforcement learning‐based event‐triggered controller is proposed. By applying the proposed control method, closed‐loop system's asymptotic stability is demonstrated, and a maximum upper bound for the infinite‐horizon performance index can be calculated beforehand. The event‐triggered condition requires the next time state information. In an effort to forecast the next state and achieve optimal control, three neural networks (NNs) are introduced and used to approximate system state, value function, and optimal control. Additionally, a M NN is utilized to cope with the time‐delay term of control input. Moreover, taking the estimation errors of NNs into account, the uniformly ultimately boundedness of state and NNs weight estimation errors can be guaranteed. Ultimately, the validity of proposed approach is illustrated by simulations.

Enhancing Security Mechanisms for IoT-Fog Networks

This study contributes to improving Morocco's fish canning industry by integrating artificial intelligence (AI). The primary objective involves developing an AI and image processing-based system to monitor and guarantee canning process quality in the facility. It commenced with an IoT-enabled device capable of capturing and processing images, leading to the creation of an AI-driven system adept at accurately categorizing improperly crimped cans. Further advancements focused on reinforcing communication between IoT devices and servers housing individual client's neural network weights. These weights are vital, ensuring the functionality of our IoT device. The efficiency of the IoT device in categorizing cans relies on updated neural network weights from the Fog server, crucial for continual refinement and adaptation to diverse can shapes. Securing communication integrity between devices and the server is imperative to avoid disruptions in can classification, emphasizing the need for secure channels. In this paper, our key scientific contribution revolves around devising a security protocol founded on HMAC. This protocol guarantees authentication and preserves the integrity of neural network weights exchanged between Fog computing nodes and IoT devices. The innovative addition of a comprehensive dictionary within the Fog server significantly bolsters security measures, enhancing the overall safety between these interconnected entities.

Neural network compensator-based robust iterative learning control scheme for mobile robots nonlinear systems with disturbances and uncertain parameters

Aiming at the problem of trajectory tracking control for mobile robot nonlinear systems with non-repetitive uncertain parameters, we propose a novel neural network compensator-based robust iterative learning control (NNRILC) scheme to achieve excellent tracking performance and uncertainty compensation. The NNRILC scheme consists of a parallel structure that includes a robust iterative learning control (RILC) term and a neural network (NN) compensator. The RILC term is used to ensure robust control performance and promise closed-loop stability. The compensator based on the neural network is employed to handle the uncertainties resulted from the nonlinear dynamics as well as the suppressed disturbances in the mobile robot nonlinear systems. Additionally, the fourth-order Runge-Kutta algorithm is employed to solve the state differential equation of the mobile robot. Consequently, The H∞ robust technique is used to construct an iterative learning control update rule to reduce the impact of disturbances. Meanwhile, the RILC scheme is designed to optimize the neural network initial parameters and weights of the NN compensator at each trial. Then the convergence of the proposed NNRILC scheme is analyzed, and the results are incorporated into the control update for the next process trial. Finally, the effectiveness of the proposed method is verified by mobile robot simulation.

Novel Watermarking and Scrambling for Convolution Neural Network Weights

Novel Watermarking and Scrambling for Convolution Neural Network Weights

Enhancing Energy Management Strategies for Extended-Range Electric Vehicles through Deep Q-Learning and Continuous State Representation

The efficiency and dynamics of hybrid electric vehicles are inherently linked to effective energy management strategies. However, complexity is heightened due to uncertainty and variations in real driving conditions. This article introduces an innovative strategy for extended-range electric vehicles, grounded in the optimization of driving cycles, prediction of driving conditions, and predictive control through neural networks. First, the challenges of the energy management system are addressed by merging deep reinforcement learning with strongly convex objective optimization, giving rise to a pioneering method called DQL-AMSGrad. Subsequently, the DQL algorithm has been implemented, allowing temporal difference-based updates to adjust Q values to maximize the expected cumulative reward. The loss function is calculated as the mean squared error between the current estimate and the calculated target. The AMSGrad optimization method has been applied to efficiently adjust the weights of the artificial neural network. Hyperparameters such as the learning rate and discount factor have been tuned using data collected during real-world driving tests. This strategy tackles the “curse of dimensionality” and demonstrates a 30% improvement in adaptability to changing environmental conditions. With a 20%-faster convergence speed and a 15%-superior effectiveness in updating neural network weights compared to conventional approaches, it also highlights an 18% reduction in fuel consumption in a case study with the Nissan Xtrail e-POWER system, validating its practical applicability.

On the effects of biased quantum random numbers on the initialization of artificial neural networks

Recent advances in practical quantum computing have led to a variety of cloud-based quantum computing platforms that allow researchers to evaluate their algorithms on noisy intermediate-scale quantum devices. A common property of quantum computers is that they can exhibit instances of true randomness as opposed to pseudo-randomness obtained from classical systems. Investigating the effects of such true quantum randomness in the context of machine learning is appealing, and recent results vaguely suggest that benefits can indeed be achieved from the use of quantum random numbers. To shed some more light on this topic, we empirically study the effects of hardware-biased quantum random numbers on the initialization of artificial neural network weights in numerical experiments. We find no statistically significant difference in comparison with unbiased quantum random numbers as well as biased and unbiased random numbers from a classical pseudo-random number generator. The quantum random numbers for our experiments are obtained from real quantum hardware.

Ultra-short-term wind power probabilistic forecasting based on an evolutionary non-crossing multi-output quantile regression deep neural network

Ultra-short-term wind power probabilistic forecasting is of significance for stable power grid operation; however, it is still challenging due to the inherent nonlinearity and uncertainty. Most state-of-the-art methods have focused on achieving quantile prediction using a combination of linear quantile regression and nonlinear complex deep neural networks. Yet, these methods struggle with several dilemmas. Quantile regression deep neural networks require a complete training once for each quantile. The multi-training mode and complex structure of quantile regression deep neural network can lead to extremely high computational complexity. Most of the training of quantile regression deep neural networks are guided by the loss of each quantile, and the weights are adjusted by gradient descent in which the gradient explosion and quantile crossover may be encountered. Therefore, this paper proposes a non-crossing multi-output quantile regression deep neural network optimized by chaotic particle swarm optimization. It designs a multi-output deep neural network to output all quantile estimations simultaneously through one training, effectively solving the structural complexity problem of traditional quantile regression deep neural networks. Since quantile regression produces a non-differentiable loss function which significantly hinders model training, the proposed neural network is trained by chaotic particle swarm optimization. It not only achieves the effect of optimizing all quantile losses simultaneously, but also can significantly alleviate the dilemma of training in traditional neural network weight optimization. In addition, several non-crossing constraints are designed for avoiding quantile crossover. The proposed model is trained and tested on two real-world wind power case studies. The experiment results show that the proposed model shows superiority in performance criteria, training speed, and avoiding quantile crossover.

Prediction model of spontaneous combustion risk of extraction borehole based on PSO-BPNN and its application

The feasibility and accuracy of the risk prediction of gas extraction borehole spontaneous combustion is improved to avoid the occurrence of spontaneous combustion in the gas extraction borehole. A gas extraction borehole spontaneous combustion risk prediction model (PSO-BPNN model) coupling the PSO algorithm with BP neural network is established through improving the connection weight and threshold values of BP neural network by the particle swarm optimization (PSO) algorithm. The prediction results of the PSO-BPNN model are compared and analyzed with that of the BP neural network model (BPNN model), GA-BPNN model, SSA-BPNN model and MPA-BPNN model. The results showed as follows: the average relative error of the PSO-BPNN model was 4.38%; the average absolute error was 0.0678; the root mean square error was 0.0934; and the determination coefficient was 0.9874. Compared with the BPNN model, the average relative error, average absolute error and root mean square error decreased by 9.35%, 0.1707 and 0.2056 respectively; and the determination coefficient increased by 0.1169. Compared with the GA-BPNN model, the average relative error, average absolute error and root mean square error decreased by 3.19%, 0.0602 and 0.0821 respectively; and the determination coefficient increased by 0.0320. Compared with the SSA-BPNN model, the average relative error, average absolute error and root mean square error decreased by 5.70%, 0.0820 and 0.1100 respectively; and the determination coefficient increased by 0.0474. Compared with the MPA-BPNN model, the average relative error, average absolute error and root mean square error decreased by 3.50%, 0.0861 and 0.1125 respectively; and the determination coefficient increased by 0.0488, proving that the PSO-BPNN model is more accurate than the BPNN model, GA-BPNN model, SSA-BPNN model and MPA-BPNN model as for prediction. When the PSO-BPNN model was applied to three extraction boreholes A, B, and C in a coal mine of Shanxi, the prediction results were better than the BPNN model, GA-BPNN model, SSA-BPNN model and MPA-BPNN model, proving the accuracy and stability of the PSO-BPNN model in predicting risk of borehole spontaneous combustion in other mine.