Traditional Learning Algorithms Research Articles

SFL-TUM: Energy Efficient SFRL method for Large Scale AI Model's Task Offloading in UAV-Assisted MEC Networks

The convergence of mobile edge computing (MEC) network with unmanned aerial vehicles (UAVs) presents an auspicious opportunity to revolutionize wireless communication and facilitate high-speed internet access in remote regions for mobile devices (MDs) as well as large scale artificial intelligence (AI) models. However, the substantial amount of data produced by the UAVs-assisted MEC network necessitates the integration of efficient distributed learning techniques in AI models. In recent times, distributed learning algorithms, including federated reinforcement learning (FRL) and split learning (SL), have been explored for the purpose of learning machine learning (ML) models that are distributed by sharing model parameters, as opposed to large raw data-sets as seen in traditional centralized learning algorithms. To implement the hybrid method, the model is first trained locally on each UAV-assisted MEC network using SL. Subsequently, the model parameters that have been encrypted are sent to a central server for federated averaging. Finally, after the model has been updated, it is distributed to each UAV-assisted MEC network for local fine-tuning. Our simulations indicate that the proposed split and federated reinforcement learning (SFRL) framework yields comparable high-test accuracy performance while consuming less energy compared to extant distributed learning algorithms. Furthermore, the SFRL algorithm efficiently realizes energy-efficient selection between the SL and FRL methods under different distributions. Numerical results shows that the proposed scheme improves the accuracy by 29.31% and reduced the energy consumption by around 67.34% and time delay by about 7.37%. as compared to the existing baseline schemes.

A Static Security Region Analysis of New Power Systems Based on Improved Stochastic–Batch Gradient Pile Descent

The uncertainty in the new power system has increased, leading to limitations in traditional stability analysis methods. Therefore, considering the perspective of the three-dimensional static security region (SSR), we propose a novel approach for system static stability analysis. To address the slow training speed of traditional deep learning algorithms using batch gradient descent (BGD), we introduce an improved stochastic–batch gradient descent (S-BGD) search method that combines the advantages of stochastic gradient descent (SGD) in fast training. This method ensures both speed and precision in parameter training. Moreover, to tackle the problem of getting trapped in local optima and saddle points during parameter training, we draw inspiration from kinematic theory and propose a gradient pile (GP) training method. By utilizing accumulated gradients as parameter corrections, this method effectively avoids getting stuck in local optima and saddle points, thereby enhancing precision. Finally, we apply the proposed methods to construct the static security region for the IEEE-118 new power system using its data as samples, demonstrating the effectiveness of our approach.

An improved deep hashing model for image retrieval with binary code similarities

The exponential growth of data raises an unprecedented challenge in data analysis: how to retrieve interesting information from such large-scale data. Hash learning is a promising solution to address this challenge, because it may bring many potential advantages, such as extremely high efficiency and low storage cost, after projecting high-dimensional data to compact binary codes. However, traditional hash learning algorithms often suffer from the problem of semantic inconsistency, where images with similar semantic features may have different binary codes. In this paper, we propose a novel end-to-end deep hashing method based on the similarities of binary codes, dubbed CSDH (Code Similarity-based Deep Hashing), for image retrieval. Specifically, it extracts deep features from images to capture semantic information using a pre-trained deep convolutional neural network. Additionally, a hidden and fully connected layer is attached at the end of the deep network to derive hash bits by virtue of an activation function. To preserve the semantic consistency of images, a loss function has been introduced. It takes the label similarities, as well as the Hamming embedding distances, into consideration. By doing so, CSDH can learn more compact and powerful hash codes, which not only can preserve semantic similarity but also have small Hamming distances between similar images. To verify the effectiveness of CSDH, we evaluate CSDH on two public benchmark image collections, i.e., CIFAR-10 and NUS-WIDE, with five classic shallow hashing models and six popular deep hashing ones. The experimental results show that CSDH can achieve competitive performance to the popular deep hashing algorithms.

New ensemble learning algorithm based on classification certainty and semantic correlation

A new bootstrap-aggregating (bagging) ensemble learning algorithm is proposed based on classification certainty and semantic correlation to improve the classification accuracy of ensemble learning. First, two predetermined thresholds are introduced to construct the long and short-text sample subsets, and different deep learning methods are compared to construct the optimal base classifier groups for each sample subsets. Then, the random sampling method employed in traditional bagging classification algorithms is improved, and a threshold group based random sampling method is proposed to obtain long and short training sample subsets of each iteration. Finally, the sample classification certainty of the base classifiers for different categories is defined, and the semantic correlation information is integrated with the traditional weighted voting classifier ensemble method to avoid the loss of important information during the sampling process. The experimental results on multiple datasets demonstrate that the algorithm significantly improves text classification accuracy and outperforms typical deep learning algorithms. The proposed algorithm achieves the improvements of approximately 0.082, 0.061 and 0.019 on CNews dataset when the F1 measurement is used over the traditional ensemble learning algorithms such as random forest, M_ADA_A_SMV and CNN_SVM_LR. Moreover, it achieves the best F1 values of 0.995, 0.985, and 0.989 on the datasets of Spam, CNews, and SogouCS datasets, respectively, when compared with the ensemble learning algorithms using different base classifiers.

Advancing spacecraft rendezvous and docking through safety reinforcement learning and ubiquitous learning principles

As spacecraft rendezvous and docking missions become increasingly complex, the need for advanced solutions has surged. In recent years, the application of reinforcement learning techniques to tackle spacecraft rendezvous guidance challenges has emerged as a prominent international trend. Vital to ensuring the secure rendezvous and docking of spacecraft is the task of obstacle avoidance. However, traditional reinforcement learning algorithms lack the ability to enforce safety constraints within the exploration space, which presents a formidable obstacle in the design of spacecraft rendezvous guidance strategies. In response to this challenge, a spacecraft rendezvous guidance methodology founded on safety reinforcement learning is proposed. Firstly, a Markov model is crafted for autonomous spacecraft rendezvous in scenarios involving collision avoidance. A reward system, contingent on obstacle warnings and collision avoidance constraints, is introduced to establish a safety reinforcement learning framework for devising spacecraft rendezvous guidance strategies. Secondly, within the framework of safety reinforcement learning, two deep reinforcement learning (DRL) algorithms, Proximal Policy Optimisation (PPO) and Deep Deterministic Policy Gradient (DDPG), are leveraged to generate these guidance strategies. Experimental findings validate the effectiveness of this approach in successfully executing obstacle avoidance and achieving rendezvous with remarkable precision. Furthermore, through an analysis of the performance and generalization capabilities of these two algorithms, the efficacy of the proposed methodology is further underscored. This fusion of advanced space guidance technology with the principles of Ubiquitous Learning marks a significant step forward in the quest for safer and more efficient spacecraft rendezvous and docking operations.

Short-term load prediction with LSTM and FCNN models Based on attention mechanisms

To address the significant load prediction discrepancies in microgrid economic dispatch, which result from substantial load fluctuations, a method for near-term load forecasting leveraging the attention mechanism is proposed, utilizing both LSTM and FCNN models. In this method, the attention mechanism is introduced to enhance the LSTM model’s ability to recognize and utilize key information, and the LSTM is used to process historical load data with time continuity selected by a sliding window, whereas the FCNN is used to process daily static features, such as the day’s maximum temperature, minimum temperature, and weather conditions. The outputs of the two networks are subsequently fused into a fully connected layer to generate the final load forecast. Training leverages six months of actual power load values and regional meteorological factor data. The forecast outcomes are then evaluated against both traditional and machine learning algorithms. The experimental findings highlight the superior prediction accuracy of the proposed model.

Content Modeling in Smart Learning Environments: A systematic literature review

Educational content has become a key element for improving the quality and effectiveness of teaching. Many studies have been conducted on user and knowledge modeling using machine-learning algorithms in smart-learning environments. However, few studies have focused on content modeling to estimate content indicators based on student interaction. This study presents a systematic literature review of content modeling using machine learning algorithms in smart learning environments. Two databases were used: Scopus and Web of Science (WoS), with studies conducted until August 2023. In addition, a manual search was performed at conferences and in relevant journals in the area. The results showed that assessment was the most used content in the papers, with difficulty and discrimination as the most common indicators. Item Response Theory (IRT) is the most commonly used technique; however, some studies have used different traditional learning algorithms such as Random Forest, Neural Networks, and Regression. Other indicators, such as time, grade, and number of attempts, were also estimated. Owing to the few studies on content modeling using machine learning algorithms based on interactions, this study presents new lines of research based on the results obtained in the literature review.

Based on an Overview of Crack Detection

This Crack detection, as an important part of concrete structural health monitoring, aims to reflect the stress state and damage degree of the structure. Traditional concrete crack detection mainly relies on manual visual identification, which has low detection efficiency and accuracy. In addition, manual visual detection has problems such as being greatly affected by lighting conditions, being unable to cover overhead locations such as bridge towers and high piers, and being highly subjective. In recent years, in order to solve the above problems, researchers at home and abroad have developed concrete crack detection equipment based on digital image technology, such as inspection vehicles equipped with high-resolution cameras, unmanned aerial vehicles, crawling robots, and so on. Meanwhile, efficient and accurate crack detection algorithms are the basis for realizing accurate crack identification. How to balance the detection speed and accuracy has been the focus of academic attention. This paper reviews the research progress of concrete crack detection equipment based on digital image technology at home and abroad in recent years, including camera platform, calibration method, preprocessing, traditional and deep learning algorithms, crack feature extraction, image stitching, and 3D representation and monitoring of cracks. In addition, the deficiencies in the research are summarized.

Learning strategies for underwater robot autonomous manipulation control

Autonomous manipulation operations represent the high intelligent coordination from robotic vision and control, it is also a symbol of the advances of robotic intelligence. The limitations of visual sensing and the increasingly complex experimental conditions make autonomous manipulation operations more difficult, particularly for deep reinforcement learning methods, which can enhance robotic control intelligence but require a lot of training process. Due to the high-dimensional continuous state space and continuous action space characteristics of underwater operations, this paper adopts a policy-based reinforcement learning method as the foundational approach. To address the issues of instability and low convergence efficiency in traditional policy-based reinforcement learning algorithms during the learning process, this paper proposes a novel policy learning method. This method adopts the Proximal Policy Optimization algorithm (PPOClip) and optimizes it through an actor-critic network. The aim is to improve the stability and effectiveness of convergence in the learning process. In the underwater training environment, a new reward shaping scheme has been designed to address the issue of reward sparsity during the training process. The manually crafted dense reward function is utilized as attractive and repulsive potential functions for goal manipulation and obstacle avoidance. On the highly complex underwater manipulation and training environment, transferred learning algorithm has been established to reduce the training times and compensate the differences between the simulation and experiment. Simulations and tank experiments have verified the performance of the proposed strategy learning method.

Novel cloud-AIoT fault diagnosis for industrial diesel generators based hybrid deep learning CNN-BGRU algorithm

The industrial diesel generator is essential to provide electric power during emergencies and requires accurate failure diagnosis in preventative maintenance services. This research presents a novel AIoT system-based hybrid deep learning algorithm for online monitoring of the anomaly conditions of 125 kW/250 kW industrial generators. Firstly, the IoT modules with different precise sensors are developed to be installed on 125 kW and 250 kW industrial generators to simulate other faults conditions in the laboratory. Then, the supervised learning operations are deployed to train deep learning algorithms with collected labeled data. The proposed algorithm, a hybrid convolution neural network bidirectional gate recurrent unit (CNN-BGRU), is deployed to extract deep features from long sequential historical signals and classify the anomaly conditions. The experiments in different 10 s, 20 s, and 30 s sampling frequencies are performed to evaluate and analyze with various benchmarks, which demonstrate efficiencies of the proposed CNN-BGRU method with other traditional deep learning algorithms, including RNN, CNN, GRU, LSTM, BRNN, and BGRU methods. The proposed hybrid method accomplishes the supreme augmentation of 29.43 % loss, 36.55 % validating loss, 25.86 % MAE, 27.00 % validating MAE, 16.78 % MSE, 20.64 % validating MSE, 6.36 % Pre, 25.34 % validating Pre, 17.30 % Rec, and 26.91 % validating Rec compared with state-of-the-art approaches. The AIoT system-based hybrid CNN-BGRU algorithm provides better improvement and higher accuracy in fault diagnosis of firefighting pumps for maintenance service in Industry 4.0.

IInception-CBAM-IBiGRU based fault diagnosis method for asynchronous motors

Aiming at the problems of insufficient extraction of asynchronous motor fault features by traditional deep learning algorithms and poor diagnosis of asynchronous motor faults in robust noise environments, this paper proposes an end-to-end fault diagnosis method for asynchronous motors based on IInception-CBAM-IBiGRU. The method first uses a signal-to-grayscale image conversion method to convert one-dimensional vibration signals into two-dimensional images and initially extracts shallow features through two-dimensional convolution; then the Improved Inception (IInception) module is used as a residual block to learning features at different scales with a residual structure, and extracts its important feature information through the Convolutional Block Attention Module (CBAM) to extract important feature information and adjust the weight parameters; then the feature information is input to the Improved Bi-directional Gate Recurrent Unit (IBiGRU) to extract its timing features further; finally, the fault identification is achieved by the SoftMax function. The primary hyperparameters in the model are optimized by the Weighted Mean Of Vectors Algorithm (INFO). The experimental results show that the method is effective in fault diagnosis of asynchronous motors, with an accuracy rate close to 100%, and can still maintain a high accuracy rate under the condition of low noise ratio, with good robustness and generalization ability.

Can Generative AI Models Extract Deeper Sentiments as Compared to Traditional Deep Learning Algorithms?

Can Generative AI Models Extract Deeper Sentiments as Compared to Traditional Deep Learning Algorithms?

Stretchable spring‐sheathed yarn sensor for 3D dynamic body reconstruction assisted by transfer learning

AbstractA wearable sensing system that can reconstruct dynamic 3D human body models for virtual cloth fitting is highly important in the era of information and metaverse. However, few research has been conducted regarding conformal sensors for accurately measuring the human body circumferences for dynamic 3D human body reshaping. Here, we develop a stretchable spring‐sheathed yarn sensor (SSYS) as a smart ruler, for precisely measuring the circumference of human bodies and long‐term tracking the movement for the dynamic 3D body reconstruction. The SSYS has a robust property, high resilience, high stability (>18 000), and ultrafast response (12 ms) to external deformation. It is also washable, wearable, tailorable, and durable for long‐time wearing. Moreover, geometric, and mechanical behaviors of the SSYS are systematically investigated both theoretically and experimentally. In addition, a transfer learning algorithm that bridges the discrepancy of real and virtual sensing performance is developed, enabling a small body circumference measurement error of 1.79%, noticeably lower than that of traditional learning algorithm. Furtherly, 3D human bodies that are numerically consistent with the actual bodies are reconstructed. The 3D dynamic human body reconstruction based on the wearing sensing system and transfer learning algorithm enables excellent virtual fitting and shirt customization in a smart and highly efficient manner. This wearable sensing technology shows great potential in human‐computer interaction, intelligent fitting, specialized protection, sports activities, and human physiological health tracking.image

Electric vehicle charging navigation strategy in coupled smart grid and transportation network: A hierarchical reinforcement learning approach

Most of the existing electric vehicle (EV) charging navigation methods do not simultaneously take into account the electric vehicle charging destination optimization and path planning. Moreover, they are unable to provide online real-time decision-making under a variety of uncertain factors. To address these problems, this paper first establishes a bilevel stochastic optimization model for EV charging navigation considering various uncertainties, and then proposes an EV charging navigation method based on the hierarchical enhanced deep Q network (HEDQN) to solve the above stochastic optimization model in real-time. The proposed HEDQN contains two enhanced deep Q networks, which are utilized to optimize the charging destination and charging route path of EVs, respectively. Finally, the proposed method is simulated and validated in two urban transportation networks. The simulation results demonstrate that compared with the Dijkstra shortest path algorithm, single-layer deep reinforcement learning algorithm, and traditional hierarchical deep reinforcement learning algorithm, the proposed HEDQN algorithm can effectively reduce the total charging cost of electric vehicles and realize online real-time charging navigation of electric vehicles, that shows excellent generalization ability and scalability.

Continual Reinforcement Learning for Quadruped Robot Locomotion.

The ability to learn continuously is crucial for a robot to achieve a high level of intelligence and autonomy. In this paper, we consider continual reinforcement learning (RL) for quadruped robots, which includes the ability to continuously learn sub-sequential tasks (plasticity) and maintain performance on previous tasks (stability). The policy obtained by the proposed method enables robots to learn multiple tasks sequentially, while overcoming both catastrophic forgetting and loss of plasticity. At the same time, it achieves the above goals with as little modification to the original RL learning process as possible. The proposed method uses the Piggyback algorithm to select protected parameters for each task, and reinitializes the unused parameters to increase plasticity. Meanwhile, we encourage the policy network exploring by encouraging the entropy of the soft network of the policy network. Our experiments show that traditional continual learning algorithms cannot perform well on robot locomotion problems, and our algorithm is more stable and less disruptive to the RL training progress. Several robot locomotion experiments validate the effectiveness of our method.

Improvement of operation and maintenance efficiency of power transformers based on knowledge graphs

AbstractCurrently, the digital transformation of the power grid is underway, and the intelligent health management technology for power transformers is rapidly advancing. However, there are issues in the operation and maintenance process, such as weak information correlation and low decision‐making efficiency. Knowledge graphs have been applied in other industrial fields, such as spacecraft maintenance, to significantly improve knowledge query efficiency. However, there is a lack of literature on knowledge graph construction in the field of power transformer operation and maintenance. Additionally, there is limited publicly available data and difficulties in effectively mining operation and maintenance knowledge in this field. A method for constructing a knowledge graph for power transformer operation and maintenance based on ALBERT is proposed. Firstly, publicly available literature in the field of power transformers is collected, and a sample enhancement method using regular matching is used to enrich the semi‐structured corpora, such as power system accident investigation reports, to construct a training dataset for power transformer operation and maintenance. Then, the ALBERT‐BiLSTM‐CRF deep learning algorithm is applied to extract power transformer operation and maintenance entities from the relevant literature and accident investigation reports, and this method is compared with traditional deep learning algorithms to demonstrate its superiority. Subsequently, the ALBERT‐BiLSTM‐Attention deep learning algorithm, which incorporates ALBERT and attention mechanism, is utilised to extract relationships between power transformer operation and maintenance entities. Compared to other deep learning algorithms, this algorithm demonstrates better performance in the domain‐specific texts of power transformer operation and maintenance. Finally, the Neo4j graph database is used to visualise and present the knowledge graph, enabling decision support based on the power transformer operation and maintenance knowledge graph.

Event-Driven Spiking Learning Algorithm Using Aggregated Labels.

Traditional spiking learning algorithm aims to train neurons to spike at a specific time or on a particular frequency, which requires precise time and frequency labels in the training process. While in reality, usually only aggregated labels of sequential patterns are provided. The aggregate-label (AL) learning is proposed to discover these predictive features in distracting background streams only by aggregated spikes. It has achieved much success recently, but it is still computationally intensive and has limited use in deep networks. To address these issues, we propose an event-driven spiking aggregate learning algorithm (SALA) in this article. Specifically, to reduce the computational complexity, we improve the conventional spike-threshold-surface (STS) calculation in AL learning by analytical calculating voltage peak values in spiking neurons. Then we derive the algorithm to multilayers by event-driven strategy using aggregated spikes. We conduct comprehensive experiments on various tasks including temporal clue recognition, segmented and continuous speech recognition, and neuromorphic image classification. The experimental results demonstrate that the new STS method improves the efficiency of AL learning significantly, and the proposed algorithm outperforms the conventional spiking algorithm in various temporal clue recognition tasks.

Maize Leaf Compound Disease Recognition Based on Attention Mechanism

In addition to the conventional situation of detecting a single disease on a single leaf in corn leaves, there is a complex phenomenon of multiple diseases overlapping on a single leaf (compound diseases). Current research on corn leaf disease detection predominantly focuses on single leaves with single diseases, with limited attention given to the detection of compound diseases on a single leaf. However, the occurrence of compound diseases complicates the accuracy of traditional deep learning algorithms for disease detection, necessitating the exploration of new models for the identification of compound diseases on corn leaves. To achieve rapid and accurate identification of compound diseases in corn fields, this study adopts the YOLOv5s model as the base network, chosen for its smaller size and faster detection speed. We propose a corn leaf compound disease recognition method, YOLOv5s-C3CBAM, based on an attention mechanism. To address the challenge of limited data for corn leaf compound diseases, a CycleGAN model is employed to generate synthetic images. The scarcity of real data is thereby mitigated, facilitating the training of deep learning models with sufficient data. The YOLOv5s model is selected as the base network, and an attention mechanism is introduced to enhance the network’s focus on disease lesions while mitigating interference from compound diseases. This augmentation results in improved recognition accuracy. The YOLOv5s-C3CBAM compound disease recognition model, incorporating the attention mechanism, achieves an average precision of 83%, an F1 score of 81.98%, and a model size of 12.6 Mb. Compared to the baseline model, the average precision is improved by 3.1 percentage points. Furthermore, it outperforms Faster R-CNN and YOLOv7-tiny models by 27.57 and 2.7 percentage points, respectively. This recognition method demonstrates the ability to rapidly and accurately identify compound diseases on corn leaves, offering valuable insights for future research on precise identification of compound agricultural crop diseases in field conditions.

CNN-based Occluded Person Re-identification in a Multi Camera Environment

In the context of rising global urban security concerns and the growing use of surveillance cameras, this study aims to enhance individual identification accuracy in occlusion scenarios using deep learning. Four CNN-based models for person re-identification are analyzed and put into practice. Additionally, comparative studies are conducted, and the model’s performance is assessed using the Market-1501 and Occluded-Reid datasets. We propose the use of ensemble learning and convolutional neural networks (CNNs) to address occlusion issues. Our results show that the ensemble approach performs better in re-identification tasks than traditional deep learning algorithms with an improvement of 1%–2% in mAP and Rank-1 scores, respectively.

Federated Learning for Intrusion Detection Systems in Internet of Vehicles: A General Taxonomy, Applications, and Future Directions

In recent years, the Internet of Vehicles (IoV) has garnered significant attention from researchers and automotive industry professionals due to its expanding range of applications and services aimed at enhancing road safety and driver/passenger comfort. However, the massive amount of data spread across this network makes securing it challenging. The IoV network generates, collects, and processes vast amounts of valuable and sensitive data that intruders can manipulate. An intrusion detection system (IDS) is the most typical method to protect such networks. An IDS monitors activity on the road to detect any sign of a security threat and generates an alert if a security anomaly is detected. Applying machine learning methods to large datasets helps detect anomalies, which can be utilized to discover potential intrusions. However, traditional centralized learning algorithms require gathering data from end devices and centralizing it for training on a single device. Vehicle makers and owners may not readily share the sensitive data necessary for training the models. Granting a single device access to enormous volumes of personal information raises significant privacy concerns, as any system-related problems could result in massive data leaks. To alleviate these problems, more secure options, such as Federated Learning (FL), must be explored. A decentralized machine learning technique, FL allows model training on client devices while maintaining user data privacy. Although FL for IDS has made significant progress, to our knowledge, there has been no comprehensive survey specifically dedicated to exploring the applications of FL for IDS in the IoV environment, similar to successful systems research in deep learning. To address this gap, we undertake a well-organized literature review on IDSs based on FL in an IoV environment. We introduce a general taxonomy to describe the FL systems to ensure a coherent structure and guide future research. Additionally, we identify the relevant state of the art in FL-based intrusion detection within the IoV domain, covering the years from FL’s inception in 2016 through 2023. Finally, we identify challenges and future research directions based on the existing literature.