Traditional Neural Network Algorithm Research Articles

Adaptive deep learning models for efficient multivariate anomaly detection in IoT infrastructures

Adapting machine learning-based systems to dynamic environments poses significant challenges due to their diverse and rapidly changing nature. Traditional Deep Neural Network (DNN) algorithms often struggle to cope effectively with such variations. This paper presents a novel evolutionary algorithm named Double Evaluation Genetic Evolution (DEGE), specifically tailored to evolve DNNs within dynamic contexts. DEGE represents a pioneering approach in evolutionary computing, focusing on the adaptive evolution of DNN structures across generations. This adaptability plays a crucial role in enabling DNNs to seamlessly adjust to evolving environmental conditions and complexities. To evaluate the efficacy of DEGE, we apply it to the domain of anomaly detection, rigorously testing the adapted DNNs within this specific context. Furthermore, we conduct comparative analyses between DEGE and established optimization methods using standard metrics to elucidate its advantages. Our findings shed light on DEGE’s effectiveness in addressing the challenges posed by dynamic environments, indicating its potential to revolutionize DNN optimization. As a practical application, we integrate DEGE-based DNNs into an IoT anomaly detection system to assess the overall impact of DEGE on anomaly detection performance. Our experiments demonstrate the efficiency of DEGE across 10 generations, showcasing its high adaptability to the dynamism inherent in IoT infrastructures. The proposed DEGE-based anomaly detection system processes highly dynamic environments within IoT infrastructure and classifies/predicts different types of anomalies efficiently with 99% detection accuracy across multiple benchmark and live experiment datasets. Solving the problem of multiclassification in dynamic abnormality detection, the proposed DEGE-based anomaly detection system was highly adaptable to the environment across generations, reaching the optimal DNN structure that delivers the best accuracy, and precision, with minimum loss value.

Research on temperature prediction model of molten steel of tundish in continuous casting

To achieve the desired superheat of molten steel during the continuous casting process, optimization of process parameters such as molten steel temperature in ladle furnace, casting speed, and baking temperature is necessary. Therefore, obtaining the superheat corresponding to these process parameters in advance is particularly important. To address this issue, a model for predicting the temperature of molten steel in the tundish during continuous casting is designed. The model adopts a combined modeling approach of mechanistic model and data model. To address the issue of the mechanism model’s inability to capture the variation of the lining’s thermal parameters, this article improves the traditional physics-informed neural network (PINN) algorithm. It combines the constraints from both the forward and inverse problems, allowing for obtaining solutions to the equations while capturing the variation of equation parameters. Actual data from multiple casting sequences at a steel plant are collected to validate the accuracy and interpretability of the model. The results show that the error of the model is about 2.1k which has better accuracy compared to pure mechanistic model and pure data model. Additionally, it can capture the variation patterns of tundish lining thermal parameters under different operating conditions. Therefore, the model designed in this article can provide both profound physical interpretation ability and more practical predictions of molten steel temperature.

Advances in Gas Detection of Pattern Recognition Algorithms for Chemiresistive Gas Sensor.

Gas detection and monitoring are critical to protect human health and safeguard the environment and ecosystems. Chemiresistive sensors are widely used in gas monitoring due to their ease of fabrication, high customizability, mechanical flexibility, and fast response time. However, with the rapid development of industrialization and technology, the main challenges faced by chemiresistive gas sensors are poor selectivity and insufficient anti-interference stability in complex application environments. In order to overcome these shortcomings of chemiresistive gas sensors, the pattern recognition method is emerging and is having a great impact in the field of sensing. In this review, we focus systematically on the advancements in the field of data processing methods for feature extraction, such as the methods of determining the characteristics of the original response curve, the curve fitting parameters, and the transform domain. Additionally, we emphasized the developments of traditional recognition algorithms and neural network algorithm in gas discrimination and analyzed the advantages through an extensive literature review. Lastly, we summarized the research on chemiresistive gas sensors and provided prospects for future development.

Study on Talent Cultivation Management Model of Universities Based on Fuzzy Neural Network Algorithm

The Talent Cultivation Management Model for Universities represents a strategic framework designed to optimize the development and oversight of academic programs. This model focuses on identifying, nurturing, and assessing talents within the university ecosystem. It incorporates innovative methodologies to align educational offerings with individual needs and career goals. This study presents an innovative approach to developing a talent cultivation management model for universities, leveraging the integration of the Fuzzy Neural Network Algorithm with the proposed Optimized Spider Monkey Fuzzy Neural Network (OSMF-NN). Recognizing the critical importance of talent development in higher education, this research seeks to enhance the efficacy and adaptability of existing management models. The OSMF-NN algorithm, inspired by the optimization capabilities of spider monkey behavior, enhances the traditional fuzzy neural network algorithm, enabling more precise and efficient talent management. By harnessing the synergies between fuzzy logic and neural networks, the proposed model offers a robust framework for identifying, nurturing, and evaluating talents within the university ecosystem. Through comprehensive experimentation and validation, this study demonstrates the effectiveness of the OSMF-NN algorithm in optimizing talent cultivation strategies, promoting personalized learning experiences, and fostering student success in higher education institutions.

Neural-based fixed-time composite learning control for multiagent systems with intermittent faults

In this paper, a distributed fixed-time composite learning control problem is addressed for nonlinear multiagent systems (MASs) subject to intermittent actuator faults. First, a distributed estimator is constructed for followers that are unable to communicate directly with the leader. Then, instead of using the traditional adaptive neural network (NN) algorithm, a predictor-based composite learning technique is proposed, which incorporates the prediction error into the NN update law to enhance the estimation accuracy of the unknown nonlinearity. Furthermore, an adaptive fault-tolerant control compensation mechanism is developed for intermittent faults that may occur indefinitely and frequently. To guarantee that all signals of the closed-loop system are bounded in fixed time, a nonsingular fixed-time fault-tolerant controller in the form of quadratic function is established. Finally, simulation results confirm the effectiveness of the presented algorithm.

Neural Network Classification Algorithm Based on Self-attention Mechanism and Ensemble Learning for MASLD Ultrasound Images

BackgroundUltrasound image examination has become the preferred choice for diagnosing metabolic dysfunction-associated steatotic liver disease (MASLD) due to its non-invasive nature. Computer-aided diagnosis (CAD) technology can assist doctors in avoiding deviations in the detection and classification of MASLD. MethodWe propose a hybrid model that integrates the pre-trained VGG16 network with an attention mechanism and a stacking ensemble learning model, which is capable of multi-scale feature aggregation based on the self-attention mechanism and multi-classification model fusion (Logistic regression, random forest, support vector machine) based on stacking ensemble learning. The proposed hybrid method achieves four classifications of normal, mild, moderate, and severe fatty liver based on ultrasound images. Result and conclusionOur proposed hybrid model reaches an accuracy of 91.34% and exhibits superior robustness against interference, which is better than traditional neural network algorithms. Experimental results show that, compared with the pre-trained VGG16 model, adding the self-attention mechanism improves the accuracy by 3.02%. Using the stacking ensemble learning model as a classifier further increases the accuracy to 91.34%, exceeding any single classifier such as LR (89.86%) and SVM (90.34%) and RF (90.73%). The proposed hybrid method can effectively improve the efficiency and accuracy of MASLD ultrasound image detection.

Neuro-Fuzzy Framework for Fault Prediction in Electrical Machines via Vibration Analysis

The advent of Industry 4.0 has ushered in a new era of technological advancements, particularly in integrating information technology with physical devices. This convergence has given rise to smart devices and the Internet of Things (IoT), revolutionizing industrial processes. However, despite the push towards predictive maintenance, there still is a significant gap in fault prediction algorithms for electrical machines. This paper proposes a signal spectrum-based machine learning approach for fault prediction, specifically focusing on bearing faults. This study compares the effectiveness of traditional neural network algorithms with a novel approach integrating fuzzy logic. Through extensive experimentation and analysis of vibration spectra from various mechanical faults in bearings, it is demonstrated that the fuzzy-neuro network model outperforms traditional neural networks, achieving a validation accuracy of 99.40% compared to 94.34%. Incorporating fuzzy logic within the neural network framework offers advantages in handling complex fault combinations, showing promise for applications requiring higher accuracy in fault detection. While initial results are encouraging, further validation with more complex fault scenarios and additional fuzzy layers is recommended to fully explore the potential of fuzzy-neuro networks in fault prediction for electrical machines.

Financial market trend prediction model based on LSTM neural network algorithm

The financial market has randomness, and the prediction of the financial market is an important task in the financial market. In traditional financial market prediction models, the prediction results are often unsatisfactory. So it needs to introduce new models for financial analysis. To solve this problem, this paper analyzed a financial market trend prediction model based on LSTM (Long Short-Term Memory) NN (Neural Network) algorithm, and conducted an empirical analysis on the Shanghai stock index dataset. This paper first introduced the LSTM NN algorithm, and then divided it into training set, test set and comparison set according to the data characteristics. At last, this paper used the data preprocessing method to verify the LSTM NN algorithm. The experimental results showed that the LSTM NN algorithm analyzed in this paper can effectively improve the generalization ability of financial market trend prediction models while ensuring the prediction accuracy. Through experimental analysis, this paper found that the average accuracy rate of using LSTM NN algorithm was 2.25% higher than that of using traditional NN algorithm. This research is primarily aimed at developing effective methods for predicting stock market trends in the continuously evolving Chinese securities market. The core objective is to empower investors with precise guidance by enabling them to make well-informed investment decisions. Achieving accurate predictions holds the potential to significantly impact economic operations in a positive way. Therefore, this research direction is of paramount importance, offering substantial value both in academic exploration and practical application.

Non-speech emotion recognition based on back propagation feed forward networks

Non-speech emotion recognition involves identifying emotions conveyed through non-verbal vocalizations such as laughter, crying, and other sound signals, which play a crucial role in emotional expression and transmission. This paper employs a nine-category discrete emotion model encompassing happy, sad, angry, peaceful, fearful, loving, hateful, brave, and neutral. A proprietary non-speech dataset comprising 2337 instances was utilized, with 384-dimensional feature vectors extracted. The traditional Backpropagation Neural Network (BPNN) algorithm achieved a recognition rate of 87.7% on the non-speech dataset. In contrast, the proposed Whale Optimization Algorithm - Backpropagation Neural Network (WOA-BPNN) algorithm, applied to a self-made non-speech dataset, demonstrated a remarkable accuracy of 98.6%. Notably, even without facial emotional cues, non-speech sounds effectively convey dynamic information, and the proposed algorithm excels in their recognition. The study underscores the importance of non-speech emotional signals in communication, especially with the continuous advancement of artificial intelligence technology. The abstract thus encapsulates the paper’s focus on leveraging AI algorithms for high-precision non-speech emotion recognition.

Research on Ferrographic Image Fault Diagnosis Based on Channel Overlapping Technique and Information Fusion Mechanism

Abstract Utilizing computer technology to realize the application of ferrographic intelligent fault diagnosis technology is a foundational investigation to oversee the operations of mechanical equipment. To continuously improve the accuracy of artificial intelligence recognition, the complexity and computation of the model will be increased. The proposal of the transformer model (the core technology of chatgpt) has fundamentally changed the intelligence level of artificial intelligence, but it has also greatly increased the demand for computer computing power. What's more, it is difficult to equip industrial quality inspection sites with high computing power computers. The channel overlapping technique developed in this paper is a technology to segment the three channels of image information and reserve overlapping areas for an information communication mechanism. With this mechanism, the model location channel overlapping convolutional neural network can obtain high recognition accuracy by using only one-half of the original training computing power. When channel overlapping combines with no position information, information fusion is formed. The model channel overlapping technique fusion convolutional neural network established by the information fusion mechanism will get a higher prediction accuracy through joint training with the original image. However, the computation consumption is nearly one-third of the pure traditional convolutional neural network algorithm.

Extreme Learning Machine Classification Method based on Twin Strategy Salp Swarm Algorithm

Extreme Learning Machines (ELM) are a type of Single Hidden Layer Feedforward Neural Network (SLFN). In recent years, they have attracted attention for their powerful approximation ability and fast learning speed. Compared with traditional neural network algorithms, ELM have the advantages of simple structure, fast learning speed, and good generalization performance. However, since the input weights and biases of ELM are randomly generated, there may be some suboptimal or unnecessary input weights and biases. In addition, ELM may require more hidden nodes, which may slow down its response to unknown test data. To address these issues, a twin strategy Salp Swarm Algorithm (TSSA) is proposed to increase the population diversity to improve the convergence speed of the algorithm through chaotic initialization, while shock inertia weights and learning paradigms are introduced into the follower position updating to enhance the stochasticity of the particles. Classification tests are conducted on six datasets using the proposed TSSA, and the experimental results show that the proposed TSSA-ELM has higher accuracy and better generalization performance than some existing ELM variants.

Exploring the Role of Artificial Intelligence in Multimodal Cultural Communication and Identification

Abstract Artificial intelligence technology has unique advantages in processing multimodal information such as images, videos and sounds, and plays an important role in the process of enhancing the effect of multimodal cultural communication. The Page Rank model is used to identify communication subjects based on the role of key communication subjects in cultural communication, as proposed in this paper. A genetic algorithm is utilized to improve the traditional neural network algorithm, so that it provides more accurate prediction results and countermeasures in the process of promoting cultural communication. The analysis shows that the OLMT algorithm has an average accuracy of 94.56% in a specific identification interval. The difference between the expected and actual output values of the improved neural network algorithm for the test samples was less than 0.7.

E-commerce consumption data prediction and privacy protection based on improved neural network algorithm

In today's shopping platform, some enterprises can use all commercial means to obtain users' personal information. How to protect the privacy of consumers has become an important issue. This paper discusses the shortcomings of the traditional neural network algorithm, and puts forward some countermeasures to improve it. Based on the basic principle of standard neural network, a new improved algorithm is developed according to the needs of this paper. The basic principle of the algorithm is based on the added momentum method. This paper mainly uses data models to collect and organize user data through user behavior patterns, so as to prove that the record of target user data cannot predict the possibility of user transportation and consumption, so as to better promote the improvement of transactions and services through these data models.

A friction temperature model for dynamic bearing operation based on neural network and genetic algorithm

This study used intelligent algorithms and experimental data to investigate the dynamic temperature of bearings. A test rig was created for angular contact ball bearings to measure the temperature of two bearings precisely while independently controlling rotational speed, axial load, radial load, and grease content. The study analyzed the steady temperature of bearings under different operating conditions using a friction temperature model based on SKF bearings. The bearings temperature was computed using traditional backpropagation neural network (BPNN) and genetic algorithms (GA). The study compared the results obtained through the SKF model and the actual temperature against those produced methods. GA displayed a higher level of accuracy and robustness. Upon evaluation, it was determined that both intelligent methods are suitable for processing variable data input. This article presents an intelligent approach to computing bearing temperature using statistical data analysis, which does not require analyzing dynamics, thermodynamics, or lubrication principles. The method's ability to compute transient temperature without boundary conditions or constraints makes it highly versatile. This feature renders it a valuable tool for bearing design and temperature control.

A Design of Apparel Appearance: Recognition and Evaluation of Clothing Pattern Styles under Deep Learning

Designing the appearance of clothing can effectively enhance its attractiveness and expand its marketability. This paper briefly introduces the Convolutional Neural Network (CNN) and applies it to the recognition and evaluation of clothing pattern styles to assist in evaluating clothing appearance design. A case analysis was then conducted. Firstly, the CNN algorithm was compared with the traditional Back-Propagation Neural Network (BPNN) algorithm, and then the design scheme proposed in this paper, called "Sanduo and Jiuru", was evaluated. The results showed that, compared to the BPNN algorithm, the CNN algorithm not only converged faster during training but also demonstrated superiority after the convergence became stable. In addition, the test set also verified the accuracy of the CNN algorithm in recognizing and evaluating clothing pattern styles. The evaluation of the "Sanduo and Jiuru" design was also very similar to human evaluation, and its excellence was analyzed accordingly.

The application of fault diagnosis techniques and monitoring methods in building electrical systems – based on ELM algorithm

The reliability of modern building electrical systems are receiving increasing attention as they become more intelligent and complex. As the majority of building electrical systems use neutral point grounding, earth faults or short circuits can get worse over time and damage both the distribution system and the electrical equipment. To this end, the corresponding three phases and four categories, namely three-phase voltage, three-phase current after fault, three-phase voltage distortion rate, three-phase current distortion rate, a total of 12 dimensional fault feature vectors and 10 fault simulation types, were summarised and extracted in conjunction with the actual operating conditions of the system. Using traditional fault identification ideas and neural network algorithm as reference, a 12-dimensional fault feature vector is used as the model input to construct a building electrical fault diagnosis and detection model based on ELM algorithm. Results showed that the ELM-based model’s classification accuracy for this experimental sample was 97.56 %, its AUC was 0.92, and its RMSE was 0.3521. These figures were higher than the classification accuracy and performance of the BP algorithm and GA-BP algorithm fault diagnosis models, and they also demonstrate better robustness and generalizability. The model also has a 97.27 % correct rate in fault discrimination, while the computation time is only 0.201 s, and its fault identification and diagnosis speed is faster than other algorithmic models. At the same time, this research model has a good fault monitoring accuracy of up to 98.6 % for building electrical systems. The research can provide a more sensitive, accurate and rapid fault monitoring method for the current building electrical system. It also improves the reliability of the building electrical system in a complex environment and achieves better protection of the system. This has a certain significance for the development of the building electrical industry.

Sea Cucumber Identification Fishing System Based on Hog Super Pixel Feature Extraction

Due to the refraction, reflection and absorption of light induced by seawater and suspended particles, the image recognition of underwater vehicle has the problem of low accuracy and difficult localization, and to solve this one problem, an improved LSTM classification algorithm (CH-LSTM) based on CLAHE and HOG is given. First, the improved CLAHE algorithm is used to enhance image by image noise removal and de-fogging, the problems of underwater image distortion, fine lines, and abrupt changes are solved in the aquaculture waters image. Then, the Histogram of Orientation Gradient (HOG) operator is used for feature extraction to describe the shape of sea cucumbers and generate feature vectors; finally, the LSTM algorithm is used to classify the feature vectors and avoid overfitting through memory gates, so the generalization ability of the model was enhanced. The identification and sorting experiments of underwater fishing sea cucumbers show that the proposed algorithm is superior, especially in the environment of poor water quality, and the identification and localization accuracy of sea cucumbers is improved compared with the traditional ground SVM and BP neural network algorithms, and the identification accuracy is above 95.28%.

Nonlinear model prediction of needle chlorophyll content of Picea koraiensis Nakai at different needle ages based on hyperspectral features

Pigment content is a critical assessment indicator in the study of plant physiological metabolism, stress resistance, ornamental characteristics, and forest health. Spectral imaging technology is widely used for rapid and non-destructive determination of plant physicochemical parameters. To address the shortcomings of previous models of spectral reflectance prediction of chlorophyll content of needles only from the perspective of traditional algorithms and ignoring physical models, this research integrates variable complexity and refined classification of physical models to validate the increased accuracy of both the conventional partial least squares (PLS) method and the traditional neural network algorithm. The results of the conifer chlorophyll models of Picea koraiensis Nakai with different needle ages based on spectral reflectance and vegetation index parameters showed that the improved nonlinear state transition algorithm-backpropagation (STA-BP) neural network model approach (R2 of 0.73–0.89) and the nonlinear Stacking partial least squares (Stacking-PLS) model approach (R2 of 0. 67–0.85) is slightly more robust than the traditional algorithms nonlinear BP model (R2 of 0.63–0.82) and linear PLS model (R2 of 0.60–0.76). This finding suggests that the nonlinear fitting of chlorophyll content in needles of different needle ages in P. koraiensis Nakai surpasses the traditional linear model fitting methodology. Furthermore, the model fitting of chlorophyll content in conifers of different needle ages outperforms the mixed P. koraiensis Nakai model, suggesting that chlorophyll models using needle refinement classification help to improve model robustness. This study provides data and theoretical support for rapid and non-invasive characterization of physiological and biochemical properties of needles of different needle ages using spectral imaging techniques to predict growth and community structure productivity of forest trees in the coming years.

Intelligent Fault Diagnosis of Rolling Bearings Using Efficient and Lightweight ResNet Networks Based on an Attention Mechanism (September 2022)

Focusing on the problems of complex structure and low feature extraction efficiency that exist in some traditional neural network algorithms, an improved convolutional neural network, combined with a convolutional attention mechanism, is proposed to im- prove the network feature extraction efficiency and reduce the network complexity. First, the convolutional block attention module (CBAM) was introduced, which can strengthen the extraction of useful features from the data, thereby improving the network feature extraction efficiency. Second, the residual structure was optimized, and the original multi-layer convolution was simplified to a single-layer convolution, which reduces the complexity of the model and improves the diagnostic efficiency. Then, the Rectified Linear Unit (ReLU) activation function in the model was replaced with the better-performing Exponential Linear Unit (ELU) activation function. Finally, the overall structure of the ResNet model was optimized. The CBAM-ResNet network model was based on the traditional ResNet18 model and consists of a CBAM module and the optimized ResNet18 model. Finally, experiments were performed using sensor data collected from rolling bearing test benches. The experimental results show that the feature extraction capability and efficiency of the new model are better than those of several other classic deep network models and the original network model, and this reduces the time complexity and model size while also maintaining a high accuracy rate.

Energy-saving street lamp system based on wireless sensor network

The purpose of this paper is to design a smart street lamp controscheme that uses wireless sensor networks to meet the needs of smartcity construction and to create energy-saving street lamps. First, the traditional neural network algorithm is enhanced to make it simple to dynamically adjust the brightness of the lamp node with ambient light. Secondly, the wireless sensor network technology based on Zigbee communication and the LabVIEW host computer program were combined to create the intelligent street lamp system. Finally, the software and hardware tests were carried out to realize the dynamic adjustment, remote control and data transmission of street lights. The results show that the lamps controlled by neural network can flexibly adjust the light intensity according to the ambient lighting and traffic flow. This method enables intelligent adjustment and energy saving.