Average Recognition Rate Research Articles

Facial Expression Recognition from Video Sequence Using Self Organizing Feature Map

Automatic analysis of facial expressions is rapidly becoming an area of intense interest in computer vision and artificial intelligence research communities. In this paper an approach is presented for facial expression recognition of the six basic prototype expressions (i.e., joy, surprise, anger, sadness, fear, and disgust) based on Facial Action Coding System (FACS). The approach utilizes the topological ordering patterns produced by Kohonen Self Organizing Map, in which implemented on expression image sequence for each prototype facial expression. The map will compute the topological relationship between the particular expression sequences, starting from the neutral expression to peak. This method tried to find a topological ordering pattern (shape) for each expression; it will not require any pre-processing tedious work such as normalization. The only requirement is that, image background must be kept constant, also with non-rigid head motion. The feature extraction phase had been performed by this method, while the classification phase done by especially designed procedures for shape and direction finding to recognize the pattern of the shape, thereafter the type of the expression also backpropagation neural network is implemented for the classification task. An average recognition rate of 88.7% was achieved for six basic expressions, where different databases had been used for the test of the method.

Research on Action Recognition Method of Dance Video Image Based on Human-Computer Interaction

Human-computer interaction technology simplifies the complicated procedures, which aims at solving the problems of inadequate description and low recognition rate of dance action, studying the action recognition method of dance video image based on human-computer interaction. This method constructs the recognition process based on human-computer interaction technology, constructs the human skeleton model according to the spatial position of skeleton, motion characteristics of skeleton, and change angles of skeleton, describes the dance posture features by generating skeleton node graph, and extracts the key frames of dance video image by using the clustering algorithm to recognize the dance action. The experimental results show that the recognition rate of this method under different entropy values is not less than 88%. Under the test conditions of complex, dark, bright, and multiuser interference, this method can make the model to describe the dance posture accurately. Furthermore, the average recognition rates are 93.43%, 91.27%, 97.15%, and 89.99%, respectively. It is suitable for action recognition of most dance video images.

Ship Target Recognition Under Different Sunlight Intensity

<p indent=0mm>In the case of surface target monitoring, the clarity of the ship target often varies with the reflection intensity of the sea surface under different sunlight intensity, which will lead to the unstable recognition rate of the ship target and increase the false alarm rate. For this reason, the ship target recognition algorithm based on ResNet-50 is proposed. Firstly, it uses ResNet-50 network to extract image feature information and applies sunlight robust loss constraint to the features before and after sunlight intensity change to reduce the feature difference. Then, it uses gray-scale histogram to calculate the statistical matrices of features to obtain six features: light contrast, brightness, smoothness, information, third-order matrices and entropy, and generates new feature vector to apply sunlight robust loss constraint to the features before and after sunlight intensity change again. Finally, the two constraints are combined to form a loss function and trained to optimize the optimal weights using Bayesian adaptive hyperparameters. The experimental results show that the average recognition rate of the database for ship sunlight variation reaches 90.47%, which is about 4.00% higher than that before the improvement, and the recognition rate of ship images with sunlight variation of 25, 65 and 80 increases by 3.14%, 6.07% and 16.41%, which shows that the algorithm has a good constraint effect on sunlight variation and the recognition rate is significantly improved.

Human Behavior Recognition Method based on Two-layer LSTM Network with Attention Mechanism

Aiming at the problem that the exiting human skeleton-based action recognition methods cannot fully extract the relevant information before and after the action, resulting in low utilization efficiency of skeleton points, we propose a two-layer LSTM (long short term memory) network with attention mechanism. The network has two layers, the first LSTM network is used for skeleton coding and initialization of system storage units and the second LSTM network integrates attention mechanism to further process the data of the first layer network. An algorithm is designed to assign different weights to skeleton points according to the importance of human body, which greatly increases the recognition accuracy. Action classification is accomplished by multiple support vector machines. Through training and testing, the average recognition rate of 98.5% is achieved on KTH dataset. The experimental result shows that the proposed method is effective in human behavior recognition.

An Adaptive, Affordable, Open-Source Robotic Hand for Deaf and Deaf-Blind Communication Using Tactile American Sign Language.

Currently, ~ 1.5 million American deaf-blind individuals depend on the availability of interpreting services to communicate in their primary conversational language, tactile American Sign Language (ASL). In an effort to give the deaf-blind community access to a device that facilitates independent communication using tactile ASL, we developed TATUM (Tactile ASL Translational User Mechanism). TATUM employs 15 degrees of actuation in a hand-wrist system that is capable of signing the 26-letter ASL alphabet. Leveraging Interpres, an independent cloud-based service, all servo sequences that render desired fingerspelled letters and ASL words are stored in a web application programming interface (API). A validation study including both deaf and deaf-blind participants confirmed that the TATUM hand mimics a human hand both in size and feel. The current design of TATUM attained an average recognition rate of 94.7% in visual validation, indicative of the potential to support deaf and deaf-blind individuals in communicating via visual and tactile ASL.

An Action Recognition Method for Volleyball Players Using Deep Learning

This paper investigates the extraction of volleyball players’ skeleton information and provides a deep learning-based solution for recognizing the players’ actions. For this purpose, the convolutional neural network-based approach for recognizing volleyball players’ actions is used. The Lie group skeleton has a large data dimension since it is used to represent the features retrieved from the model. The convolutional neural network is used for feature learning and classification in order to process high-dimensional data, minimize the complexity of the recognition process, and speed up the calculation. This paper uses the Lie group skeleton representation model to extract the geometric feature of the skeleton information in the feature extraction stage and the geometric transformation (rotation and translation) between different limbs to represent the volleyball players’ movements in the feature representation stage. The approach is evaluated using the datasets Florence3D actions, MSR action pairs, and UTKinect action. The average recognition rate of our method is 93.00%, which is higher than that of the existing literature with high attention and reflects better accuracy and robustness.

Analysis and Recognition of Human Lower Limb Motions Based on Electromyography (EMG) Signals

Background: This paper focuses on the characteristics of lower limb EMG signals for common movements. Methods: We obtained length data for lower limb muscles during gait motion using software named OpenSim; statistical product and service solutions (SPSS) were utilized to study the correlation between each muscle, based on gait data. Low-correlation muscles in different regions were selected; inertial measurement unit (IMU) and EMG sensors were used to measure the lower limb angles and EMG signals when on seven kinds of slope, in five kinds of gait (walking on flat ground, uphill, downhill, up-step and down-step) and four kinds of movement (squat, lunge, raised leg and standing up). Results: After data denoising and feature extraction, we designed a double hidden-layer BP neural network to recognize the above motions according to EMG signals. Results show that EMG signals of selected muscles have a certain periodicity in the process of movement that can be used to identify lower limb movements. Conclusions: It can be seen, after the recognition of different proportions of training and testing sets that the average recognition rate of the BP neural network is 86.49% for seven gradients, 93.76% for five kinds of gait and 86.07% for four kinds of movements.

Using Artificial Intelligence to Achieve Auxiliary Training of Table Tennis Based on Inertial Perception Data.

Compared with optical sensors, wearable inertial sensors have many advantages such as low cost, small size, more comprehensive application range, no space restrictions and occlusion, better protection of user privacy, and more suitable for sports applications. This article aims to solve irregular actions that table tennis enthusiasts do not know in actual situations. We use wearable inertial sensors to obtain human table tennis action data of professional table tennis players and non-professional table tennis players, and extract the features from them. Finally, we propose a new method based on multi-dimensional feature fusion convolutional neural network and fine-grained evaluation of human table tennis actions. Realize ping-pong action recognition and evaluation, and then achieve the purpose of auxiliary training. The experimental results prove that our proposed multi-dimensional feature fusion convolutional neural network has an average recognition rate that is 0.17 and 0.16 higher than that of CNN and Inception-CNN on the nine-axis non-professional test set, which proves that we can better distinguish different human table tennis actions and have a more robust generalization performance. Therefore, on this basis, we have better realized the enthusiast of table tennis the purpose of the action for auxiliary training.

Recognition of Badminton Shot Action Based on the Improved Hidden Markov Model.

In recent years, with the rapid development of sports, the number of people playing various sports is increasing day by day. Among them, badminton has become one of the most popular sports because of the advantages of fewer restrictions on the field and ease of learning. This paper develops a wearable sports activity classification system for accurately recognizing badminton actions. A single acceleration sensor fixed on the end of the badminton racket handle is used to collect the data of the badminton action. The sliding window segmentation technique is used to extract the hitting signal. An improved hidden Markov model (HMM) is developed to identify standard 10 badminton strokes. These include services, forehand chop, backhand chop the goal, the forehand and backhand, forehand drive, backhand push the ball, forehand to pick, pick the ball backhand, and forehand. The experimental results show that the model designed can recognize ten standard strokes in real time. Compared with the traditional HMM, the average recognition rate of the improved HMM is improved by 7.3%. The comprehensive recognition rate of the final strokes can reach up to 95%. Therefore, this model can be used to improve the competitive level of badminton players.

A Convolutional Neural Network Algorithm for the Optimization of Emergency Nursing Rescue Efficiency for Critical Patients.

In order to help pathologists quickly locate the lesion area, improve the diagnostic efficiency, and reduce missed diagnosis, a convolutional neural network algorithm for the optimization of emergency nursing rescue efficiency of critical patients was proposed. Specifically, three convolution layers and convolution kernels of different sizes are used to extract the features of patients' posture behavior, and the classifier of patients' posture behavior recognition system is used to learn the feature information by capturing the nonlinear relationship between the features to achieve accurate classification. By testing the accuracy of patient posture behavior feature extraction, the recognition rate of a certain action, and the average recognition rate of all actions in the patient body behavior recognition system, it is proved that the convolution neural network algorithm can greatly improve the efficiency of emergency nursing. The algorithm is applied to the patient posture behavior detection system, so as to realize the identification and monitoring of patients and improve the level of intelligent medical care. Finally, the open source framework platform is used to test the patient behavior detection system. The experimental results show that the larger the test data set is, the higher the accuracy of patient posture behavior feature extraction is, and the average recognition rate of patient posture behavior category is 97.6%, thus verifying the effectiveness and correctness of the system, to prove that the convolutional neural network algorithm has a very large improvement of emergency nursing rescue efficiency.

Accurate recognition of object contour based on flexible piezoelectric and piezoresistive dual mode strain sensors

The application of flexible wearable sensors in the grasping process of robot hand can recognize the contour, soft and hard, material, surface temperature and other information of the grasping object, which can effectively improve the intelligent level of the robot. In this work, a method of object contour recognition is proposed by combining the flexible PVDF polymer piezoelectric sensor and high conductivity hydrogel piezoresistive sensor aiming at the problem of profile recognition for objects of the same or similar material. The response of flexible piezoresistive sensor to the static strain is used to sense the angular displacement of robot fingers, and then the shape and size of the object is recognized indirectly. At the same time, the flexible piezoelectric sensor is used as the fingertip tactile sensor to reflect the surface morphology of the object through the dynamic strain information when touching the object. In the whole process of grasping the object, the dual-mode strain information is fully used to realize the recognition of the shape, size and surface morphology of the object. Combining these information, the accurate recognition of the object contour can be further realized. In the experiments, six objects with different shape and four objects with different surface morphology are recognized to verify the feasibility of piezoresistive sensors and piezoelectric sensors respectively. In a comprehensive experiment, eight objects made of the same rubber material with different shape, size and surface morphology are recognized, and the average recognition rate is about 84%, which shows good classification advantages for the objects with similar shape, size and material.

Assessing the Performance of DWT-PCA/SVD Face Recognition Algorithm under Multiple Constraints

Many architectures of face recognition modules have been developed to tackle the challenges posed by varying environmental constraints such as illumination, occlusions, pose, and expressions. These recognition systems have mainly focused on a single constraint at a time and have achieved remarkable successes. However, the presence of multiple constraints may deteriorate the performance of these face recognition systems. In this study, we assessed the performance of Principal Component Analysis and Singular Value Decomposition using Discrete Wavelet Transform (DWT-PCA/SVD) for preprocessing face recognition algorithm on multiple constraints (partially occluded face images acquired with varying expressions). Numerical evaluation of the study algorithm gave reasonably average recognition rates of 77.31% and 76.85% for left and right reconstructed face images with varying expressions, respectively. A statistically significant difference was established between the average recognition distance of the left and right reconstructed face images acquired with varying expressions using pairwise comparison test. The post hoc analysis using the Bonferroni simultaneous confidence interval revealed that the significant difference established through the pairwise comparison test was mainly due to the sad expressions. Although the performance of the DWT-PCA/SVD algorithm declined as compared to its performance on single constraints, the algorithm attained appreciable performance level under multiple constraints. The DWT-PCA/SVD recognition algorithm performs reasonably well for recognition when partial occlusion with varying expressions is the underlying constraint.

SAR image classification based on multi‐feature fusion decision convolutional neural network

With the success of convolutional neural network (CNN) in the field of image processing and image recognition, an improved fully convolutional neural network (FCNN) based on CNN is proposed. Although FCNN has better performance than CNN, the number of parameters of FCNN has also increased significantly compared to CNN. Consequently, this paper proposes a multi-feature fusion decision convolutional neural network (MFFD-CNN), which use two kinds down-sample methods in the pooling layer, and chooses the concatenate or add operation as the way that consolidates the feature of the convolutional layer with a stride of 2 and the max-pooling layer to execute fusion operations. Meanwhile replaces the traditional softmax loss with an additive margin Softmax (AM-Softmax) loss. The structure, which is based on the multi-target classification experiment results of the MSTAR data set, shows can not only obtain an average correct recognition rate 1.2% higher than FCNN, but also better stability without augmenting the training samples of MSTAR data.

Detection of Mild Cognitive Impairment with MEG Functional Connectivity Using Wavelet-Based Neuromarkers

Studies on developing effective neuromarkers based on magnetoencephalographic (MEG) signals have been drawing increasing attention in the neuroscience community. This study explores the idea of using source-based magnitude-squared spectral coherence as a spatial indicator for effective regions of interest (ROIs) localization, subsequently discriminating the participants with mild cognitive impairment (MCI) from a group of age-matched healthy control (HC) elderly participants. We found that the cortical regions could be divided into two distinctive groups based on their coherence indices. Compared to HC, some ROIs showed increased connectivity (hyper-connected ROIs) for MCI participants, whereas the remaining ROIs demonstrated reduced connectivity (hypo-connected ROIs). Based on these findings, a series of wavelet-based source-level neuromarkers for MCI detection are proposed and explored, with respect to the two distinctive ROI groups. It was found that the neuromarkers extracted from the hyper-connected ROIs performed significantly better for MCI detection than those from the hypo-connected ROIs. The neuromarkers were classified using support vector machine (SVM) and k-NN classifiers and evaluated through Monte Carlo cross-validation. An average recognition rate of 93.83% was obtained using source-reconstructed signals from the hyper-connected ROI group. To better conform to clinical practice settings, a leave-one-out cross-validation (LOOCV) approach was also employed to ensure that the data for testing was from a participant that the classifier has never seen. Using LOOCV, we found the best average classification accuracy was reduced to 83.80% using the same set of neuromarkers obtained from the ROI group with functional hyper-connections. This performance surpassed the results reported using wavelet-based features by approximately 15%. Overall, our work suggests that (1) certain ROIs are particularly effective for MCI detection, especially when multi-resolution wavelet biomarkers are employed for such diagnosis; (2) there exists a significant performance difference in system evaluation between research-based experimental design and clinically accepted evaluation standards.

Action Recognition of Lower Limbs Based on Surface Electromyography Weighted Feature Method.

To improve the recognition rate of lower limb actions based on surface electromyography (sEMG), an effective weighted feature method is proposed, and an improved genetic algorithm support vector machine (IGA-SVM) is designed in this paper. First, for the problem of high feature redundancy and low discrimination in the surface electromyography feature extraction process, the weighted feature method is proposed based on the correlation between muscles and actions. Second, to solve the problem of the genetic algorithm selection operator easily falling into a local optimum solution, the improved genetic algorithm-support vector machine is designed by championship with sorting method. Finally, the proposed method is used to recognize six types of lower limb actions designed, and the average recognition rate reaches 94.75%. Experimental results indicate that the proposed method has definite potentiality in lower limb action recognition.

Artificial Intelligence-Enabled ECG Algorithm Based on Improved Residual Network for Wearable ECG

Heart disease is the leading cause of death for men and women globally. The residual network (ResNet) evolution of electrocardiogram (ECG) technology has contributed to our understanding of cardiac physiology. We propose an artificial intelligence-enabled ECG algorithm based on an improved ResNet for a wearable ECG. The system hardware consists of a wearable ECG with conductive fabric electrodes, a wireless ECG acquisition module, a mobile terminal App, and a cloud diagnostic platform. The algorithm adopted in this study is based on an improved ResNet for the rapid classification of different types of arrhythmia. First, we visualize ECG data and convert one-dimensional ECG signals into two-dimensional images using Gramian angular fields. Then, we improve the ResNet-50 network model, add multistage shortcut branches to the network, and optimize the residual block. The ReLu activation function is replaced by a scaled exponential linear units (SELUs) activation function to improve the expression ability of the model. Finally, the images are input into the improved ResNet network for classification. The average recognition rate of this classification algorithm against seven types of arrhythmia signals (atrial fibrillation, atrial premature beat, ventricular premature beat, normal beat, ventricular tachycardia, atrial tachycardia, and sinus bradycardia) is 98.3%.

Fiber optic tactile sensor for surface roughness recognition by machine learning algorithms

In this study, a sensor tip with a metallic hemispherical nozzle tip (MHNT) design based on the Fabry-Perot interferometer was developed for surface roughness recognition (SRR). Sandpaper samples with ten different arithmetical mean deviations of the surface (Sa) values were used as surfaces to be recognized. The feature vectors were found by applying the discrete wavelet transform (DWT) to the analog signals obtained from the sandpaper samples. Machine learning (ML) algorithms K-nearest neighbor (KNN) and support vector machine (SVM) were used for classification. An in-depth recognition process was carried out using the classifiers’ different length criteria and kernel types. In the test process, each category consists of two sub-categories as testing within the training dataset (TWITD) and testing without the training dataset (TWOTD). The experiments were carried out in a controlled manner with the conveyor belt system (CBS) and manual. As a result of the experimental studies, the average recognition rates (Rave) for CBS were found as 84.2% and 81.6% for TWITD and TWOTD, while the Rave for the manual are found as 80% and 77.5% for TWITD and TWOTD, respectively.

Design of a robot target recognition system based on deep learning algorithms

Due to the poor multi-scale conversion of matching models constructed by traditional systems, resulting in a poor recognition rate of robot target recognition systems, the design of a robot target recognition system based on deep learning algorithms is investigated. In the hardware design, an image collector is used to collect image information. In the software design, the image acquisition program is set up, the image information is pre-processed, the matching model is constructed based on the deep learning algorithm, the image features are extracted at multiple scales, and the target is recognised using image smoothing and denoising techniques. The experimental results show that the average recognition rate of the designed system is 96.2%, and the average recognition rate of the traditional system is 89.4%, the recognition rate is improved by 6.8%, and the robot target recognition system designed based on deep learning algorithm has better recognition effect and adapts to various recognition environments.

RESEARCH ON CROP INFORMATION EXTRACTION OF AGRICULTURAL UAV IMAGES BASED ON BLIND IMAGE DEBLURRING TECHNOLOGY AND SVM

The blurring of crop images acquired by agricultural Unmanned Aerial Vehicle (UAV) due to sudden inputs by operators, atmospheric disturbance, and many other factors will eventually affect the subsequent crop identification, information extraction, and yield estimation. Aiming at the above problems, the new proposed combined deblurring algorithm based on the re-weighted graph total variation (RGTV) and L0-regularized prior, and the other two representative deblurring algorithms were applied to restore blurry crop images acquired during UAV flight, respectively. The restoration performance was measured by subjective vision, and objective evaluation indexes. The crop shape-related and texture-related feature parameters were then extracted, the Support Vector Machine (SVM) classifier with four common kernel functions was implemented for crop classification to realize the purpose of crop information extraction. The deblurring results showed that the proposed algorithm performed better in suppressing the ringing effect and preserving the image fine details, and retained higher objective evaluation indexes than the other two deblurring algorithms. The comparative analysis of different classification kernel functions showed that the Polynomial kernel function with an average recognition rate of 94.83% was most suitable for crop classification and recognition. The research will help in further popularization of crop monitoring based on UAV low-altitude remote sensing.

Recognition of Design Fixation via Body Language Using Computer Vision

The main objective of this study is to recognize design fixation accurately and effectively. First, we conducted an experiment to record the videos of design process and design sketches from 12 designers for 15 minutes. Then, we executed a video analysis of body language in designers, correlating body language to the presence of design fixation, as judged by a panel of six experts. We found that three body language types were significantly correlated to fixation. A two-step hybrid recognition model of design fixation based on body language was proposed. The first-step recognition model of body language using transfer learning based on a pretrained VGG-16 convolutional neural network was constructed. The average recognition rate achieved by the VGG-16 model was 92.03%. Then, the frames of recognized body language were used as input vectors to the second-step fixation classification model based on support vector machine (SVM). The average recognition rate for the fixation state achieved by the SVM model was 79.11%. The impact of the work could be that the fixation can be detected not only by the sketch outcomes but also by monitoring the movements, expressions, and gestures of designers, as it is happening by monitoring the movements, expressions, and gestures of designers.