Hand Gesture Recognition Algorithm Research Articles

Adaptive Trajectories’ Constant False Alarm Rate Mirror Filters and Elevation Angle Evaluation for Multiple-Input Multiple-Output Radar-Based Hand Gesture Recognition

Gesture recognition technology has been quickly developed in the field of human–computer interaction. The multiple-input multiple-output (MIMO) radar is popular in gesture recognition because of its notable spatial resolution. This work proposes a MIMO radar-based hand gesture recognition algorithm with low complexity. We leverage low-complexity adaptive signal processing to extract trajectory information and minimize noise to create a system that can be applied in real-world applications with small training datasets. First, a spectrum analysis is utilized on range-Doppler maps (RDMs), and a cell-averaging constant false alarm rate (CA-CFAR) with mirror filters is applied to improve the robustness of noise. Then, the features related to the distance, speed, direction, and elevation angle of the moving object are determined using the proposed adaptive signal analysis techniques. For classification, the random forest algorithm is implemented. The proposed system can precisely distinguish and identify eight gestures, including waving, moving to the left or right, patting, pushing, pulling, and rotating clockwise or anti-clockwise, with an accuracy of 95%. Experiments demonstrate the capability of the proposed hand gesture recognition system to classify different movements precisely.

Enhance the AI Virtual System Accuracy with Novel Hand Gesture Recognition Algorithm Comparing to Convolutional Neural Network

The objective of this study is to enhance the precision of AI virtual systems by implementing Novel Hand Gesture Recognition techniques in comparison to Convolutional Neural Network. Materials and Methods: To recognise hand motions, a Convolutional Neural Network with distinct training and testing stages is utilized. The average Gpower for the test is between 0.05 and 0.85, or around 85%. Sample size is determined as 27,455 for each group using G Power 3.1 software (G Power setting parameters: α=0.05 and power=0.85). Results and Discussion: Novel Hand gesture recognition 92.60% identifies between objects and boosts the observed accuracy with a statistically non-significant value of p=0.123 (p>0.05) in comparison to the convolutional neural network's 88.59%. Conclusion: Comparison of the Novel Hand gesture Recognition algorithm and Convolutional Neural Network in terms of performance that shows Hand gesture recognition has 91.62% with better accuracy.

A study on hand gesture recognition algorithm realized with the aid of efficient feature extraction method and convolution neural networks: design and its application to VR environment

A study on hand gesture recognition algorithm realized with the aid of efficient feature extraction method and convolution neural networks: design and its application to VR environment

Accuracy Enhancement of Hand Gesture Recognition Using CNN

Human gestures are immensely significant in human-machine interactions. Complex hand gesture input and noise caused by the external environment must be addressed in order to improve the accuracy of hand gesture recognition algorithms. To overcome this challenge, we employ a combination of 2D-FFT and convolutional neural networks (CNN) in this research. The accuracy of human-machine interactions is improved by using UWB radar to acquire image data, then transforming it with 2D-FFT and bringing it into CNN for classification. The classification results of the proposed method revealed that it required less time to learn than prominent models and had similar accuracy.

Low Complexity Radar Gesture Recognition Using Synthetic Training Data

Developments in radio detection and ranging (radar) technology have made hand gesture recognition feasible. In heat map-based gesture recognition, feature images have a large size and require complex neural networks to extract information. Machine learning methods typically require large amounts of data and collecting hand gestures with radar is time- and energy-consuming. Therefore, a low computational complexity algorithm for hand gesture recognition based on a frequency-modulated continuous-wave (FMCW) radar and a synthetic hand gesture feature generator are proposed. In the low computational complexity algorithm, two-dimensional Fast Fourier Transform is implemented on the radar raw data to generate a range-Doppler matrix. After that, background modelling is applied to separate the dynamic object and the static background. Then a bin with the highest magnitude in the range-Doppler matrix is selected to locate the target and obtain its range and velocity. The bins at this location along the dimension of the antenna can be utilised to calculate the angle of the target using Fourier beam steering. In the synthetic generator, the Blender software is used to generate different hand gestures and trajectories and then the range, velocity and angle of targets are extracted directly from the trajectory. The experimental results demonstrate that the average recognition accuracy of the model on the test set can reach 89.13% when the synthetic data are used as the training set and the real data are used as the test set. This indicates that the generation of synthetic data can make a meaningful contribution in the pre-training phase.

Enhancement of Hand Gesture Recognition Using Convolutional Neural Networks Integrating a Combination of an Autoencoder Network and PCA

Hand gestures offer people a convenient way to interact with computers, in addition to give them the ability to communicate without physical contact and at a distance, which is essential in today’s health conditions, especially during an epidemic infectious viruses such as the COVID-19 coronavirus. However, factors, such as the complexity of hand gesture patterns, differences in hand size and position, and other aspects, can affect the performance of hand gesture recognition and classification algorithms. Some deep learning approaches such as convolutional neural networks (CNN), capsule networks (CapsNets) and autoencoders have been proposed by researchers to improve the performance of image recognition systems in this particular field: While CNNs are arguably the most widely used networks for object detection and image classification, CapsNets and Autoencoder seem to resolve some of the limitations identified in the first approach. For this reason, in this work, a specific combination of these networks is proposed to effectively solve the ASL problem. The results obtained in this work show that the proposed group with a simple data augmentation process improves precision performance by 99.43%.

A Hand Gesture Recognition Algorithm Based on Multi-scale Hybrid Features

A human hand gesture recognition algorithm based on multi-scale hybrid features is pro-posed. A large number of gesture data images are organized and annotated by automatic im-age annotation algorithm. Based on dense sampling, the multi-scale Gaussian pyramid is taken into account for enhancing the image details; it can realize the recognition of both large and small target gestures. Meanwhile, according to the aggregation and distribution of gestures, statistical analysis is used to optimize the size and aspect ratio of anchors, which can further improve the accuracy of recognition. The experiment results show that the mean average precisions of this algorithm can be improved to 99.7% and 93.3% for the simple gesture and complex gesture, respectively, which are higher than that obtained by these traditional methods, such as faster region-convolution neural network (Faster R-CNN), You Only Look Once (YOLO), and SSD.

Wrist-Worn Hand Gesture Recognition While Walking via Transfer Learning.

Walking, one of the most common daily activities, causes unwanted movement artifacts which can significantly deteriorate hand gesture recognition accuracy. However, traditional hand gesture recognition algorithms are typically developed and validated with wrist-worn devices only during static human poses, neglecting the critical importance of dynamic effects on gesture accuracy. Thus, we developed and validated a signal decomposition approach via empirical mode decomposition to accurately segment target gestures from coupled raw signals during dynamic walking and a transfer learning method based on distribution adaptation to enable gesture recognition through domain transfer between dynamic walking and static standing scenarios. Ten healthy subjects performed seven hand gestures during both walking and standing experiments while wearing an IMU wrist-worn device. Experimental results showed that the signal decomposition approach reduced the gesture detection error by 83.8%, and the transfer learning approach (20% transfer rate) improved hand gesture recognition accuracy by 15.1%. This ground-breaking work demonstrates the feasibility of hand gesture recognition while walking via wrist-worn sensing. These findings serve to inform real-life and ubiquitous adoption of wrist-worn hand gesture recognition for intuitive human-machine interaction in dynamic walking situations.

Robust Hand Gesture Recognition Based on RGB-D Data for Natural Human–Computer Interaction

To naturally interact with virtual environment by hand gesture, this paper presents a robust RGB-D data based recognition method of static and dynamic hand gesture. Firstly, for static hand gesture recognition, starting from the hand gesture contour extraction, the palm center is identified by Distance Transform (DT) algorithm. The fingertips are localized by employing the K-Curvature-Convex Defects Detection algorithm (K-CCD). On the basis, the distances of the pixels on hand gesture contour to palm center and the angle between fingertips are considered as the auxiliary features to construct a multimodal feature vector, and then recognition algorithm is presented to robustly recognize the static hand gestures. Secondly, combining Euclidean distance between hand joints and shoulder center joint with the modulus ratios of skeleton features, this paper generates a unifying feature descriptor for each dynamic hand gesture and proposes an improved dynamic time warping (IDTW) algorithm to obtain recognition results of dynamic hand gestures. Finally, we conduct extensive experiments to test and verify the static and dynamic hand gesture recognition algorithm and realize a low-cost real-time application of natural interaction with virtual environment by hand gestures.

Hand gesture recognition algorithm combining hand-type adaptive algorithm and effective-area ratio for efficient edge computing

Most existing gesture recognition algorithms have low recognition rates under rotation, translation, and scaling of hand images as well as different hand types. We propose a new hand gesture recognition algorithm that combines the hand-type adaptive algorithm and effective-area ratio based on feature matching. Samples are divided into several groups according to the subjects’ palm shapes and the algorithm is trained using self-collected data. The user’s hand type is paired with one of the sample libraries by the hand-type adaptive algorithm. To further improve the accuracy, the effective-area ratio of the gesture is calculated based on the minimum bounding rectangle, and the preliminary gesture is recognized by the effective-area ratio feature method. The results of experiments demonstrate that the proposed algorithm could accurately recognize gestures in real time and exhibits good adaptability to different hand types. The overall recognition rate is over 94%. The recognition rate still exceeds 93% when hand gesture images are rotated, translated, or scaled.

Hand Gesture Recognition on a Resource-Limited Interactive Wristband.

Most of the reported hand gesture recognition algorithms require high computational resources, i.e., fast MCU frequency and significant memory, which are highly inapplicable to the cost-effectiveness of consumer electronics products. This paper proposes a hand gesture recognition algorithm running on an interactive wristband, with computational resource requirements as low as Flash < 5 KB, RAM < 1 KB. Firstly, we calculated the three-axis linear acceleration by fusing accelerometer and gyroscope data with a complementary filter. Then, by recording the order of acceleration vectors crossing axes in the world coordinate frame, we defined a new feature code named axis-crossing code. Finally, we set templates for eight hand gestures to recognize new samples. We compared this algorithm’s performance with the widely used dynamic time warping (DTW) algorithm and recurrent neural network (BiLSTM and GRU). The results show that the accuracies of the proposed algorithm and RNNs are higher than DTW and that the time cost of the proposed algorithm is much less than those of DTW and RNNs. The average recognition accuracy is 99.8% on the collected dataset and 97.1% in the actual user-independent case. In general, the proposed algorithm is suitable and competitive in consumer electronics. This work has been volume-produced and patent-granted.

Hand Gesture Recognition Algorithm Using SVM and HOG Model for Control of Robotic System

In this study, we propose the gesture recognition algorithm using support vector machines (SVM) and histogram of oriented gradient (HOG). Besides, we also use the CNN model to classify gestures. We approach and select techniques of applying problem controlling for the robotic system. The goal of the algorithm is to detect gestures with real-time processing speed, minimize interference, and reduce the ability to capture unintentional gestures. Static gesture controls are used in this study including on, off, increasing, and decreasing. Besides, it uses motion gestures including turning on the status switch and increasing and decreasing the volume. Results show that the algorithm is up to 99% accuracy with a 70-millisecond execution time per frame that is suitable for industrial applications.

UWB-gestures, a public dataset of dynamic hand gestures acquired using impulse radar sensors

In the past few decades, deep learning algorithms have become more prevalent for signal detection and classification. To design machine learning algorithms, however, an adequate dataset is required. Motivated by the existence of several open-source camera-based hand gesture datasets, this descriptor presents UWB-Gestures, the first public dataset of twelve dynamic hand gestures acquired with ultra-wideband (UWB) impulse radars. The dataset contains a total of 9,600 samples gathered from eight different human volunteers. UWB-Gestures eliminates the need to employ UWB radar hardware to train and test the algorithm. Additionally, the dataset can provide a competitive environment for the research community to compare the accuracy of different hand gesture recognition (HGR) algorithms, enabling the provision of reproducible research results in the field of HGR through UWB radars. Three radars were placed at three different locations to acquire the data, and the respective data were saved independently for flexibility.

An Improved Hand Gesture Recognition Algorithm based on image contours to Identify the American Sign Language

It is an open era of research to provide the assistance communication to hearing and visually impaired people. For the same, this paper proposed a recognition and classification of hand gesture to identify the correct denotation with maximum accurateness for standard American Sign Language. The proposal intelligently used the information based on image contours to identify the character’s representation of hand gesture. The proposal optimizes the performance overhead through identifications of 17 characters and 6 symbols based on image contours and convexity measurement of Standard American Sign Language without using complex algorithms and specialized hardware devices. Accuracy measurement done through simulation, which shows how our proposal provide more accuracy with minimum complexity in comparison to other state-of-art works.

Gesture recognition device based on cross reticulated graphene strain sensors

Perception and recognition of hand gestures have received much attention for their applications in the human–computer fields. The data-glove application in gesture recognition makes it expediently to track the movements of human fingers. Whereas, the development of the data-glove for hand gesture still face numerous technical difficulties, such as the sensitivity, flexible ability, and system integration under low-cost. In this paper, a simple gesture recognition glove system was developed to characterize the sign language, which consists of cross reticulated graphene (CRG) flexible sensors, a multi-channel data acquisition module, and an artificial neural network algorithm. The designed acquisition module has several channels, so that signs from five sensors can be collected and transferred to the intelligent terminal to execute the hand gesture recognition algorithm. Besides, the recognition results suggest that the recognition rate of the neural network for 22 letters in the English alphabet can reach more than 90% and the overall recognition has an over 86% accuracy.

TinyRadarNN: Combining Spatial and Temporal Convolutional Neural Networks for Embedded Gesture Recognition With Short Range Radars

This work proposes a low-power high-accuracy embedded hand-gesture recognition algorithm targeting battery-operated wearable devices using low-power short-range RADAR sensors. A 2-D convolutional neural network (CNN) using range-frequency Doppler features is combined with a temporal convolutional neural network (TCN) for time sequence prediction. The final algorithm has a model size of only 46 thousand parameters, yielding a memory footprint of only 92 KB. Two data sets containing 11 challenging hand gestures performed by 26 different people have been recorded containing a total of 20'210 gesture instances. On the 11 hand gesture data set, accuracies of 86.6% (26 users) and 92.4% (single user) have been achieved, which are comparable to the state of the art, which achieves 87% (10 users) and 94% (single user), while using a TCN-based network that is 7500× smaller than the state of the art. Furthermore, the gesture recognition classifier has been implemented on a parallel ultralow power processor, demonstrating that real-time prediction is feasible with only 21 mW of power consumption for the full TCN sequence prediction network, while a system-level power consumption of less than 120 mW is achieved. We provide open-source access to example code and all data collected and used in this work on tinyradar.ethz.ch.

Hand Gestures Recognition Using Radar Sensors for Human-Computer-Interaction: A Review

Human–Computer Interfaces (HCI) deals with the study of interface between humans and computers. The use of radar and other RF sensors to develop HCI based on Hand Gesture Recognition (HGR) has gained increasing attention over the past decade. Today, devices have built-in radars for recognizing and categorizing hand movements. In this article, we present the first ever review related to HGR using radar sensors. We review the available techniques for multi-domain hand gestures data representation for different signal processing and deep-learning-based HGR algorithms. We classify the radars used for HGR as pulsed and continuous-wave radars, and both the hardware and the algorithmic details of each category is presented in detail. Quantitative and qualitative analysis of ongoing trends related to radar-based HCI, and available radar hardware and algorithms is also presented. At the end, developed devices and applications based on gesture-recognition through radar are discussed. Limitations, future aspects and research directions related to this field are also discussed.

Dynamic Hand Gesture Recognition Based on Signals From Specialized Data Glove and Deep Learning Algorithms

Gesture recognition as a natural, convenient and recognizable way has been received more and more attention on human–machine interaction (HMI) recently. However, visual-based gesture recognition methods are often restricted by environments and classical wearable device-based strategies are suffered from relatively low accuracy or the complicated structures. In this study, we first design a low-cost and efficient data glove with simple hardware structure to capture finger movement and bending simultaneously. Second, a novel dynamic hand gesture recognition algorithm (DGDL-GR) is proposed to recognize human dynamic sign language, in which a fusion model of convolutional neural network (fCNN) and generic temporal convolutional network (TCN) is fully utilized. The fCNN (fusion of 1-D CNN and 2-D CNN) is proposed to extract time-domain features of finger resistance movement and spatial domain features of finger resistance bending simultaneously. Moreover, due to the superiorities of TCN in sequence modeling task, this work proposes a novel hand gesture recognition method based on the TCN, which includes causal convolution, dilation convolution, and a residual network with appropriate layers. Both long- and short-time dependencies of the hand gesture features are deeply mined and classified in the end. Results of extensive experiments have demonstrated that the proposed DGDL-GR algorithm outperforms many state-of-the-art algorithms on the measure of accuracy, F1 score, precision score, and recall score with the real-world dataset. Moreover, the number of residual blocks and some key hyperparameters of the proposed DGDL-GR algorithm has been studied thoroughly in this work.

Shape-Based Features for Optimized Hand Gesture Recognition

Gesture recognition is the most intuitive form of human-computer interface. Hand gestures provide a natural way for humans to interact with computers to perform a variety of different applications. However, factors such as complexity of hand gesture structures, differences in hand size, hand posture, and environmental illumination can influence the performance of hand gesture recognition algorithms. Considering the above factors, this paper aims to present a real time system for hand gesture recognition on the basis of detection of some meaningful shape-based features like orientation, center of mass, status of fingers, thumb in terms of raised or folded fingers of hand and their respective location in image. The internet is growing at a very fast pace. The use of web browser is also growing. Everyone has at least two or three most frequently visited website. Thus, in this paper, effectiveness of the gesture recognition and its ability to control the browser via the recognized hand gestures are experimented and the results are analyzed.

Home Automation using Esp 8266

Home automation is advancing in most sectors of the world, people are finding ways to make their life simpler and more efficient. Most of the home automation devices use raspberry pi and various sensors. Many of the device are inculcated with hand gesture recognition algorithms in order to make them more user friendly. This system is based on Wi-Fi signals and communication takes place over a particular bandwidth of the Wi-Fi. The system takes into usage a Wi-Fi technology thus it provides universal access to the system for automated control of appliance. ESP-8266 is the vital component of this project that helps in communication using Wi-Fi protocol. The main objective that lies behind this project is the inspection of controlling of the home appliances distantly while keeping it cost effective. The motivation behind the project was to enable users to make their home automatic and have distantly unanimous control. The home gadgets controller framework with an operational expense was viewed as fabricated that ought to be transferrable giving removed access controlling plan to the machines. Thus the analysis comprises the working of the Wi-Fi module along with various censors and IC’s. ESP-8266 helps the user to control the device from anywhere around the globe using the mobile application.