Gait Recognition System Research Articles

Integration of Sensory Memory Process Display System for Gait Recognition

AbstractGait is among the most dependable, accurate, and secure methods of biometric identification. However, high power consumption and low computing capability are two major obstacles on wearable sensors‐based gait recognition system. In this work, an integrated system is reported combining a triboelectric nanogenerator (TENG), a memristor (Ag/HfOx/Pt), and perovskite‐based multicolor LEDs (PMCLED) for the visualization and recognition of foot patterns through signal‐on‐none and multi‐wavelength on‐device preprocessing. The flexible TENG acts as a sensory receptor, generating voltage based on the duration and intensity of pressure, which in turn promotes voltage‐triggered synaptic plasticity in the memristor. The PMCLED, with its threshold switching and multi‐wavelength emission characteristics, enables nonlinear filtering and amplification of the synaptic signal from the memristor, resulting in a simplified system design and reduced background noise. Additionally, the effectiveness of on‐device preprocessing is validated based on a 5 × 5 array of integrated devices and software‐built neural network for foot pattern visualization and recognition. The proposed system is able to recognize the on‐device preprocessed images with high accuracy, indicating great potentials in both healthcare monitoring and human‐machine interaction.

MFCF-Gait: Small Silhouette-Sensitive Gait Recognition Algorithm Based on Multi-Scale Feature Cross-Fusion.

Gait recognition based on gait silhouette profiles is currently a major approach in the field of gait recognition. In previous studies, models typically used gait silhouette images sized at 64 × 64 pixels as input data. However, in practical applications, cases may arise where silhouette images are smaller than 64 × 64, leading to a loss in detail information and significantly affecting model accuracy. To address these challenges, we propose a gait recognition system named Multi-scale Feature Cross-Fusion Gait (MFCF-Gait). At the input stage of the model, we employ super-resolution algorithms to preprocess the data. During this process, we observed that different super-resolution algorithms applied to larger silhouette images also affect training outcomes. Improved super-resolution algorithms contribute to enhancing model performance. In terms of model architecture, we introduce a multi-scale feature cross-fusion network model. By integrating low-level feature information from higher-resolution images with high-level feature information from lower-resolution images, the model emphasizes smaller-scale details, thereby improving recognition accuracy for smaller silhouette images. The experimental results on the CASIA-B dataset demonstrate significant improvements. On 64 × 64 silhouette images, the accuracies for NM, BG, and CL states reached 96.49%, 91.42%, and 78.24%, respectively. On 32 × 32 silhouette images, the accuracies were 94.23%, 87.68%, and 71.57%, respectively, showing notable enhancements.

Wearable gait recognition system based on time domain features of Bluetooth inertial sensor network

Abstract As an important part of medical monitoring, gait recognition has been used in lower limb rehabilitation diagnosis and gait assessment. To meet practical requirements, we designed a wearable gait recognition system based on time domain features of Bluetooth inertial sensor network, which can be used for real-time acquisition and evaluation of gait signals. In this research, we used 6 sensor units to integrate 10 kinds of gait information, and designed a gait monitoring system covering the main joints of lower limbs based on Bluetooth network. The gait monitoring system can collect the inertial sensing data of lower limbs at a maximum rate of 90 Hz through the 6 sensor units, and has good electrical performance. In daily use, each unit can work for more than 3 hours and maintain a received signal strength indicator (RSSI) of more than -90 dBm at a spatial distance of 10 meters. On the gait dataset collected in the experiment, we used sliding window to segment the time domain signals and extract 10 kinds of time domain features for classification algorithm. We achieved 97.1% average identification accuracy of 7 different gait patterns by support vector machine (SVM).

Evaluating CNN Models for Gait Recognition: A Study on the CASIA-B Dataset

Gait recognition, a form of biometric identification, has garnered considerable interest for its ability to identify individuals from a distance. Yet, its effectiveness depends significantly on the precision of the underlying categorization models. This study thoroughly evaluates many Convolutional Neural Network (CNN) models to determine their effectiveness in properly identifying and categorizing gait patterns. We train and test several CNN architectures using advanced deep learning techniques on the widely known CASIA-B dataset, which is a benchmark dataset for gait recognition research. The analyses involve models like as VGG16, VGG19, NASNetLarge, NASNetMobile, EfficientNetB0, and Xception, each well-known for their effectiveness in picture categorization tasks. We evaluate the performance of these models by conducting thorough experiments and detailed analysis, focusing on accuracy, validation loss, and other pertinent metrics. The Xception model demonstrated the highest accuracy of 97.17% of the models assessed. This model frequently surpasses similar models, demonstrating its strength and effectiveness in precisely recognizing gait patterns. On the other hand, the accuracy of other models varied from 9.78% to 93.85%, demonstrating the variable levels of efficacy among various designs. The findings have significant implications for the creation and implementation of gait recognition systems. The high precision demonstrated by the Xception model highlights the promise of CNN-based methods in progressing gait identification technology. Our work highlights the significance of choosing suitable model architectures for achieving the best performance in gait detection tasks. In the future, research may focus on using larger datasets and exploring other CNN architectures to improve the accuracy and reliability of gait detection systems. Our goal is to enhance gait recognition technology to improve biometric identification for security, surveillance, and healthcare applications. GUB JOURNAL OF SCIENCE AND ENGINEERING, Vol 10(1), 2023 P 17-26

Deep motion estimation through adversarial learning for gait recognition

Gait recognition is a form of identity verification that can be performed over long distances without requiring the subject’s cooperation, making it particularly valuable for applications such as access control, surveillance, and criminal investigation. The essence of gait lies in the motion dynamics of a walking individual. Accurate gait-motion estimation is crucial for high-performance gait recognition. In this paper, we introduce two main designs for gait motion estimation. Firstly, we propose a fully convolutional neural network named W-Net for silhouette segmentation from video sequences. Secondly, we present an adversarial learning-based algorithm for robust gait motion estimation. Together, these designs contribute to a high-performance system for gait recognition and user authentication. In the experiment, two datasets, i.e., OU-IRIS and our own dataset, are used for performance evaluation. Experimental results show that, the W-Net achieves an accuracy of 89.46% in silhouette segmentation, and the proposed user-authentication method achieves over 99.6% and 93.8% accuracy on the two datasets, respectively.

Gait Recognition Under Different Clothing Conditions Via Deterministic Learning

In real-world scenarios, the clothing difference constitutes one of the most common covariate factors that can affect the performance of gait recognition systems. This paper proposes a gait recognition method which is invariant to maximum number of clothing conditions. First, four kinds of timevarying silhouette features are selected to capture the spatiotemporal characteristics of gait motion. Second, frame-to-frame gait dynamics underlying different individuals ʼ gait features is effectively modeled by radial basis function ( RBF ) neural networks through deterministic learning. Gait patterns are represented as the gait dynamics underlying time-varying gait features. This kind of dynamics information has little sensitivity to the variance between gait patterns under different clothing conditions. In order to eliminate the effect of clothing differences, the training patterns under different clothing conditions further constitute a uniform training dataset, containing all kinds of gait dynamics under different clothing conditions. A rapid recognition scheme is presented on published gait databases. Extensive experiments demonstrate the efficacy of the proposed method.

An end-to-end gait recognition system for covariate conditions using custom kernel CNN

Gait recognition is the identification of individuals based on how they walk. It can identify an individual of interest without their intervention, making it better suited for surveillance from afar. Computer-aided silhouette-based gait analysis is frequently employed due to its efficiency and effectiveness. However, covariate conditions have a significant influence on individual recognition because they conceal essential features that are helpful in recognizing individuals from their walking style. To address such issues, we proposed a novel deep-learning framework to tackle covariate conditions in gait by proposing regions subject to covariate conditions. The features extracted from those regions will be neglected to keep the model's performance effective with custom kernels. The proposed technique sets aside static and dynamic areas of interest, where static areas contain covariates, and then features are learnt from the dynamic regions unaffected by covariates to effectively recognize individuals. The features were extracted using three customized kernels, and the results were concatenated to produce a fused feature map. Afterward, CNN learns and extracts the features from the proposed regions to recognize an individual. The suggested approach is an end-to-end system that eliminates the requirement for manual region proposal and feature extraction, which would improve gait-based identification of individuals in real-world scenarios. The experimentation is performed on publicly available dataset i.e. CASIA A, and CASIA C. The findings indicate that subjects wearing bags produced 90 % accuracy, and subjects wearing coats produced 58 % accuracy. Likewise, recognizing individuals with different walking speeds also exhibited excellent results, with an accuracy of 94 % for fast and 96 % for slow-paced walk patterns, which shows improvement compared to previous deep learning methods.© 2017 Elsevier Inc. All rights reserved.

Degradable, biocompatible, and flexible capacitive pressure sensor for intelligent gait recognition and rehabilitation training

Gait recognition and rehabilitation training based on pressure sensing technology have an important role in the field of rehabilitation medicine. However, existing pressure sensors that are used in this process are often fabricated from non-degradable or non-biocompatible source materials, which limits their application in long-term sustainable use. In this study, we propose a high-performance, degradable, biocompatible and flexible capacitive pressure sensor. Its dielectric layer is prepared using a polyvinyl alcohol/sodium alginate (PVA/SA) electrospun nanofiber membrane (ENM), while its upper and lower electrodes are fabricated from PVA@graphene screen-printed ENMs. Experimental results demonstrate the sensor's exceptional pressure sensing performance, characterized by its high sensitivity (0.54 kPa−1 at 0–10 kPa), low detection limit (∼2.2 Pa), rapid response time (26.6/29.9 ms), and excellent stability (5000 cycles). Furthermore, it exhibits outstanding biocompatibility, achieving a cell viability assay survival rate exceeding 97%, and remarkable degradability, completely degrading within one hour. A gait recognition and rehabilitation training system has been developed by integrating the sensors with a deep learning algorithm and wireless transmission technology. The system can effectively monitor and record dynamic parameters of lower limb swing during walking, exhibiting an impressive gait recognition accuracy of 98% over five normal and abnormal gaits. Moreover, it can guide patients in performing diverse rehabilitation actions as well as monitor their progress through action count recording. This innovative solution offers a sustainable approach to gait recognition and rehabilitation training within the field of rehabilitation medicine, thereby opening up new avenues for patient recovery.

PGGait: Gait Recognition Based on Millimeter-Wave Radar Spatio-Temporal Sensing of Multidimensional Point Clouds.

Gait recognition, crucial in biometrics and behavioral analytics, has applications in human-computer interaction, identity verification, and health monitoring. Traditional sensors face limitations in complex or poorly lit settings. RF-based approaches, particularly millimeter-wave technology, are gaining traction for their privacy, insensitivity to light conditions, and high resolution in wireless sensing applications. In this paper, we propose a gait recognition system called Multidimensional Point Cloud Gait Recognition (PGGait). The system uses commercial millimeter-wave radar to extract high-quality point clouds through a specially designed preprocessing pipeline. This is followed by spatial clustering algorithms to separate users and perform target tracking. Simultaneously, we enhance the original point cloud data by increasing velocity and signal-to-noise ratio, forming the input of multidimensional point clouds. Finally, the system inputs the point cloud data into a neural network to extract spatial and temporal features for user identification. We implemented the PGGait system using a commercially available 77 GHz millimeter-wave radar and conducted comprehensive testing to validate its performance. Experimental results demonstrate that PGGait achieves up to 96.75% accuracy in recognizing single-user radial paths and exceeds 94.30% recognition accuracy in the two-person case. This research provides an efficient and feasible solution for user gait recognition with various applications.

AttenGait: Gait recognition with attention and rich modalities

Current gait recognition systems employ different types of manual attention mechanisms, like horizontal cropping of the input data to guide the training process and extract useful gait signatures for people identification. Typically, these techniques are applied using silhouettes as input, which limits the learning capabilities of the models. Thus, due to the limited information provided by silhouettes, state-of-the-art gait recognition approaches must use very simple and manually designed mechanisms, in contrast to approaches proposed for other topics such as action recognition. To tackle this problem, we propose AttenGait, a novel model for gait recognition equipped with trainable attention mechanisms that automatically discover interesting areas of the input data. AttenGait can be used with any kind of informative modalities, such as optical flow, obtaining state-of-the-art results thanks to the richer information contained in those modalities. We evaluate AttenGait on two public datasets for gait recognition: CASIA-B and GREW; improving the previous state-of-the-art results on them, obtaining 95.8% and 70.7% average accuracy, respectively. Code will be available athttps://github.com/fmcp/attengait.

The flexible and distributed pressure sensor with 64 units for on-line gait recognition analysis

With the rapid development of flexible electronic technology, human gait recognition device is also developing in the direction of flexibility, refinement, and intelligence. In this paper, a gait recognition system with the advantages of being non-invasive and flexible is proposed and prepared to collect complex pressure information of human plantar and identify different gaits accurately. A flexible and distributed pressure sensor with a structure of eight rows and eight columns is designed and fabricated by the screen printing process and micro-nano manufacturing technology. The insole shape can be placed directly into a sneaker for easy wearing, while 64 pressure sensing units allow for more accurate detection of complex plantar pressure information. In addition, based on the “voltage mirror” principle and the feature threshold analysis method, a distributed pressure acquisition circuit and an online gait recognition software are developed respectively to realize time-sharing decoupling of complex output signals from multiple pressure sensing units and online real-time display of different gaits. Finally, Different human gait recognition experiments have also been carried out. The results show that the test error of the pressure sensing unit is better than 8.28%. The gait recognition system can realize the reliable and accurate online real-time identification of slow walking, fast walking, and different leaning directions, which shows great potential and value in the fields of medical diagnosis, health monitoring, gait correction and artificial intelligence.

Machine learning models and methods for human gait recognition

The paper explores the challenge of human identification through gait recognition within biometric identification systems. Itoutlines the essential criteria for human biometric features, discusses primary biometric characteristics, and their application in biometric identification systems. The paper also examines the feasibility of utilizing gait as a biometric identifier, emphasizing its advantages, such as not requiring the upfront provision of personal biometric information and specialized equipment.The authors conduct an analysis of existing scientific literature in the field of gait recognition, categorizing gait recognition methodsinto template-based and non-template-based approaches. Throughout their research, they identify the key issues and challenges that researchers face in this domain, along with the prevailing trends in human gait recognition within biometric identification systems.Additionally, the paper introduces a method for person identification based on gait, utilizing the Histogram of Oriented Gradients and the Sum Variance Haralick texture features. It involves transforming input video into a series of images depicting the gait silhouette, creating a Gait Energy Image (GEI) by combining these gait silhouettes throughout a gait cycle, and translating the GEI into the Gait Gradient Magnitude Image (GGMI). The subsequent step involves extracting recommended gait characteristics from the GGMIs of participants included in a dataset.To preprocess the collected characteristics, Principal Component Analysis (PCA) is applied, reducing the dimensions that may negatively impact classification robustness, thereby enhancing overall performance. In the final step, a K-Nearest Neighbors (KNN) classifier is employed to categorize the characteristics obtained from a specific dataset.The proposed novel feature vector in the paper demonstrates increased reliability and effectively captures spatial variations in gait patterns. Notably, it reduces the dimensionality of the feature vector from 3780×1 to 63×1, resulting in decreased computational complexity in the gait recognition system. Experimental evaluations on the CASIA A and CASIA B datasets reveal that the proposed approach outperforms other HOG-based methods in most scenarios, with the exception of situations involving frontal images.

A multi-view human gait recognition using hybrid whale and gray wolf optimization algorithm with a random forest classifier

Gait recognition has become one of the furthest promising behavioral biometric techniques for identifying individuals. Gait recognition models are capable of identifying humans at a distance based on their walking manner without their permission or interference. However, it is usually noted that the performance of a gait recognition approach will drop drastically in the presence of covariates such as carrying conditions, clothing conditions, and variations in the view angle. Therefore, it is necessary to develop a robust gait recognition system in order to identify the most significant gait features. In this paper, we introduced a recently developed hybrid whale and gray wolf optimization algorithm (WGWOA) for determining the optimal subset of gait features by combining the advantages of whale optimization and gray wolf optimization techniques. Moreover, we employed principal component analysis (PCA) to extract the essential gait features from the gradient gait energy image (GGEI) and random forest (RF) approach to classify the optimal gait features. The proposed method has been assessed on the publicly available largest multi-view CASIA-B and OU-MVLP benchmark datasets. Experimental results indicate that the proposed model achieved an accuracy of 99.25%, 98.39%, and 97.97% under normal, carrying a bag and wearing coat walking conditions, respectively on the CASIA-B dataset. Furthermore, the proposed model achieved an accuracy of 97.63% under normal conditions on the OU-MVLP dataset. The comparative results also confirm that the proposed algorithm is superior to the contemporary approaches.

Data preprocessing and feature selection techniques in gait recognition: A comparative study of machine learning and deep learning approaches

The study of gait recognition, a biometric application that identifies individuals based on their unique walking patterns, is an evolving field. In this paper, we conduct a literature review to compare the performance of machine learning and deep learning approaches in covariate conditions, focusing on the specific aspects of deep learning pipelines in gait recognition. We highlight commonly used strategies and open problems in identification based on behavioral traits and propose future perspectives for researchers in this field. Through our investigation, we aim to provide insights that will aid researchers in developing informed decisions when to take which data preprocessing technique in designing gait recognition systems. Our paper provides a comprehensive exposition of machine learning versus deep learning architectures and pipelines for biometric applications using human gait and serves as a valuable resource for researchers in this area.

A Self‐Powered Body Motion Sensing Network Integrated with Multiple Triboelectric Fabrics for Biometric Gait Recognition and Auxiliary Rehabilitation Training

AbstractGait analysis provides a convenient strategy for the diagnosis and rehabilitation assessment of diseases of skeletal, muscular, and neurological systems. However, challenges remain in current gait recognition methods due to the drawbacks of complex systems, high cost, affecting natural gait, and one‐size‐fits‐all model. Here, a highly integrated gait recognition system composed of a self‐powered multi‐point body motion sensing network (SMN) based on full textile structure is demonstrated. By combining of newly developed energy harvesting technology of triboelectric nanogenerator (TENG) and traditional textile manufacturing process, SMN not only ensures high pressure response sensitivity up to 1.5 V kPa−1, but also is endowed with several good properties, such as full flexibility, excellent breathability (165 mm s−1), and good moisture permeability (318 g m−2 h−1). By using machine learning to analyze periodic signals and dynamic parameters of limbs swing, the gait recognition system exhibits a high accuracy of 96.7% of five pathological gaits. In addition, a customizable auxiliary rehabilitation exercise system that monitors the extent of the patient's rehabilitation exercise is developed to observe the patient's condition and instruct timely recovery training. The machine learning‐assisted SMN can provide a feasible solution for disease diagnosis and personalized rehabilitation of the patients.

WiCrew: Gait-Based Crew Identification for Cruise Ships Using Commodity WiFi

Security check-in life-support areas, e.g., bridge and engine room are crucial for cruise ships due to numerous and diverse passenger identities. Instead of conventional security check approaches, such as facial recognition and fingerprint identification, device-free approaches enabled by WiFi-based gait recognition have attracted considerable attention owing to their low cost, nonintrusiveness, and privacy protection. Despite the excellent performance of existing indoor methods, they cannot be trivially extended to cruise ships because of the unique characteristics of hull deformation caused by vibrating engines and waves. This stems from the flexible structure of cruise ships, which introduces additional noise to the WiFi signals. To address this challenge, we propose WiCrew, a device-free gait recognition system that detects crew identity anomalies in cruise ships. WiCrew consists of two components: 1) a spatial separation algorithm that separates the signal components from ship vibration and human activity and 2) a speed-independent adversarial learning framework that identifies the ship’s crew using human gaits at an arbitrary walking speed. Extensive experiments on a cruise ship demonstrate the effectiveness of WiCrew. While the crew members walk at speed of 0.7 to 1.8 m/s, the average recognition accuracy reaches 82%, which is similar to vision-based approaches.

Gait-CNN-ViT: Multi-Model Gait Recognition with Convolutional Neural Networks and Vision Transformer.

Gait recognition, the task of identifying an individual based on their unique walking style, can be difficult because walking styles can be influenced by external factors such as clothing, viewing angle, and carrying conditions. To address these challenges, this paper proposes a multi-model gait recognition system that integrates Convolutional Neural Networks (CNNs) and Vision Transformer. The first step in the process is to obtain a gait energy image, which is achieved by applying an averaging technique to a gait cycle. The gait energy image is then fed into three different models, DenseNet-201, VGG-16, and a Vision Transformer. These models are pre-trained and fine-tuned to encode the salient gait features that are specific to an individual's walking style. Each model provides prediction scores for the classes based on the encoded features, and these scores are then summed and averaged to produce the final class label. The performance of this multi-model gait recognition system was evaluated on three datasets, CASIA-B, OU-ISIR dataset D, and OU-ISIR Large Population dataset. The experimental results showed substantial improvement compared to existing methods on all three datasets. The integration of CNNs and ViT allows the system to learn both the pre-defined and distinct features, providing a robust solution for gait recognition even under the influence of covariates.

Synthesizing 3D Gait Data with Personalized Walking Style and Appearance

Extracting gait biometrics from videos has been receiving rocketing attention given its applications, such as person re-identification. Although deep learning arises as a promising solution to improve the accuracy of most gait recognition algorithms, the lack of enough training data becomes a bottleneck. One of the solutions to address data deficiency is to generate synthetic data. However, gait data synthesis is particularly challenging as the inter-subject and intra-subject variations of walking style need to be carefully balanced. In this paper, we propose a complete 3D framework to synthesize unlimited, realistic, and diverse motion data. In addition to walking speed and lighting conditions, we emphasize two key factors: 3D gait motion style and character appearance. Benefiting from its 3D nature, our system can provide various gait-related data, such as accelerometer data and depth map, not limited to silhouettes. We conducted various experiments using the off-the-shelf gait recognition algorithm and draw the following conclusions: (1) the real-to-virtual gap can be closed when adding a small portion of real-world data to a synthetically trained recognizer; (2) the amount of real training data needed to train competitive gait recognition systems can be reduced significantly; (3) the rich variations in gait data are helpful for investigating algorithm performance under different conditions. The synthetic data generator, as well as all experiments, will be made publicly available.

Toward Selective Adversarial Attack for Gait Recognition Systems Based on Deep Neural Network

Deep neural networks (DNNs) perform well for image recognition, speech recognition, and pattern analysis. However, such neural networks are vulnerable to adversarial examples. An adversarial example is a data sample created by adding a small amount of noise to an original sample in such a way that it is difficult for humans to identify but that will cause the sample to be misclassified by a target model. In a military environment, adversarial examples that are correctly classified by a friendly model while deceiving an enemy model may be useful. In this paper, we propose a method for generating a selective adversarial example that is correctly classified by a friendly gait recognition system and misclassified by an enemy gait recognition system. The proposed scheme generates the selective adversarial example by combining the loss for correct classification by the friendly gait recognition system with the loss for misclassification by the enemy gait recognition system. In our experiments, we used the CASIA Gait Database as the dataset and TensorFlow as the machine learning library. The results show that the proposed method can generate selective adversarial examples that have a 98.5% attack success rate against an enemy gait recognition system and are classified with 87.3% accuracy by a friendly gait recognition system.

Gait Recognition Using Convolutional Neural Network

Biometrics are the body measurements and calculations related to individuals. Biometrics validation is used as a form of identification of individual. Gait recognition system is one of the most advanced technology that people have been working on for a while now that takes center stage in the field of biometrics. Compared to the other types of existing systems of biometric recognition such as fingerprint detection, iris-scanning systems etc., Gait Recognition system ensures no human intervention. This paper focuses on recognition based on a person’s gait. Every person has a distinct gait pattern that is unique to every other person. To train the model CASIA-B dataset has been used. The dataset includes 124 subjects where each sample has undergone Gait Energy Image extraction. Samples with clothing and baggage have been included which changes the silhouette of the person. Therefore, the model has been trained for a wider application where people wear different type of clothing and carry-ons. A Convolutional Neural Network consisting of 8 layers has been trained which performs well on both samples of dataset and an accuracy of 95.45% was obtained on dataset not involving layers of clothing and accuracy of 91.80% was obtained for the sample with clothing and baggage.