Abstract

Recently, Doppler radar-based foot gesture recognition has attracted attention as a hands-free tool. Doppler radar-based recognition for various foot gestures is still very challenging. So far, no studies have yet dealt deeply with recognition of various foot gestures based on Doppler radar and a deep learning model. In this paper, we propose a method of foot gesture recognition using a new high-compression radar signature image and deep learning. By means of a deep learning AlexNet model, a new high-compression radar signature is created by extracting dominant features via Singular Value Decomposition (SVD) processing; four different foot gestures including kicking, swinging, sliding, and tapping are recognized. Instead of using an original radar signature, the proposed method improves the memory efficiency required for deep learning training by using a high-compression radar signature. Original and reconstructed radar images with high compression values of 90%, 95%, and 99% were applied for the deep learning AlexNet model. As experimental results, movements of all four different foot gestures and of a rolling baseball were recognized with an accuracy of approximately 98.64%. In the future, due to the radar’s inherent robustness to the surrounding environment, this foot gesture recognition sensor using Doppler radar and deep learning will be widely useful in future automotive and smart home industry fields.

Highlights

  • IntroductionGesture recognition has been playing an important role in opening new ways of human and machine interaction in a wide variety of applications such as wearable devices [1,2,3], smart phones [4], autonomous vehicles [5,6,7], and health care [8].Existing sensors for a gesture recognition of movements of hands and arms include ultrasound [9,10,11,12], camera based vision [13,14,15,16,17], and radar [18,19,20,21,22,23,24,25,26,27,28]

  • We propose a new technique for foot gesture recognition using an Singular Value Decomposition (SVD)

  • Doppler radar signature in the time domain, the Doppler radar signature in the frequency domain, and the STFT spectrogram for four different foot gestures were measured and unique radar signatures corresponding to each foot gesture were obtained

Read more

Summary

Introduction

Gesture recognition has been playing an important role in opening new ways of human and machine interaction in a wide variety of applications such as wearable devices [1,2,3], smart phones [4], autonomous vehicles [5,6,7], and health care [8].Existing sensors for a gesture recognition of movements of hands and arms include ultrasound [9,10,11,12], camera based vision [13,14,15,16,17], and radar [18,19,20,21,22,23,24,25,26,27,28]. Camera based image sensors are a very common gesture recognition approach that use various popular. Because camera based sensors are strongly dependent on surrounding environment factors like lighting, dust, and so on, it is necessary to design sensors very precisely for out-ofvehicle or outdoor use. Radar has the advantage of being strong against noise signals such as those from moisture, dust, and vibration. Radar sensors are suitable for human motion recognition because they have excellent sensitivity and Doppler resolution to changes of moving objects as well as strong immunity to ambient noise

Methods
Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call