Abstract
In-air gesture interaction enables a natural communication between a man and a machine with its clear semantics and humane mode of operation. In this paper, we propose a real-time recognition system on multiple gestures in the air. It uses the commodity off-the-shelf (COTS) reader with three antennas to detect the radio frequency (RF) signals of the passive radio frequency identification (RFID) Tags attached to the fingers. The idea derives from the crucial insight that the sequential phase profile of the backscatter RF signals is a reliable and well-regulated indicator insinuating space-time situation of the tagged object, which presents a close interdependency with tag's movements and positions. The KL divergence is utilized to extract the dynamic gesture segment by confirming the endpoints of the data flow. To achieve the template matching and classification, we bring in the dynamic time warping (DTW) and k-nearest neighbors (KNN) for similarity scores calculation and appropriate gesture recognition. The experiment results show that the recognition rates for static and dynamic gestures can reach 85% and 90%, respectively. Moreover, it can maintain satisfying performance under different situations, such as diverse antenna-to-user distances and being hidden from view by nonconducting obstacles.
Highlights
As wireless sensor technology develops, the human-computer interactions (HCI) have transformed from traditional ways of keyboards and touchscreen to in-air gesture interaction
We propose a real time static and dynamic gesture recognition system for in-air interaction, which using the backscatter communication between the battery-free passive tags and the commodity off-the-shelf (COTS) radio frequency identification (RFID) reader
We summarize the advantages of this system over other existing systems as follows:1) Non-line of sight (NLOS) identification, since the backscatter signal is capable of high penetration; 2) Energy-free sensing, since passive RFID tags have no independent power source and must be activated by RFID reader; 3) low cost and lightly carrying, since the passive RFID tags are light and cheap while the COTS RFID reader release the user from any hardware modifications
Summary
As wireless sensor technology develops, the human-computer interactions (HCI) have transformed from traditional ways of keyboards and touchscreen to in-air gesture interaction. Research on RFID-based gesture recognition is on the rise during recent years and obtains positive breakthroughs in [1], [24], [25] They have not taken both static and dynamic gestures into consideration and the system performance is limited by the complexity of the environment. We propose a real time static and dynamic gesture recognition system for in-air interaction, which using the backscatter communication between the battery-free passive tags and the COTS RFID reader. By analyzing and measuring the phase trend of the backscatter signals, both static and dynamic gesture recognition can be achieved naturally Developing such a system is not so straightforward.
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
