Abstract
As a universal interaction method, hand and finger gestures can express people’s intention directly and clearly in daily life, and has been one of the hotspots in human–computer interaction community. In this paper, we present <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">DMT</i> , a device-free finger gesture tracking system that can track and recognize the finger motion accurately. To achieve this, we transform the mobile device, such as a smart phone, into an active sonar system by establishing inaudible audio links between the built-in speakers and microphone. The finger motion will have an effect (e.g., Doppler-shift) on the audio signals, which makes it possible to track the finger motion according to the received signal characteristics at the microphone side. Due to the small reflection energy and slow moving speed of the finger, the existing methods cannot detect the Doppler-shift accurately. To this end, a Fourier fitting-based method is proposed in the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">DMT</i> to accurately detect the Doppler-shift. With the detected Doppler-shift, the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">DMT</i> can track the finger motion with high accuracy. The <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">DMT</i> supports all kinds of finger gestures interaction, including characters and shapes. Extensive experiments demonstrate the high accuracy and robustness of the <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">DMT</i> in dynamic environments.
Published Version (
Free)
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call