Tracking of deformable human hand in real time as continuous input for gesture-based interaction

Abstract

Gesture input is a natural and effective interactive model. The tracking of deformable hand gesture is a very important task in gesture-based interaction. A novel real-time tracking approach is proposed to capture hand motion with single camera. It combines the characters of model-based and appearance-based method. The presented approach achieves auto-initialization by posture recognition and matching with image features. It solves the problem of interference among fingers successfully by the integration of K-Means clustering and Particle Filters. Moreover, tracking detection realizes resumption from tracking failure and automatic update of hand model. Experiments show that, the proposed method can achieve continuous real-time tracking of deformable hand gesture, and meets the requirements for gesture-based Human-Computer Interaction.