A Continuous Hand Gestures Recognition Technique for Human-Machine Interaction Using Accelerometer and Gyroscope Sensors

Abstract

Recent advances in smart devices have sustained them as a better alternative for the design of human–machine interaction (HMI), because they are equipped with accelerometer sensor, gyroscope sensor, and an advanced operating system. This paper presents a continuous hand gestures recognition technique that is capable of continuous recognition of hand gestures using three-axis accelerometer and gyroscope sensors in a smart device. To reduce the influence of unstableness of a hand making the gesture and compress the data, a gesture coding algorithm is developed. An automatic gesture spotting algorithm is developed to detect the start and end points of meaningful gesture segments. Finally, a gesture is recognized by comparing the gesture code with gesture database using dynamic time warping algorithm. In addition, a prototype system is developed to recognize the continuous hand gestures-based HMI. With the smartphone, the user is able to perform the predefined gestures and control smart appliances using the Samsung AllShare protocol.