Design an Interactive User Interface with Integration of Dynamic Gesture and Handwritten Numeral Recognition

Abstract

The HCI (Human-Computer Interface) technology development has been an important topic because of the popularity of digital technology and the innovation of 3C product. The product of the NUI (Natural User Interface) is more popular than the design of HCI base on a joystick, mouse, keyboard and touch. It always uses the body movements to achieve the interactive in recently years. After "Kinect" controller was announced by the Microsoft Corporation, it open an innovative technologies in the natural user interface, which allows users to get more natural, more diverse ways to interact with machine. In this paper, the Kinect controller can complete a future digital home ITV (Interactive TV) and interactive multimedia software of control that allows users to achieve the visual and interactive operation with a more intuitive and user-friendly operation. It differs from the traditional button control. And this paper can achieve the effect of interaction HCI by Kinect. The interactive control system of this paper is included both of dynamic and handwriting recognition. The dynamic gesture uses the Kinect Sensor to achieve the real-time interaction. The handwriting digital character could be used to select TV channel. The digital character use the BPNN (Back Propagation Neural Network) to achieve the recognition and it also has a good performance in this paper.