Smart Tablet Monitoring by a Real-Time Head Movement and Eye Gestures Recognition System

Abstract

Different research works are studying to integrate new ways of interaction with mobiles devices such as smartphone and tablets to provide a natural and easy mode of communication to people. In this paper we propose a new system to monitoring tablets through head motions and eye-gaze gestures recognition. This system is able to open browser application with simples' motions by the head and the eyes. For the face detection, we use a Viola and Jones technique, and for the eyes detection and tracking we used Haar classifier to the detection part and the template matching for the tracking part. We develop this system on android based tablet. Through the front-facing camera the system capture a real-time streaming video on which we implement the detection and recognition module. We test the system on 5 persons and the experiment results shows that this system is robust and it is invariant for the lightness and the moving state of the user. As known the tablet's resources are limited, in consequence the response time of our system is not satisfied for the real time condition. That is why we apply the cloud computing to solve this problem.