Robust real-time eye detection and tracking under variable lighting conditions and various face orientations

Abstract

Most eye trackers based on active IR illumination require distinctive bright pupil effect to work well. However, due to a variety of factors such as eye closure, eye occlusion, and external illumination interference, pupils are not bright enough for these methods to work well. This tends to significantly limit their scope of application. In this paper, we present an integrated eye tracker to overcome these limitations. By combining the latest technologies in appearance-based object recognition and tracking with active IR illumination, our eye tracker can robustly track eyes under variable and realistic lighting conditions and under various face orientations. In addition, our integrated eye tracker is able to handle occlusion, glasses, and to simultaneously track multiple people with different distances and poses to the camera. Results from an extensive experiment shows a significant improvement of our technique over existing eye tracking techniques.