Study on directional eye movements in non‐frontal face images for eye‐controlled interaction

Abstract

AbstractDirectional eye movements based eye‐controlled interaction focuses on interpreting the horizontal, vertical, and diagonal eye movements or their combinations as inputs to design user interfaces for people who suffer with severe mobility disabilities. In this paper, we take into consideration the inherent eye jitter and evaluate the accuracy of dynamic tracking of horizontal, vertical, diagonal, and rectangular eye movements prior to using them. We observe that the rectangular eye gesture composed of short horizontal and vertical eye movements has the best tracking accuracy in the presence of jitter. Finally, we present methods for identifying horizontal and vertical eye movements based on the trajectory of eye pupil centers from non‐frontal face images. We find that the methods are robust and effective within ±20°deflective azimuths of non‐frontal faces. This effectiveness is demonstrated by using the rectangular eye gesture as an interface to perform a painting task.