Combined Use of Rear Touch Gestures and Facial Feature Detection to Achieve Single-Handed Navigation of Mobile Devices

Abstract

To improve single-handed operation of mobile devices, rear touch panel operation to control commands and facial feature detection to control cursor position are proposed. Operational control is achieved through finger chord gestures on a rear touch panel, and nose movement is used to control cursor movement. Zooming is achieved by detecting the apparent distance between the left and right eyes in conjunction with a finger chord gesture. We have evaluated movement time, error rates, and the throughputs of these techniques in comparison with the conventional single-handed front touch panel thumb operations using Fitts's law. Experiments have been conducted to evaluate two operation modes, selection and zooming, in the form of reciprocal 1-D pointing tasks with 12 participants. For the target selection task, the proposed technique achieved 12% (0.26 s) shorter movement time and 4.7% smaller error rate than the conventional method on average. Especially, for long distance targets, the performance of the conventional method became remarkably inferior due to the limit of reach of the thumb, whereas the proposed technique achieved much less deterioration and obtained expected performance because the cursor could reach anywhere on the display. For the target size adjustment task, the proposed technique achieved 9% (0.22 s) shorter movement time than the conventional method and obtained a comparable error rate of less than 4%. Consequently, we could demonstrate the techniques that make single-handed select and zoom operations available anywhere on a large-sized tablet device with no blockage of the display.