Exploring touch feedback display of virtual keyboards for reduced eye movements

Abstract

When typing on smartphones or palm tablets, users generally make an effort to type correctly while simultaneously checking the small keyboard and the text display. Unlike physical keyboards that allow users to perform typing based on long-term muscle memory, virtual keyboards typically require more frequent eye movements between the keyboard and the text display areas.This study proposes a new way of designing a virtual keyboard display to reduce the effort associated with frequent eye-movements. For this study, we developed virtual keyboard display systems featuring both static and dynamic word-by-word (WBW) feedback displays. The two display systems were examined in comparison with a more conventional method known as character-by-character (CBC) feedback display. We investigated user satisfaction, typing performance and the user’s eye gaze shifts. Eye gaze shifts were measured between the keyboard and the text display areas across the three conditions using self-report, log, and eye-tracking measures. In the static WBW condition, the words being typed displayed in a fixed area at the top of the virtual keyboard; in the dynamic WBW display, the words displayed in a small popup window at the tip of the selected key.Using a repeated measure experiment for the three display conditions, participants were asked to type fifteen phrases using a palm tablet while wearing eye-tracking glasses for each condition. We conducted a mixed-model design ANOVA with group (SLOW vs. FAST typing; men vs. women) as between-subject factors and display condition (CBC vs. WBW). We found a significant (11%) improvement in typing speed with the dynamic WBW over the CBC display for less experienced keyboard users. In addition, participants reported higher satisfaction with the two WBW conditions than the CBC condition. Eye fixations, dwell times, and heat map data also supported that WBW displays are advantageous for less experienced, slower typists by helping them stay focused more on the keyboard, thus reducing eye transitions to the text display. Our study systematically demonstrates how and to what extent the virtual keyboard display strategy influences typing performance and subjective experience based on self-reports and eye-tracking measures. The approach and findings of this study should provide useful information and practical guidance to mobile application developers and designers who are interested in improving virtual keyboard functionalities and user satisfaction.