Automatic Scrolling Research Articles

Tracking the Progression of Reading Using Eye-Gaze Point Measurements and Hidden Markov Models

In this article, we consider the problem of tracking the eye gaze of individuals while they engage in reading. In particular, we develop the ways to accurately track the line being read by an individual using commercially available eye-tracking devices. Such an approach will enable futuristic functionalities, such as comprehension evaluation, interest level detection, and user-assisting applications such as hand-free navigation and automatic scrolling. Furthermore, the proposed approach will pave the way to develop technology that may generate valuable feedback to content makers, such as web designers, authors, educators, and social media users. The existing commercial eye trackers provide an estimated location of the eye-gaze points every few milliseconds. However, these estimated gaze points are not sufficient to quantify reading progression—a specific eye-gaze activity. In this article, we propose algorithms to bridge the commercial gaze tracker outputs and informative eye-gaze patterns while reading. The proposed system consists of Kalman filters and hidden Markov models to parameterize these statistical models and to accurately detect the line being read. The proposed approach is shown to yield an improvement of 27.1% in line detection accuracy over line tracking using estimated eye-gaze points alone by the eye tracker.

Image grid display: A study on automatic scrolling presentation

In this paper we describe a study on image grid display with automatic vertical scrolling. While scroll operations are normally carried out manually by the user, in the context of RSVP (Rapid Serial Visual Presentation) techniques this work considers a presentation mode in which the image grid is automatically scrolled. Through experiments carried out with 50 testers, we have investigated user performance while looking for specific target subjects within large collections of images. Different numbers of columns and scrolling speeds have been considered. The search task implied both clicking on the identified target pictures and simply vocally stating their visual recognition. To this purpose, and to identify possible specific gaze behaviours, eye tracking technology has been exploited. The obtained results show that number of columns and scroll speed do affect search performance. Moreover, the user’s gaze tends to focus on different screen areas depending on the values of these two parameters. Although it is not possible to definitely find an optimal columns–speed combination that is valid in all cases, the particular context of use can suggest feasible solutions according to one’s needs. To the best of our knowledge, image grid display with automatic scrolling has never been studied to date.

Toward better retrieval and presentation by exploring cross-media correlations

This paper addresses explicit correlation and implicit correlation between various media streams in a composite multimedia document, the so-called navigated hypermedia document in our language learning system, in order to facilitate document retrieval and synchronized presentation. For replaying a recorded lecture in a form as close as possible to the original classroom experience, we devised a capturing mechanism to explicitly record all the lecturing media streams and relations between them, including instructor's voice, slide change of the HTML lectures, and various guiding actions (e.g., tele-pointers, pen strokes, document scrolling, keyword highlighting, and text annotations) on HTML-based slides. In addition, for more effective learning, we study three different aspects - temporal, spatial, and content relation - of the implicit correlations that are inherently hidden between the media involved. The implicit relations are discovered by three designed processes: the speech-text alignment process for temporally synchronized speech-text presentation, the automatic scrolling process for the viewing window's spatial synchronization, and the content dependency checking process to ensure consistency of the content processed and the relations involved. The experimental results show that exploring cross-media correlations is helpful for system development in document presentation and retrieving. Users are allowed to replay a vivid and learning-effective multimedia lecture and to access the desired part of the document very easily via cross-media indexing. Hence the results have been applied to the development of online multimedia language learning systems aimed at improving students' English and Chinese language capabilities.