Prediction of user action in moving-target selection tasks

Abstract

Selection of moving targets is a common, yet complex task in human–computer interaction (HCI), and more specifically in virtual reality (VR). Action prediction has proven to be the most comprehensive enhancement to address moving-target selection challenges. Current predictive techniques, however, heavily rely on continuous tracking of user actions, without considering the possibility that target-reaching actions may have a dominant pre-programmed component—this theory is known as the pre-programmed control theory.Thus, based on the pre-programmed control theory, this research explores the possibility of predicting moving-target selection prior to action execution. Specifically, three levels of action prediction are investigated: 1) action performance measured as the movement time (MT) required to reach a target, 2) prospective difficulty (PD), i.e., subjective assessments made prior to action execution; and 3) intention, i.e., the target that the user plans to reach.In this dissertation, intention prediction models are developed using decision trees and scoring functions—these models are evaluated in two VR studies. PD models for 1-D, and 2-D moving- target selection tasks are developed based on Fitts' Law, and evaluated in an online experiment. Finally, MT models with the same structural form of the aforementioned PD models are evaluated in a 3-D moving-target selection experiment deployed in VR.