Modeling modality selection in multimodal human-computer interaction

Abstract

Research Interests The main interest of my research is the development of model-based methods for simulation and automated usability prediction of multimodal interfaces. In particular I want to investigate how modality choice of users can be predicted and simulated by a computational model that estimates the quality of multimodal interfaces. Therefore I am also interested in exploring rules and cognitive processes that impact users’ modality selection in multimodal humancomputer interaction.