TouchInteract: An Interaction Technique with Large Displays Using Touchscreen-Phone

Abstract

At present, more and more large-scale displays appear in public and semi-public places, but very few of them have interaction capabilities. We present Touch Interact: a novel interaction technique with large displays using touch screen-phone. Touch Interact allows users to remotely control the large displays using their touch screen mobile phone. Users can sliding or tapping on the mobile phone's touch screen, or pressing the phone's keyboard, these operations are converted to standard input event stream, and then they are sent via Blue tooth to the large displays, the large displays analyse and process the standard input event stream, then transform it to user's intent such as cursor positioning, object selection, text input, etc.