Multi-user smartphone-based interaction with large high-resolution displays

Abstract

We investigate the practicality of using smartphones to interact with large high-resolution displays, such as tiled display walls. To accomplish such a task, we found that in most cases it is not necessary to find the spatial location of the phone relative to the display, rather we can identify the object a user wants to interact with through image recognition. The interaction with the object itself can be done by using the smartphone as the medium. This trivially allows multi-user interaction with a large display wall, provided that each user has a smartphone. To investigate the feasibility of this concept we implemented a prototype.