Abstract

The idea of hybrid user interfaces (HUI) does not rely only on the use of different devices but also on different interactive environments with the goal of bringing together the advantages of each environment. The main challenge regarding the development of such systems is to know which are the design aspects that should be taken into account in order to promote smooth and continuous interactions. In this way our work reinforces the importance of interactions continuity and dimensional task congruence as design principles to guide the development and interaction analysis within HUI. An example scenario was conceived from splitting a previous single desktop application for 3D volume sculpture into three different interactive environments (Wimp, Augmented Reality and Head-Mounted Immersive Virtual Reality). To achieve such goal we employ the OpenInterface platform to allow the management of several modalities for user interaction within and along the three environments. Finally, we discuss the outcomes of the analysis of interactions within our HUI according to the design principles proposed.

Highlights

  • Recent studies have demonstrated that in certain situations a mix of 3D and 2D interaction is preferred in relation to the exclusive use of one or the other [1]

  • This paper focus on a subset of the mixed reality continuum between WIMP and virtual reality interfaces passing through augmented reality

  • The term hybrid user interfaces (HUI) (Hybrid User Interfaces) was first proposed by [2], referring to a heterogeneous environment, rich in interaction techniques, and with different kinds of devices used in a complementary way

Read more

Summary

INTRODUCTION

Recent studies have demonstrated that in certain situations a mix of 3D and 2D interaction is preferred in relation to the exclusive use of one or the other [1]. It would be of great advantage to explore this heterogeneity in the sense of giving more interaction environments in the same physical workplace Trying to address such issue, the idea of hybrid user interfaces [2] does not rely only on the use of different devices and on different interaction environments. The use of a hybrid interface composed by different interaction environments enhances the exploration of the mixed reality continuum [3] because these interaction environments can complement each other, bringing particular advantages. In the MagicBook, the user walks from the real world to virtual reality passing through augmented reality using a hand-held device The transition between these environments consisted of automated virtual camera movements and image effects, such as fade in and out.

RELATED WORK ON HYBRID USER INTERFACES
Transitional Interaction
MULTIMODAL PLATFORM DESCRIPTION
DEMONSTRATION EXAMPLE
Hybrid viewer
USAGE SCENARIO
Matching the task continuity property
Findings
VIII. CONCLUSIONS AND FUTURE WORK
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call