X‐person asymmetric interaction in virtual and augmented realities

Abstract

AbstractThis study proposes simple, highly immersive x‐person asymmetric interactions that account for the experience type characteristics of asymmetric virtual environments, jointly experienced by virtual reality (VR) users and augmented reality (AR) users. The first person interactions for VR users are performed through the use of hand gestures, and they define a manipulation process that maps the gestures and object control scheme to provide intuitive interactions with the virtual environment and objects. The third person interaction for AR users is designed to view the overall virtual scene and recognize and judge situations to allow for intuitive communication and interactions among the virtual environment, objects, and users based on a touch interface. The core goal of this process is to provide all users who participate in asymmetric virtual environments with satisfying experiences and presence through individualized experience modes and roles. To this end, an application that uses the x‐person asymmetric interactions was created. Furthermore, a survey experiment is performed to statistically analyze the interactions and verify that they provided users with a satisfactory experience, that is, a satisfactory sense of presence and social presence in each user's situation.