Explorable Representation of Interaction in VR/AR Environments

Abstract

Synthetic 3D content, which is the main element of virtual and augmented reality applications, typically includes objects, which react to interaction with users and other objects. Interaction may result in changes of the objects’ geometry, structure and appearance. Representation of 3D content covering temporal properties can be useful in application domains that benefit from analysis of users’ and objects’ behavior, such as education, training, e-commerce, marketing and merchandising. However, the available approaches do not enable exploration of 3D content with regards to its time-dependent properties. The main contribution of this paper is temporal representation of interaction. The representation is based on semantic web standards and ontologies, which enable use of general as well as domain knowledge for exploration of content. The representation is discussed in the context of an immersive virtual car showroom implemented using headsets and motion tracking devices.