Application of Virtual Avatar using Motion Capture in Immersive Virtual Environment

Abstract

This study proposes a method for providing various experiential environments and experiences by applying virtual avatars based on motion capture to produce immersive virtual environment. It aims to increase the immersion of virtual environment and provide new experiences, whereby both non-immersive users (using PCs and mobile devices) and immersive users (using virtual reality (VR)) can participate and perform various experiences. To this end, an integrated development environment based on the Unity 3D engine is built. In this environment, immersive content allowing for multi-user participation on cross-platforms and virtual avatars using motion capture can work together flexibly. Further, it defines the real-time streaming processes of movements in a real space as calculated from actors (skeleton data) and motion capture cameras for avatars in a virtual environment. Immersive content that users in the various participating environments can experience together is created and virtual avatars based on actor are applied according to the motion capture. In addition, through survey experiments, the experiential environment that interacts with virtual avatars based on human actor using motion capture and non-player character (NPC) avatars operating according to a predetermined pattern within the produced virtual environment is compared and analyzed. This virtual avatar application method using motion capture provides a high-immersion, and an interesting and positive experience owing to the irregular and unpredictable variety of experiences.