마커 기반 상호작용 동기화 및 혼합현실 협업 콘텐츠 개발

Abstract

As non-face-to-face services spread in the post-COVID-19, expanded reality technologies such as mixed reality are attracting attention in various fields. In mixed reality, each user forms a unique coordinate system with the device location at the time the application is executed as the origin. The positions of virtual objects thus cannot be shared or synchronized by using absolute coordinates. In particular, for a co-located collaboration, virtual objects augmented on each user’s device should exist exactly at the same spot in the real world, which means the objects rendered on each user’s display should be aligned in the same position and rotation in the real world as well as synchronized. For this, we propose a method for creating a standard coordinate system for a collaborative workspace and synchronizing interactions. All users create a standard coordinate system at the location of a marker, and then register virtual objects and avatars as its sub-objects. Afterwards interactions in the collaborative space are synchronized among users by exchange of local position relative to the standard coordinate system. We developed the mixed reality application in which multiple users collaborate for 3D-drone assembly, and verified our proposal by showing that it synchronizes interactions in real-time successfully.