Video avatar-based remote video collaboration

Abstract

Most existing remote video communication systems are confined to how to accurately deliver adequate information in real time,but lose sight of communicators' interaction demands. Meanwhile,traditional2D-based video communications cannot make full use of people's 3D information,which shows great potential for video communication to achieve immersive,natural and efficient interactions with 3D technique. To enhance the immersion sense and expand interaction modes in video collaboration,the design goal for ‘immersive'video communication systems was proposed and a novel,avatar-based remote video collaboration system was designed and implemented. Specifically,using Creative Senz3 D depth camera,the proposed system extracted people's foreground images through background segmentation as their video avatars,and located the avatars together in a common virtual scenario. Natural and immersive interactions among people and between people and virtual scenes were also well designed,which expanded modes of interaction and collaboration in video communication. Finally,a user study was conducted and the result indicates that the proposed video avatar-based remote video cooperation mode can effectively enhance people's sense of immersion in telecommunication.