Collaborative MR Workspace with Shared 3D Vision Based on Stereo Video Transmission

Abstract

Mixed reality (MR) research aims to develop technologies that inputting or mixing the real world objects into computer generated three dimensional (3D) virtual space. The mixed reality, including augmented reality (AR) and augmented virtuality (AV), produces an environment in which the real objects are superimposed on user’s view of the virtual environment or the virtual objects are superimposed on user’s view of the real environment. Mixed reality has received a great deal of attention as a new method for displaying information or increasing the reality of virtual environments. Many research results have been reported and demonstrated [P. Biermann and B. Jung, 2004 Shintaro Ono et al., 2005]. Recently, some new assessments have been developed that such new model of virtual systems which are different from traditional form is efficient for exciting user’s sense [Yi Cai et al., 1997 Raphael Grasset, 2005]. However, most of such large-scale assessments still remain at the level of viewing computer graphics (CG)-generated virtual objects. It has revealed that such model of virtual system is no longer functional or fascinate based on virtual reality techniques only. The new, innovative, and mixed reality based approaches are required for operation or exhibition in 21st century. That means the new virtual reality model is focusing on cooperation-centred, real object-based operation. The features of such operation are mainly real or mixed, natural interactive, three dimensional with stereo vision, and collaborative. Mixed reality environments are defined by Milgram as those in which real world and virtual world objects are presented together on a single display [Milgram P. and Kishino, 1994]. The single user based mixed reality interfaces have been developed for computer aided instruction [S. Feiner et al., 1993], manufacture [Cruz-Neira et al., 1992] and medical visualization [Bajura et al., 1992]. Recently, Seon-Min et al. [Seon-Min et al., 2006] presents a method for merging a live video stream of multiple users into a shared virtual space. These applications have shown that mixed reality interfaces can enable users to interact with the real world in ways never before possible. Furthermore, the combination of mixed reality and network communication is becoming a more interesting research subject. Although mixed reality techniques have proven enough valuable in single user applications, there has been less research on group collaborative applications. We believe that mixed reality is ideal for collaborative interfaces because it addresses two major issues in three dimensional computer supported collaborative work: