Virtual reality realization technology and its application based on augmented reality

Abstract

We propose an Augmented Reality (AR) implementation technology based on Virtual Reality (VR), and build a system which contains a headset VR equipment, one depth camera, one color camera and a smart phone. We will collect the depth and color information through these two cameras. When the depth and color information are given, we can integrate them into four channel images fused by RGB color image and depth-image information (RGB-D), then use simultaneous localization and mapping (SLAM) to transform RGB-D image sequence into a real scene 3D model, and identify the layout of the scene on this basis. Furthermore, by the means of the Augmented Reality technology we can add auxiliary information about the objects in the scene and place the virtual objects arbitrarily into reality to achieve the fusion of virtual objects and the real scene. Finally we produce the 3D visual effect which is able to be observed by human eyes, and achieve virtual reality effect by the headset device. Through our method, virtual and real objects can be seen on the screen created by the depth and color camera to achieve the interaction of virtual and real scene.