Virtual real-time walkthrough of multi-spectral scene

Abstract

Although many virtual walkthrough system for visible scene have been carried out by now, little work has been reported about the virtual walkthrough of multi-spectral scene. In this paper, we present a virtual walkthrough system which can real-time simulate the dynamic multi-spectral scenes. We first construct the target and non-target areas with different kinds of modeling techniques such as geometry and texture based hybrid method, free viewpoint visual hulls and spectral depth image model. To realistically generate the multi-spectral images of objects under changed situations, we present a realistic imaging model which is suitable for both visual and infrared scene. We also propose a new model to simulate the effect of high-dynamic range. To further speed up the rendering process, several simplification and acceleration techniques like LOD, pre-calculation and GPU are adopted. Finally the virtual real-time walkthrough of large-scale multi-spectral scenes is successfully carried out and the average walkthrough speed is larger than 30 frames per second.