Method of 3D reconstruction using graph cuts, and its application to preserving intangible cultural heritage

Abstract

We are developing an archive system that can preserve Japanese traditional dramatic arts, such as "Noh", in the form of dynamic 3D models. Dynamic 3D models are models that are generated from video images captured by multiple cameras surrounding a target object for each frame. The archive system can provide an entire Noh scene from any viewpoint by synthesizing dynamic 3D models with a computer graphics model of a Noh stage. Dynamic 3D models are generated using the graph-cut algorithm but it has a problem that thin parts of the object are cut off. As most of actors of Japanese traditional dramatic arts wear a traditional costume with long sleeves and a fan, it is important to reconstruct thin parts to preserve the arts. We therefore introduced the constraint imposed by the silhouette edges and the core obtained by adaptive erosion process on the volume intersection. We also propose the method of texture mapping that three texture images are blended, to suppress the flickers caused by the view dependent texture mapping. We describe our archive system with the proposed methods and present the effectiveness of the methods.