Abstract
Abstract. This paper proposes a fused 3D transparent visualization method with the aim of achieving see-through imaging of large-scale cultural heritage by combining photogrammetry point cloud data and 3D reconstructed models. 3D reconstructed models are efficiently reconstructed from a single monocular photo using deep learning. It is demonstrated that the proposed method can be widely applied, particularly to instances of incomplete cultural heritages. In this study, the proposed method is applied to a typical example, the Borobudur temple in Indonesia. The Borobudur temple possesses the most complete collection of Buddhist reliefs. However, some parts of the Borobudur reliefs have been hidden by stone walls and became not visible following the reinforcements during the Dutch rule. Today, only gray-scale monocular photos of those hidden parts are displayed in the Borobudur Museum. In this paper, the visible parts of the temple are first digitized into point cloud data by photogrammetry scanning. For the hidden parts, a 3D reconstruction method based on deep learning is proposed to reconstruct the invisible parts into point cloud data directly from single monocular photos from the museum. The proposed 3D reconstruction method achieves 95% accuracy of the reconstructed point cloud on average. With the point cloud data of both the visible parts and the hidden parts, the proposed transparent visualization method called the stochastic point-based rendering is applied to achieve a fused 3D transparent visualization of the valuable temple.
Highlights
Tangible cultural heritage sites can be damaged or destroyed accidentally, deliberately, or by a natural disaster, which is a huge loss to the civilization
With the rapid development of laser scanning and photogrammetry scanning techniques, these problems can be solved by establishing digital archives of tangible cultural heritage sites
This paper proposes a method for visualizing the original appearance of this valuable cultural heritage site before its parts were covered
Summary
Tangible cultural heritage sites can be damaged or destroyed accidentally, deliberately, or by a natural disaster, which is a huge loss to the civilization. The visualization of digital archives is increasingly important for the preservation and analysis of cultural heritage sites Many meaningful applications such as walk-through displays, computer-aided design, geographic information systems, and virtual reality applications can be implemented based on the visualization of digital archives. All these methods require an efficient and accurate digitizing method of cultural heritage sites. There are a lot of cases where many cultural heritage sites no longer exist or are partially damaged In this situation, 3D scanning technologies are insufficient for establishing a complete digital archive of their original appearance.
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callMore From: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
