IMGTR: Image-triangle based multi-view 3D reconstruction for urban scenes

Abstract

Multi-view depth map reconstruction is a popular approach to generate 3D information with good flexibility and scalability. However, texture-weak regions and repeated textures challenge these methods in urban scenes. To address this need, this paper proposes an image-triangle based multi-view 3D reconstruction (IMGTR) method. Starting from constructing a density-adaptive image triangulation for each image, the main procedure is to determine the corresponding object plane for each image triangle under an objective function consisting of the image similarity measure, the smoothness constraint and the continuity constraint on the edges between adjacent triangles. Qualitative and quantitative experiments show that the proposed method can reconstruct complex urban structures more accurate and achieve higher fidelity in planar urban structures than some recently released multi-view stereo algorithms. Specifically, for the Vaihingen dataset IMGTR achieves an average improvement of 4.27% compared to PMVD, 50.94% to SURE and 54.76% to COLMAP in position accuracy.