3D reconstruction of building facade with fused data of terrestrial LiDAR data and optical image

Abstract

We describe a novel method of data fusion of terrestrial LiDAR and images for delineating and deriving features and 3D reconstruction of regular building facades. We discuss the registration of LiDAR and image based on the transferring parameters of coordinate systems. We conduct the initial features extraction of building from images based on the gradient direction, and the further processing of the features constrained by the integrity rules of building construction. And consequently we implement the converting of 2D image feature lines’ to 3D point cloud space based on the former registration, and then the 3D point cloud data around the 3D feature lines are searched. Finally we obtain the more accurate 3D feature lines after a series of operations of “buffer area – plane fitting – feature line extraction” on the point cloud data around the feature lines, which is for better presentation of building model. At the end of the paper, the experiment of the data fusion of image and LiDAR was conducted. We argue that the method represent a fundamental and useful approach to improve and explore the accuracy and efficiency of 3D reconstruction of building façade based on terrestrial LiDAR data and optical image.