Terrestrial laser scanning (TLS) is an efficient tool to capture the point cloud for facade modeling. However, it is not easy to obtain the position by Global Navigation Satellite System (GNSS) as occluded by high buildings, which would lead to a problem for orienting the TLS data to a target coordinate system. In this paper, we propose a coarse-to-fine registration method for reliably orient the TLS data using digital line graph (DLG). The orientation is completed by horizontal plane registration and elevation registration part. The proposed method is composed of five steps: (1) Using the proposed method to extract the corner points from the building outline of DLG. (2) Using the proposed method based on RANSAC algorithm to extract the corner points and the façade point clouds of the TLS data. (3) Coarse alignment of the two extracted sets of corner points using 4PCS algorithm; (4) Fine registration by 2D-ICP algorithm; and (5) Completing elevation registration using elevation control points. Three data sets are employed to perform the experiments, and the results confirm that the proposed method is reliable and efficient in achieving the registration DLG and TLS data. By comparing to two other typical registration methods, the proposed method performs better.