Exterior orientation estimation of oblique aerial images using SfM-based robust bundle adjustment

Abstract

ABSTRACT In this article, a structure from motion (SfM) framework for oblique aerial images of man-made environments is proposed, covering the issues of determining overlapping images, feature extraction, image matching, rejection of erroneous correspondences, feature tracking, automatic transfer of ground control points (GCPs), and bundle block adjustment. One of the challenges that it is intended to solve is the reduction of the required manual work concerning the measurement of GCPs, in order to increase the degree of automation of the exterior orientation estimation process, through the usage of geometric constraints automatically imposed. Yet another challenge is the difficulty in matching correctly feature points among multiple oblique views that depict scenes with repetitive patterns and homogeneous textures. The proposed algorithm solves this by eliminating all erroneous tie points through the combination of multiple checks and geometric constraints imposed during the image matching procedure and a robust iterative bundle adjustment framework. The proposed SfM methodology is applied in different configurations of oblique images under non-ideal aerial triangulation scenarios characterized by lack of well-distributed GCPs as well as minimum manual image measurements. The results are analysed, focusing on the improvement of the accuracy of the exterior orientation parameters thanks to the proposed robust outlier removal technique as well as on the impact of the proposed scale-based weighting strategy for bundle adjustment of oblique images on the exterior orientation results. The proposed SfM framework proves to be a good alternative solution to existing commercial SfM methods.