VIEW GRAPH CONSTRUCTION FOR LARGE-SCALE UAV IMAGES: AN EVALUATION OF STATE-OF-THE-ART METHODS

Abstract

Abstract. Structure from Motion (SfM) is a 3D reconstruction framework that has achieved great success on large-scale Unmanned Aerial Vehicle (UAV) images. Due to the high time consumption of feature matching, a matching candidate subset is obtained by image retrieval to improve efficiency. Bag of Word (BoW) based image retrieval has been widely used in SfM systems, but the large number of local features and the high dimension of the BoW vector cause the retrieval method time-consuming. Vector of Locally Aggregated Descriptors (VLAD) and learning-based NetVLAD perform well in image retrieval, and these vector representation methods are evaluated in this study. After images are transformed into vectors, Nearest Neighbour (NN) searching methods like Brute-force and KD-Tree are used to find similar images. But as the number of images and the vector dimension increase, Approximate Nearest Neighbour (ANN) searching methods like Hierarchical Navigable Small World (HNSW) and Locality-Sensitive Hashing (LSH) are considered to replace NN searching to avoid efficiency degradation. These vector searching methods are also evaluated in this study. The test results demonstrate that the optimal method VLAD with HNSW can speed up about 100 times in finding matching candidate subset. A view graph that guides scene partition and sub-scene reconstruction in parallel SfM can be created by the optimal method. With this view graph construction method, the efficiency of SfM is significantly improved.