LGS: LOCAL GEOMETRICAL STRUCTURE-BASED INTEREST POINT MATCHING FOR WIDE-BASELINE IMAGERY IN URBAN AREAS

Abstract

Abstract. Feature matching is a fundamental technical issue in many applications of photogrammetry and remote sensing. Although recently developed local feature detectors and descriptors have contributed to the advancement of point matching, challenges remain with regard to urban area images that are characterized by large discrepancies in viewing angles. In this paper, we define a concept of local geometrical structure (LGS) and propose a novel feature matching method by exploring the LGS of interest points to specifically address difficult situations in matching points on wide-baseline urban area images. In this study, we first detect interest points from images using a popular detector and compute the LGS of each interest point. Then, the interest points are classified into three categories on the basis of LGS. Thereafter, a hierarchical matching framework that is robust to image viewpoint change is proposed to compute correspondences, in which different feature region computation methods, description methods, and matching strategies are designed for various types of interest points according to their LGS properties. Finally, random sample consensus algorithm based on fundamental matrix is applied to eliminate outliers. The proposed method can generate similar feature descriptors for corresponding interest points under large viewpoint variation even in discontinuous areas that benefit from the LGS-based adaptive feature region construction. Experimental results demonstrate that the proposed method provides significant improvements in correct match number and matching precision compared with other traditional matching methods for urban area wide-baseline images.