Abstract

The desired local feature descriptor should be distinctive, compact and fast to compute and match. Therefore, many computer vision applications use binary keypoint descriptors instead of floating-point, rich techniques. In this paper, an optimisation approach to the design of a binary descriptor is proposed, in which the detected keypoint is described using several, scale-dependent patches. Each such patch is divided into disjoint blocks of pixels, and then, binary tests between blocks’ intensities, as well as their gradients, are used to obtain the binary string. Since the number of image patches and their relative sizes influence the descriptor creation pipeline, a simulated annealing algorithm is used to determine them, optimising recall and precision of keypoint matching. The simulated annealing is also used for dimensionality reduction in long binary strings. The proposed approach is extensively evaluated and compared with SIFT, SURF and BRIEF on public benchmarks. Obtained results show that the binary descriptor created using the resulted pipeline is faster to compute and yields comparable or better performance than the state-of-the-art descriptors under different image transformations.

Highlights

  • Many computer vision applications for object recognition, tracking or scene reconstruction, have been using local feature descriptors

  • Since precision and recall measures [17] reflect the quality of performance of a given local feature descriptor in image matching tests, they can be used as an objective function

  • Speeded Up Robust Features (SURF), Scale-Invariant Feature Transform (SIFT) and Binary Robust Independent Elementary Features (BRIEF) were selected for comparison due to their high performance reported in many works

Read more

Summary

Introduction

Many computer vision applications for object recognition, tracking or scene reconstruction, have been using local feature descriptors Such descriptors capture an image content that surrounds the detected keypoint and express it in the form of a vector. Scale-Invariant Feature Transform (SIFT) [1,2] and Speeded Up Robust Features (SURF) [3] approaches are such floating-point descriptors The binary string was created as a result of pairwise tests on intensities and gradients of blocks. Such binary string can be long; the SA was run in order to determine the most important 128 or 256 bits.

Related work
The approach
Optimisation problem
Descriptor design using simulated annealing
Optimisation
Evaluation
Conclusions
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call