Region-based Image Retrieval Using Probabilistic Feature Relevance Learning

Abstract

Region-Based Image Retrieval (RBIR), a specialisation of content-based image retrieval, is a promising and important research area. RBIR usually requires good segmentation, which is often difficult to achieve in practice for several reasons, such as varying environmental conditions and occlusion. It is, therefore, imperative to develop effective mechanisms for interactive, region-based visual query in order to provide confident retrieval performance. In this paper, we present a novel RBIR system, Finding Region In the Pictures (FRIP), that uses human-centric relevance feedback to create similarity metric on-the-fly in order to overcome some of the limitations associated with RBIR systems. We use features such as colour, texture, normalised area, shape and location, extracted from each region of a segmented image, to represent image content. For each given query, we estimate local feature relevance using probabilistic relevance model, from which to create a flexible metric that is highly adaptive to query location. As a result, local data densities can be sufficiently exploited, whereby rapid performance improvement can be achieved. The efficacy of our method is validated and compared against other competing techniques using real world image data.