An Integrated Methods for Refined Facial-Image Retrieval using Sift and Click-Through Data

Abstract

In the modern era, the emergence of social networking sites paved the way to the people to upload lot of images online. Social sites like Instagram and Flickr allow users to add semantic information to the images in the form of tags. Often these tags are the firsthand semantic data for retrieving the images from the Internet. When a user searches for images in the web, the images with tags relevant to user query are retrieved. Most of the time, these semantic data are not relevant to the content of the image and hence the user gets irrelevant images in contrast to their intended search. This is more common in facial image search. In this paper, we propose an integrated approach to refine the relevance of retrieved facial images. Using Scale Invariant Feature Extraction (SIFT) the facial features of semantically most relevant image and click-through data of all the retrieved images are used to rank and present a meaningful search result. Along with facial features and click through information, the co-occurrence of related tags is also considered. Also we propose the construction of inverted index structure to improve the search performance.