A scalable sub-graph regularization for efficient content based image retrieval with long-term relevance feedback enhancement

Abstract

The goal of content-based image retrieval (CBIR) is to search relevant images through the analysis of image content. Manifold Ranking (MR) and Efficient Manifold Ranking (EMR) method has been successfully applied to content-based image retrieval due to its ability to discover underlying geometrical structure of dataset given the query data. But given the image database is scalable, the graph in MR and EMR cannot be extended or updated as their graph size is fixed. In this paper, to solve the above problem, we consider to formulate a sub-graph based on fixed anchors, instead of constructing the graph based on the while dataset, where the anchors are selected by utilizing conventional k-means method and the sub-graph weight matrix is defined by the similarity between any pair-wise anchors. Since the number of anchors is much smaller than the original dataset, updating the sub-graph is much easier than the original graph of whole dataset. Motivated by such sub-graph construction, we then develop an efficient graph regularization framework to predict the ranking scores for the whole data along the sub-graph, where the ranking score is first propagated from query image to the partial anchors, then from partial anchors to all anchors via the sub-graph and finally to the whole dataset. It can also utilize user relevance feedbacks to update the sub-graph so that the discriminative information can be involved to enhance the retrieval performance in a long term. Extensive simulations verify the effectiveness of the proposed method.