Independent component filter based adaptive texture features applied to content-based image retrieval

Abstract

In this research we concentrate on adaptive texture feature extractors which are automatically extracted from an image collection. We use independent component analysis (ICA) to extract independent component filters (ICF). ICF have previously been shown to include edge filters, having properties similar to the receptive fields of simple cells of the human visual cortex. In this thesis we evaluate the utility of ICF-based collection-specific features in the context of content-based image retrieval (CBIR), with the view to demonstrate the viability of using such automatic collection-specific features. We find that global features extracted using a small number of ICF outperform those extracted by a bank of Gabor filters, even when very large number of Gabors are used. We also present comparisons against a variety of state-of-the-art features and show that ICF-based features perform better than these, without the need for any hand-tuning. ICA extracts large number of filters. In order to find a useful smaller subset we evaluate a previously-published variance-based filter selection method. We identify the shortcomings of this method. Our proposed improvements to filter-based feature selection and extraction, response scaling and locally normalised convolution, was a result of trying to address some of these shortcomings. Even with these improvements the variance-based method has an intrinsic flaw of being susceptible to selecting redundant filters. We propose a new filter selection method based on normalised cross-correlation and clustering. We show that our method selects a more useful subset compared to the previously published variance-based method. We also propose a salient-point based local feature which uses ICF and show that our proposed feature performs better than SIFT features and also the global ICF features. We further illustrate the utility of ICFSIFT by developing a grid-based adaptive local feature and we demonstrate that ICFSIFT extracts different and useful information compared to the ICF-based global and grid-based local features. After applying the techniques proposed in this thesis to four standard texture collections, we show that, while hand-tuned features can work well for their target collection, the automatic adaptive features perform better for the general case.