Latent factor model based zero-shot learning

Abstract

The key of zero-shot learning is to design an appropriate approach to capture the potential relevance between the image visual features and category-level semantic knowledge. There is a lot of data with matrix form in zero-shot recognition problem, such as image label matrix, visual feature matrix and semantic information matrix. Inspired by the latent factor model which tackles recommendation problems well avoid being influenced by sparse matrix, we regard an image as a user and analogize each dimension of the visual feature as an item. The key to our approach is that we model the image recognition as a special recommendation problem by aid of latent factor model. We evaluate our algorithm on three classic benchmark data sets for both conventional and generalized zero-shot setting, the classification results outperform significantly the state-of-art approaches with low calculation cost.