Exploiting Visual Contents in Posters and Still Frames for Movie Recommendation

Abstract

Recommender systems, e.g., movie recommendation, play an important role in our life. However, few movie recommendation methods have considered the rich visual content information in posters and still frames, which can be used to alleviate the data sparsity and cold start problems in recommendation. Moreover, no existing paper has taken visual feature learning and recommendation into a unified optimization process. To this end, in this paper, we focus on how to use visual contents to improve the performance of movie recommendation and propose a novel movie recommendation model named unified visual contents matrix factorization (UVMF) that integrates visual feature extraction and recommendation into a unified framework. Specifically, we integrate convolutional neural network into probabilistic matrix factorization, and the model can be trained end-to-end. Moreover, we unfix weights in the last few layers of VGG16 to learn features and adapt them for the movie recommendation task. Finally, the experimental results on real-world data show that UVMF outperforms other benchmark methods in terms of recommendation accuracy.