Context-Aware User and Item Representations Based on Unsupervised Context Extraction From Reviews

Padipat Sitkrongwong,Atsuhiro Takasu,Saranya Maneeroj

doi:10.1109/access.2020.2993063

Abstract

User reviews often supply valuable information to alleviate the rating sparsity problem that can occur in recommender systems. Recent work has employed deep learning techniques to learn user and item representations from reviews, which are then used to predict ratings. Such representations are usually learned by considering every word in previous reviews, including words that are irrelevant to user preferences or item features. Some approaches try to identify and extract significant words from reviews based on a predefined list of contexts, where contexts such as the season or weather could have strong influences on user decisions about items, and which are more relevant to their preferences or sought-after features. Specifying optimal values for contexts, however, is not a trivial task and the values are mostly restricted to a single word format. To overcome these limitations, we propose a novel unsupervised method for extracting contexts from reviews, which are then utilized to construct user and item representations. To this end, we adopt a region embedding technique to automatically extract a context as any word in a text region that influences patterns of rating distributions in reviews. Instead of considering every word in all previous reviews, our user and item representations are dynamically constructed based on different relevance levels among the extracted contexts from a particular review by applying our interaction and attention modules. Experiments demonstrated that utilizing our representations for rating prediction could outperform existing state-of-the-art context-aware and review-based recommendation techniques.

Highlights

User-generated reviews can supply valuable information to alleviate the rating sparsity problem that can occur in the standard collaborative filtering-based (CF-based) recommendation approach, which utilizes rating data alone [1]–[3]
We develop a region embedding technique [24] to emphasize the words in a small text region for consideration as a context, and represent it by region embedding to be used for a rating prediction
We propose an extension to the model developed for our context extraction method [23], namely context-aware region embedding (CARE)

Summary

Introduction

User-generated reviews can supply valuable information to alleviate the rating sparsity problem that can occur in the standard collaborative filtering-based (CF-based) recommendation approach, which utilizes rating data alone [1]–[3]. Recent work has employed deep learning techniques and attention mechanisms to learn representations of users and items from reviews and use them for rating prediction [4]–[7]. These models utilize different types of networks to learn such representations, they share two similar principles that could limit their potential. The associate editor coordinating the review of this manuscript and approving it for publication was Vicente Alarcon-Aquino They consider every word in a review as an input when learning user and item representations. If we can identify and utilize only the words relevant to a specific recommendation domain, the user and item representations could be constructed in a more efficient and meaningful way

Objectives

Methods

Results

Discussion

Conclusion