An embedding and interactions learning approach for ID feature in deep recommender system

Abstract

The embedding of features plays a critical role in the neural network-based recommendation model. The ID feature, which is discrete and high-dimensional sparse, contains the significant information for relevance reasoning in recommender system. However, most models use the same embedding method to address the encoding of all features. This results in inaccurate expression of ID features, as well as reduces the generalization ability of the model. Based on the assumption that learning higher-order information from the mixture of ID and other features by crossover and extraction operations provides limited benefits, or negative results, we propose an ID feature learning model (IFLM) to embed the ID tags independently and learn their interactions efficiently. IFLM separates the ID tags from the complete inputs as its exclusive input, then outputs the vectors with general data structure, thus, making it easily parallel to other deep recommendation models. Besides, IFLM generates the second-order cross feature from pairwise IDs and captures higher-order feature through the specific hidden layer, which is more efficient in learning the knowledge of ID features. We used our approach on three typical deep recommendation models. The experimental results showed that the optimized model produced better results than the corresponding baseline, in terms of prediction accuracy and convergence time.