Towards similar alignment and unique uniformity in collaborative filtering

Abstract

Representation learning, with its desired properties, including Alignment and Uniformity, has recently emerged as an effective approach in collaborative filtering (CF) for recommender systems. Alignment measures the distance between positive pairs, and uniformity describes the distribution of all samples on the unit hypersphere. Despite the effectiveness of existing research, the challenges of insufficient alignment and uniformity bias persist in studies on the desired properties of recommender systems: (1) Sparse interaction information leads to an insufficient alignment representation. (2) Calculating the uniformity loss based on duplicate samples introduces bias, which affects the overall representation uniformity.Building on aforementioned challenges, we propose a Similar Alignment and Unique Uniformity model called SUAU. SUAU mitigates insufficient alignment by introducing additional item-similar item pairs for model training and employing a uniqueness strategy to prevent uniformity bias. More specifically, we propose a similar items generation method that identifies the most similar items based on the interaction behavior of the original items’ related users to form item-similar item pairs. The experimental results obtained on three highly sparse datasets demonstrate that the propose model achieves superior alignment and uniformity compared with state-of-the-art models, notably surpassing the best CF methods in terms of recommendation performance. We have open-sourced the source code on a publicly accessible website: https://github.com/ZzYUuuu/SUAU.