UDIS: Enhancing Collaborative Filtering with Fusion of Dimensionality Reduction and Semantic Similarity

Abstract

In the era of vast information, individuals are immersed in choices when purchasing goods and services. Recommender systems (RS) have emerged as vital tools to navigate these excess options. However, these systems encounter challenges like data sparsity, impairing their effectiveness. This paper proposes a novel approach to address this issue and enhance RS performance. By integrating user demographic data, singular value decomposition (SVD) clustering, and semantic similarity in collaborative filtering (CF), we introduce the UDIS method. This method amalgamates four prediction types—user-based CF (U), demographic-similarity-based (D), item-based CF (I), and semantic-similarity-based (S). UDIS generates separate predictions for each category and evaluates four different merging techniques—the average, max, weighted sum, and Shambour methods—to integrate these predictions. Among these, the average method proved most effective, offering a balanced approach that significantly improved precision and accuracy on the MovieLens dataset compared to alternative methods.