Abstract
Recommender systems have become the dominant means of curating cultural content, significantly influencing the nature of individual cultural experience. While the majority of academic and industrial research on recommender systems optimizes for personalized user experience, this paradigm does not capture the ways that recommender systems impact cultural experience in the aggregate, across populations of users. Although existing novelty, diversity, and fairness studies probe how recommender systems relate to the broader social role of cultural content, they do not adequately center culture as a core concept and challenge. In this work, we introduce commonality as a new measure of recommender systems that reflects the degree to which recommendations familiarize a given user population with specified categories of cultural content. Our proposed commonality metric responds to a set of arguments developed through an interdisciplinary dialogue between researchers in computer science and the social sciences and humanities. With reference to principles underpinning public service media (PSM) systems in democratic societies, we identify universality of address and content diversity in the service of strengthening cultural citizenship as particularly relevant goals for recommender systems delivering cultural content. We develop commonality as a measure of recommender system alignment with the promotion of a shared cultural experience of, and exposure to, diverse cultural content across a population of users. Moreover, we advocate for the involvement of human editors accountable to a larger value community as a fundamental part of defining categories in the service of cultural citizenship. We empirically compare the performance of recommendation algorithms using commonality with existing utility, diversity, novelty, and fairness metrics using three different domains. Our results demonstrate that commonality captures a property of system behavior complementary to existing metrics and suggests the need for alternative, non-personalized interventions in recommender systems oriented to strengthening cultural citizenship across populations of users. Moreover, commonality demonstrates both consistent results under different editorial policies and robustness to missing labels and users. Alongside existing fairness and diversity metrics, commonality contributes to a growing body of scholarship developing “public good” rationales for digital media and machine learning systems.
Highlights
AND BACKGROUNDOnline platforms that host cultural content such as music, movies, and literature use recommender systems to suggest and distribute items from their catalogs employing the principle of personalization
Our results demonstrate that existing high-utility recommendation algorithms under-perform in terms of commonality
We have attempted to model two of the most important principles: universality and diversity, in the service of progress towards a third— cultural citizenship. We suggest that this is in itself a satisfactory achievement, and we propose to follow up other aspects of the normative perspectives laid out in the first part in future papers
Summary
AND BACKGROUNDOnline platforms that host cultural content such as music, movies, and literature use recommender systems to suggest and distribute items from their catalogs employing the principle of personalization. We measure the degree to which a recommender system succeeds in personalization by adopting various offline metrics (e.g., precision, NDCG) and online metrics (e.g., clickthrough rate, consumption) [27]. Evaluation using these metrics is appealing in commercial settings, because they are aligned with revenue-generating metrics such as retention and subscriptions. Increasing evidence suggests that, while the degree of personalization is one desirable property of a recommender system, it does not capture the wider effects of recommender systems in aggregate, nor does it measure the effects of recommender systems across a population of users. This is important, because personalized recommendations are likely to have cumulative effects, shaping the wider cultures and societies within which they are being used [2]
Published Version (
Free)
Join us for a 30 min session where you can share your feedback and ask us any queries you have