Collaborative filtering algorithms are prone to mainstream-taste bias

Pantelis Pipergias Analytis*, Philipp Hager*

*Kontaktforfatter

Publikation: Kapitel i bog/rapport/konference-proceedingKonferencebidrag i proceedingsForskningpeer review

Abstract

Collaborative filtering has been a dominant approach in the recommender systems community since the early 1990s. Collaborative filtering (and other) algorithms, however, have been predominantly evaluated by aggregating results across users or user groups. These performance averages hide large disparities: an algorithm may perform very well for some users (or groups) and poorly for others. We show that performance variation is large and systematic. In experiments on three large-scale datasets and using an array of collaborative filtering algorithms, we demonstrate large performance disparities across algorithms, datasets and metrics for different users. We then show that two key features that characterize users, their mean taste similarity and dispersion in taste similarity with other users, can systematically explain performance variation better than previously identified features. We use these two features to visualize algorithm performance for different users and we point out that this mapping can capture different categories of users that have been proposed before. Our results demonstrate an extensive mainstream-taste bias in collaborative filtering algorithms, which implies a fundamental fairness limitation that needs to be mitigated.

OriginalsprogEngelsk
TitelProceedings of the 17th ACM Conference on Recommender Systems, RecSys 2023
Antal sider7
ForlagAssociation for Computing Machinery
Publikationsdato14. sep. 2023
Sider750-756
ISBN (Elektronisk)9798400702419
DOI
StatusUdgivet - 14. sep. 2023
Begivenhed17th ACM Conference on Recommender Systems, RecSys 2023 - Singapore, Singapore
Varighed: 18. sep. 202322. sep. 2023

Konference

Konference17th ACM Conference on Recommender Systems, RecSys 2023
Land/OmrådeSingapore
BySingapore
Periode18/09/202322/09/2023

Bibliografisk note

Funding Information:
We would like to thank Joseph Konstan and Thorsten Joachims for their insightful remarks and K. Rhett Nichols for editing the manuscript. The presented research was supported by a Sapere Aude starting grant to Pantelis P. Analytis bestowed by the Independent Research Fund Denmark.

Publisher Copyright:
© 2023 ACM.

Fingeraftryk

Dyk ned i forskningsemnerne om 'Collaborative filtering algorithms are prone to mainstream-taste bias'. Sammen danner de et unikt fingeraftryk.

Citationsformater