An investigation on the user interaction modes of conversational recommender systems for the music domain

Abstract

Conversational Recommender Systems (CoRSs) implement a paradigm that allows users to interact in natural language with the system for defining their preferences and discovering items that best fit their needs. CoRSs can be straightforwardly implemented as chatbots that, nowadays, are becoming more and more popular for several applications, such as customer care, health care, and medical diagnoses. Chatbots implement an interaction based on natural language, buttons, or both. The implementation of a chatbot is a challenging task since it requires knowledge about natural language processing and human–computer interaction. A CoRS might be particularly useful in the music domain since music is generally enjoyed in contexts when a standard interface cannot be exploited (driving, doing homeworks, running). However, there is no work in the literature that analytically compares different interaction modes for a conversational music recommender system. In this paper, we focus on the design and implementation of a CoRS for the music domain. Our CoRS consists of different components. The system implements content-based recommendation, critiquing and adaptive strategies, as well as explanation facilities. The main innovative contribution is that the user can interact through different interaction modes: natural language, buttons, and mixed. Due to the lack of available datasets for testing CoRSs, we carried out an in vivo experimental evaluation with the goal of investigating the impact of the different interaction modes on the recommendation accuracy and on the cost of interaction for the final user. The experiment involved 110 people, and 54 completed the whole process. The analysis of the results shows that the best interaction mode is based on a mixed strategy that combines buttons and natural language. In addition, the results allow to clearly understand which are the steps in the dialog that are particularly strenuous for the user.