Abstract

Endowing a task-oriented dialogue system with adaptiveness to user personality can greatly help improve the performance of a dialogue task. However, such a dialogue system can be practically challenging to implement, because it is unclear how user personality influences dialogue task performance. To explore the relationship between user personality and dialogue task performance, we enrolled participants via crowdsourcing to first answer specified personality questionnaires and then chat with a dialogue system to accomplish assigned tasks. A rule-based dialogue system on the prevalent Multi-Domain Wizard-of-Oz (MultiWOZ) task was used. A total of 211 participants’ personalities and their 633 dialogues were collected and analyzed. The results revealed that sociable and extroverted people tended to fail the task, whereas neurotic people were more likely to succeed. We extracted features related to user dialogue behaviors and performed further analysis to determine which kind of behavior influences task performance. As a result, we identified that average utterance length and slots per utterance are the key features of dialogue behavior that are highly correlated with both task performance and user personality.

Highlights

  • Personality is the characteristics of behavior, cognition, and emotional patterns that evolve from biological and environmental factors (Corr and Matthews, 2020)

  • Endowing a task-oriented dialogue system with adaptiveness to user personality can greatly help improve the performance of a dialogue task

  • Two problems remain that hinder the dialogue system adapting to user personality to achieve better task performance: (1) what kind of personality traits are correlated with task performance and (2) how the personality on the prevalent Multi-Domain Wizard-of-Oz (MultiWOZ) task was used

Read more

Summary

Related Work

Related studies can be classified into: (1) the exploration of correlations between personality and dialogue system performance, (2) the application of personality to a dialogue system, and (3) useradaptive dialogue system. Nass and Lee (2000) explored the differences between extroverts and introverts in speaking, such as pitch and volume. The aim of our research is to find out the influences of personality on task performance to benefit further development of a dialogue system that can adapt to user personality to achieve better dialogue task performance. Thoughtful way) and agreeableness (the tendency to be compassionate and cooperative toward others) have been found to be important factors influencing the dialogue in customer service (Blignaut et al, 2014; Sackett and Walmsley, 2014). Qiu et al (2017) examined the consistency of the correlation between personality and word usage in

Approach
Description of HIT
Description of Dialogue System
Data Analysis
Data Processing
Analysis between Dialogue Behavior and Task Performance
Findings
Conclusion and Future Work
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call