Empirical feature analysis for dialogue breakdown detection

Abstract

Chat-oriented dialogue systems sometimes generate inappropriate response utterances to user utterances that cause dialogue breakdown. Detecting such inappropriate utterances and suppressing them will support the continuation of the dialogue. Although a previous state-of-the-art dialogue breakdown detector leveraged dialogue-act transitions and word-based similarities between utterance pairs, these features are insufficient to evaluate the appropriateness of question-answering or relatedness between utterances that share few topic words. In this paper, we propose novel features to assess these problems, and examine their effectiveness for improving the performance of dialogue breakdown detection.