Abstract

This paper proposes an interactive dialog system, called AidIR, to aid information retrieval. AidIR allows users to retrieve information on diseases resulting from coronaviruses and diseases transmitted by vector mosquitoes with natural language interaction and Line chat media. In a subjective evaluation, we asked 20 users to rate the intuitiveness, usability, and user experience of AidIR with a range between −2 and 2. Moreover, we also asked these users to answer yes–no questions to evaluate AidIR and provide feedback. The average scores of intuitiveness, usability, and user experience are 0.8, 0.8, and 1.05, respectively. The yes–no questions demonstrated that AidIR is better than systems using the graphical user interface in mobile phones and single-turn dialog systems. According to user feedback, AidIR is more convenient for information retrieval. Moreover, we designed a new loss function to jointly train a BERT model for domain classification and sequence label tasks. The accuracy of both tasks is 92%. Finally, we trained the dialog policy network with supervised learning tasks and deployed the reinforcement learning algorithm to allow AidIR to continue learning the dialog policy.

Highlights

  • Academic Editors: Yuen-Hsien Tseng, According to the statistics of We Are Social [1], nearly 66.6% of the population are unique mobile users

  • We discuss the experimental results of our models

  • We examine the performance of the ABERT model

Read more

Summary

Introduction

Academic Editors: Yuen-Hsien Tseng, According to the statistics of We Are Social [1], nearly 66.6% of the population are unique mobile users. A more intuitive system that allows end-users to use the Chinese language to retrieve information is crucial to research. Current dialog systems such as Google Assistant and Microsoft Cortana cannot entirely address the problems of current systems using GUI. These systems usually focus on automating tasks in mobile phones and computers. The usability, intuitiveness, and user experiences of current dialog systems and systems using GUI still have much to improve upon To address their issues, an intuitive information retrieval system in mobile phones is studied in this paper.

Task-Oriented Dialog System
Architecture of AidIR
Corpus Pre-Processing
Operationalization of Taxonomy
Token Replacement
WordPiece Tokenization
Domain Classification and Sequence Label in AidIR
Pre-Training with Mask LM Task and Medical Corpora
BERT for Sequence Label and Domain Classification
Dialog Management in AidIR
User Dialog Act Detection
Dialog Policy Making
Response Templates Corresponding to Each Dialog Policy
Dialog Policy Learning
Warm-Up Stage
Online Learning Stage
Rewards Corresponding to Each State
Implementation of AidIR
Experimental Results
Fine-Tuning Results of BERT Model with Mask LM Task
Training Results of ABERT
Visualization of ABERT Model
Results of Dialog Act Models
Results of Subjective Evaluation
Comparison between AidIR and Systems with GUI
AidIR Requests and Checks Information
AidIR Checks with User but Got Rejected
User Asks Many Questions Related to One Disease
Error Information Included in Rejection Dialog
AidIR Requests More Information
Conclusions
Future Works
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call