Abstract

Purpose of research. The research described in this article is conducted within the Salebot.pro project (on the https://salebot.pro resource) and aimed at development of simple and effective realization of a dialog system. Methods . The research plan provided the analysis of various methods of natural processing languages and machine learning languages. Implementation of these methods was taken from popular libraries with an open source code. The model of a dialog system was made in two options: on the basis of Spacy freymvork and metric assessment algorithm, on the basis of Levenstein's distance. Simplicity of implementation and costs on training of a system and personnel were compared. Results. The algorithms described in article compare the most similar words from two texts and count average percent of coincidence. Such approach provides a possibility of acceptable work in languages with free word order. Russian is one such languages. The executed research allowed developing an automated training algorithm of dialog systems in real time without context loss. On the same basis training algorithm of a dialog system in dialog history is developed. It is offered to use these algorithms together. It is originally necessary to train it at history of dialogues during creation of a dialogue system. And then it is necessary to train it permanently in real time. Conclusion. The advantage of the developed algorithm is ease in implementation and low cost of infrastructure which is necessary for model training and its service and also operation simplicity. Approach which differs from training with the teacher allows accelerating training process and input of new data into the system. Specific feature of the developed algorithms is ignoring of text semantics that makes training automated but not automatic.

Highlights

  • После обучения необходимо в ручном режиме проверить результаты и выбрать те состояния диалога, которые не связаны с предыдущими репликами

  • Computer Engineering Dept., Hacettepe University, Beytepe-Ankara, Turkey, 2018

Read more

Summary

Алгоритмы автоматизированного обучения диалоговых систем

Представленное в данной статье исследование проведено в рамках проекта Salebot.pro (на ресурсе https://salebot.pro) и было нацелено на разработку простой и эффективной реализации диалоговой системы. План исследования предусматривал анализ различных методов обработки естественных языков и машинного обучения. Сравнивались простота реализации и затраты на обучение системы и персонала. Выполненное исследование позволило разработать алгоритм автоматизированного обучения диалоговых систем в режиме реального времени без потери контекста. На той же основе разработан алгоритм обучения диалоговой системы по истории диалога. При создании диалоговой системы первоначально необходимо ее обучить на истории диалогов, а затем перманентно обучать в режиме реального времени. Достоинством разработанного алгоритма является легкость в реализации и дешевизна построения инфраструктуры, необходимой для обучения модели, и ее обслуживания, а также простота в эксплуатации. Алгоритмы автоматизированного обучения диалоговых систем // Известия Юго-Западного государственного университета.

Материалы и методы решения задачи
Алгоритм обучения по истории диалогов
Алгоритм обучения в режиме реального времени
Результаты и их обсуждения
Список литературы
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.