An Approach to Automate the Scientific Paper's Evaluation Based on NLP Technologies: the Experience in the Russian Segment of Financial Technologies Field

Abstract

This paper reflects the research to design and application the complex method to evaluate the quality of the paper written in the IMRaD format. As a field we choose Russian segment of the financial technologies area since we had interest to use multilingual language model. The method covers paper's relevance to the chosen field and internal topics, the actuality, relation between parts, text borrowing, and experiment part. The clustering and classifying algorithms, and language machine learning model were used. The experimental part based on corpus of Russian papers shows the deviation of method's recommendations from expert opinion not more than 20%. The results may be interested not only reviewers but student as authors of futures papers to avoid common mistakes during paper's writing.