Development of Data Analysis Method for the Preprocessing of Natural Language Texts

Abstract

A method based on Data Mining and natural language text preprocessing approaches to form a document corpus is proposed. The aim of the study is to develop a method of Data Analysis for the preprocessing of natural language texts of professional standards and structural elements of educational content. To achieve this goal, a study of the structural elements of educational and professional content, the corpus of documents and the database of competencies was made. The content of the topic planning of syllabuses has considered as educational content. Professional content was presented as a requirement in the professional standards of labor functions and competencies. It also describes a Data Mining method and an approach to the preprocessing of natural language texts. The result was a corpus of documents extracted from large volumes of semi-structured documents.