Development and Study of an Approach for Determining Incorrect Words of the Kazakh Language in Semi-structured Data

Abstract

Research in the field of computer linguistics is relevant due to the rapid growth of information in natural languages on the Internet and social networks. Currently, there is an increase in the amount of information that humans and machines create in natural language. Information retrieval systems, dialog systems, machine translation, and automatic resume tools, spelling check modules analyze and process texts in natural languages. Thus, the range of automatic word processing systems is wide and covers a variety of tasks. One of the most important tasks of natural language processing (NLP) is to find errors in texts and including words, identify and correct incorrect words. The article provides an overview of semi-structured data, methods, and technologies for detecting incorrect words in natural languages. An approach for identifying incorrect words in the Kazakh language was developed and the features and capabilities of this approach were analyzed. A comparative analysis of texts on the Internet and social networks and of technologies that identify incorrect words in natural languages has been carried out.