Design of Korean Text Resource Information Mining and Management Platform

Abstract

This paper applies data mining technology to search for Korean/Korean web pages. After a brief introduction to data mining and information management technology, it mainly studies Korean word segmentation technology, topic prediction, and tunnel crossing strategy. The detailed work is as follows: The word segmentation task is the basis of natural language processing. The first task for Chinese, Japanese, Korean and other characters in various tasks is word segmentation. In terms of Korean/Korean word segmentation, traditional matching-based word segmentation methods often require manual construction of a large dictionary, which does not have the ability to recognize words that are not in the dictionary, and the accuracy of word segmentation is not very high.