Hindi named entity recognition using system combination

Abstract

This paper reports development of Hindi named entity recognition (NER) system using various machine learning algorithms and their combination. Three machine learning algorithms namely simple K-nearest neighbour (KNN), weighted K-nearest neighbour and HMM have been used for developing three different Hindi NER systems which are finally combined through majority voting to develop an improved hybrid NER system. We have designed set of novel features which have been used for improving the performances of the KNN-based NER systems. A comparative study among our developed NER models has been made based on some standard data sets. This study reveals that performance of the weighted KNN-based NER system is comparable with that of the HMM-based NER system and performance of the hybrid system is significantly better than each individual base model. Our experimental results also show that performance of the hybrid NER system is better than some existing state-of-the art Hindi NER systems.