A Probabilistic Feature Based Maximum Entropy Model for Chinese Named Entity Recognition

Abstract

This paper proposes a probabilistic feature based Maximum Entropy (ME) model for Chinese named entity recognition. Where, probabilistic feature functions are used instead of binary feature functions, it is one of the several differences between this model and the most of the previous ME based model. We also explore several new features in our model, which includes confidence functions, position of features etc. Like those in some previous works, we use sub-models to model Chinese Person Names, Foreign Names, location name and organization name respectively, but we bring some new techniques in these sub-models. Experimental results show our ME model combining above new elements brings significant improvements.