A mutual information and information entropy pair based feature selection method in text classification

Zhili Pei Zhili Pei,Lisha Liu Lisha Liu,Yinan Lu Yinan Lu,Lihua Wang Lihua Wang,Ying Kong Ying Kong,Yuxin Zhou Yuxin Zhou

doi:10.1109/iccasm.2010.5620805

A mutual information and information entropy pair based feature selection method in text classification

Zhili Pei Zhili Pei, Lisha Liu Lisha Liu + Show 4 more

https://doi.org/10.1109/iccasm.2010.5620805

Copy DOI

Publication Date: Oct 1, 2010

Citations: 5

Affiliation: Jilin University, Jilin Province Science and Technology Department, Inner Mongolia University for Nationalities, Dalian Medical University

#Mutual Information Entropy #Theory Of Information Entropy + Show 8 more

Abstract
Full-Text PDF
Similar Papers

Abstract

Text classification is an important research field of data mining topics. This article brings a mutual information and information entropy pair based feature selection method (MIIEP_FS) based on the theory of information entropy and information entropy pair concept. This method measure the classification effect using feature by mutual information method and show the difference extent between the features being selected and the ones selected by information entropy. The experimental results show that the MIIEP_FS method proposed is more effective than MI and CHI methods. Macro F1 degrees of different kinds of machine learning algorithms: Naive Bayes and KNN method are higher by MIIEP_FS method, sometimes even more than the ones of support vector machines.

Full Text