Abstract
Latent semantic indexing (LSI) is an important method for information retrieval (IR), in which we can automatically transform the original textual data to a smaller semantic space by take advantage of some of the implicit or latent higher-order structure in associations of words with customized objects, and it also has been successfully applied to text classification. LSI can resolve the problems of polysemy and synonymy, and can reduce noise in the raw document-term matrix. But LSI is not an optimal approach to text classification. Because LSI is a complete unsupervised method, which ignores categories discrimination, it often drops the performance of text classification when it is applied to the whole training documents. In this paper, in order to prevent the spreading of the unsolicited email and harmful message, under multi-languages (Chinese and English) circumstance we have developed a system based on customized email topic being filtered, and we represented topic in Latent Semantic model, and abstract features from predefined email categories and document categories in LSI method. It is able to filter and recognize customized or special unwanted Chinese and English emails in positive examples supervised learning approach. We propose an improving LSI to improve the classification performance by a separate single value decomposition (SVD) on the transformed local region of each category. We apply support vector machine (SVM) classification method to recognize and filter email based on text classifier. The result of the experiment showed that our approach is very effective and has a good filtering performance.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.