Classification Based on Brain Storm Optimization With Feature Selection

Abstract

Classification is one of the most classic problems in machine learning. Due to the global optimization ability, evolutionary computation (EC) techniques have been successfully applied to solve many problems and the evolutionary classification model is one of the methods used to solve classification problems. Recently, some evolutionary algorithms (EAs) such as the fireworks algorithm (FWA) and brain storm optimization (BSO) algorithm have been employed to implement the evolutionary classification model and achieved the desired results. This means that it is feasible to use EC techniques to solve the classification problem directly. However, the existing evolutionary classification model still has some disadvantages. The limited datasets used in the experiment make the experimental results not convincing enough, and more importantly, the structure of the evolutionary classification model is closely related to the dimension of datasets, which may lead to poor classification performance, especially on large-scale datasets. Therefore, this paper aims at improving the structure of the evolutionary classification model to improve classification performance. Feature selection is an effective method to deal with large datasets, firstly, we introduce the concept of feature selection and use the different feature subsets to construct the structure of the evolutionary classification model. Then, the BSO algorithm is employed to implement the evolutionary classification model to search the optimal structure by search for the optimal feature subset. Moreover, the optimal weight parameters corresponding to the different structures are also searched by the BSO algorithm while searching the optimal feature subset. For verification of the classification effectiveness of the proposed method, 11 different datasets are selected for experiments. The results show that it is feasible to optimize the structure of the evolutionary classification model by introducing feature selection. Moreover, the new method has better classification performance than the original method, especially on large-scale or high-dimensional datasets.