Particle Swarm Optimization Based Feature Selection Research Articles

Binary Particle Swarm Optimization-Based Feature Selection for Predicting the Class of the Knee Angle from EMG Signals in Lower Limb Movements

Binary Particle Swarm Optimization-Based Feature Selection for Predicting the Class of the Knee Angle from EMG Signals in Lower Limb Movements

Complement component face space for 3D face recognition from range images

This paper proposes a mathematical model for decomposing a range face image into four basic components (named ‘complement components’) in conjunction with a simple approach for data-level fusion to generate thirty-six additional hybrid components. These forty component faces composing a new face image space called the ‘complement component face space.’ The main challenge of this work was to extract relevant features from the vast face space. Features are extracted from the four basic components and four selected hybrid components using singular value decomposition. To introduce diversity, the extracted feature vectors are fused by applying the crossover operation of the genetic algorithm using a Hamming distance-based fitness measure. Particle swarm optimization-based feature selection is employed on the fused features to discard redundant feature values and to maximize the face recognition performance. The recognition performances of the proposed feature set with a support vector machine-based classifier on three accessible and well-known 3D face databases, namely, Frav3D, Bosphorus, and Texas3D, show significant improvements over those achieved by state-of-the-art methods. This work also studies the feasibility of utilizing the component images in the complement component face space for data augmentation in convolutional neural network (CNN)-based frameworks.

Incorporation of multimodal multiobjective optimization in designing a filter based feature selection technique

Current work reports about the development of a new feature selection technique fusing two concepts, multimodal multiobjective optimization and filter-based feature selection. Use of the concept of multimodality in multiobjective based feature selection helps in generating diverse set of feature subsets on final Pareto front. This approach evaluates the quality of the reduced feature set by utilizing different quality measures. This process of feature selection focuses on achieving two discrete objectives: (1) identification of a large number of Pareto-optimal solutions along with achieving a good distribution in both objective and decision spaces; (2) making a selection of feature subset with minimal redundancy and high correlation with classes. To achieve the second objective, a variety of objective functions based on information-theoretic measures like normalized mutual information and correlation with class attributes are utilized. A multiobjective ring-based Particle swarm Optimization (PSO) and non-dominated sorting with special crowding distance are employed to cover the aspects corresponding to the first objective. An evaluation is carried out on seven publicly available datasets concerning different classifiers. The results of these experiments illustrate that the multimodal PSO based feature selection approach finds more feature subsets than its simple PSO counterpart in multiobjective environment. And, the results are also compared with those of existing wrapper based multimodal multiobjective feature selection methods.

A particle swarm optimization-based feature selection for unsupervised transfer learning

Transfer learning (TL) method has captured an attractive presence because it facilitates the learning ability in the target domain by acquiring knowledge from well-established source domains. To gain strong knowledge from the source domain, it is important to narrow down the distribution difference between the source and the target domains. For this purpose, it is necessary to consider the objectives such as preserving the discriminative information, preserving the original similarity of the source and the target domain data, maximizing the variance of the target domain, and preserving marginal and conditional distribution at the same time. Furthermore, some existing TL methods use only original feature data, so there is a threat of degenerated feature transformation. To overcome all these limitations, in this paper, a novel feature selection-based transfer learning approach using particle swarm optimization (PSO) for unsupervised transfer learning (FSUTL-PSO) is implemented. In FSUTL-PSO, we incorporate all such objectives into one fitness function and select common good features from the source and target domains based on the fitness function for eliminating the threat of degenerated features. Extensive experiments have been done on all possible tasks of Office+Caltech and PIE Face datasets and our proposed method FSUTL-PSO has shown significant improvement over the existing transfer or non-transfer learning methods.

Improving an Intelligent Detection System for Coronary Heart Disease Using a Two-Tier Classifier Ensemble.

Coronary heart disease (CHD) is one of the severe health issues and is one of the most common types of heart diseases. It is the most frequent cause of mortality across the globe due to the lack of a healthy lifestyle. Owing to the fact that a heart attack occurs without any apparent symptoms, an intelligent detection method is inescapable. In this article, a new CHD detection method based on a machine learning technique, e.g., classifier ensembles, is dealt with. A two-tier ensemble is built, where some ensemble classifiers are exploited as base classifiers of another ensemble. A stacked architecture is designed to blend the class label prediction of three ensemble learners, i.e., random forest, gradient boosting machine, and extreme gradient boosting. The detection model is evaluated on multiple heart disease datasets, i.e., Z-Alizadeh Sani, Statlog, Cleveland, and Hungarian, corroborating the generalisability of the proposed model. A particle swarm optimization-based feature selection is carried out to choose the most significant feature set for each dataset. Finally, a two-fold statistical test is adopted to justify the hypothesis, demonstrating that the performance differences of classifiers do not rely upon an assumption. Our proposed method outperforms any base classifiers in the ensemble with respect to 10-fold cross validation. Our detection model has performed better than current existing models based on traditional classifier ensembles and individual classifiers in terms of accuracy, F1, and AUC. This study demonstrates that our proposed model adds a considerable contribution compared to the prior published studies in the current literature.

Multi-Objective Particle Swarm Optimization-based Feature Selection for Face Recognition

Multi-Objective Particle Swarm Optimization-based Feature Selection for Face Recognition

An Selection System For Automotive Sentiment Classification In Hadoop Using KNN Classifier

With the growing popularity of big data analytics in the area of online product review, the biggest issue is voluminous data. Sentiment analysis and opinion mining are useful for solving text and web based issues. For sentiment analysis, this work makes use of the Hadoop framework. The Hadoop is not only reliable but also a fault immune model for processing huge amounts of data. There is a critical role that is played by sentiment analysis in text mining purposes such as in consumer attitude recognition, trade name and product spotting, customer relationship management, and market research. Data is labelled either as subjective or objective based on the subjectivity classification. This subjective classification is further divided as positive, negative or neutral by sentiment classification. The sentiment is classified based on the features which are taken from the data. As feature selection contributes in conserving the classification expense with regard to time and computation load, feature selection has gained a lot of prominence. This work uses the Term Frequency (TF) feature extraction. The objective here is using feature selection based on information Gain (IG) and Particle Swarm Optimization (PSO) for feature selection in sentiment classification. These schemes can decrease the features in the original set as they eliminate redundant features for text sentiment categorization and thus improvise the accuracy of classification. Also, the running time of the learning algorithms is decreased. K-nearest neighbour (KNN) classifier is used for evaluating the suggested scheme. It has been shown by empirical outcomes that compared to the IG based feature selection; the PSO based feature selection scheme attains better and more robust performance.

Genetic Particle Swarm Optimization-Based Feature Selection for Very-High-Resolution Remotely Sensed Imagery Object Change Detection.

In the field of multiple features Object-Based Change Detection (OBCD) for very-high-resolution remotely sensed images, image objects have abundant features and feature selection affects the precision and efficiency of OBCD. Through object-based image analysis, this paper proposes a Genetic Particle Swarm Optimization (GPSO)-based feature selection algorithm to solve the optimization problem of feature selection in multiple features OBCD. We select the Ratio of Mean to Variance (RMV) as the fitness function of GPSO, and apply the proposed algorithm to the object-based hybrid multivariate alternative detection model. Two experiment cases on Worldview-2/3 images confirm that GPSO can significantly improve the speed of convergence, and effectively avoid the problem of premature convergence, relative to other feature selection algorithms. According to the accuracy evaluation of OBCD, GPSO is superior at overall accuracy (84.17% and 83.59%) and Kappa coefficient (0.6771 and 0.6314) than other algorithms. Moreover, the sensitivity analysis results show that the proposed algorithm is not easily influenced by the initial parameters, but the number of features to be selected and the size of the particle swarm would affect the algorithm. The comparison experiment results reveal that RMV is more suitable than other functions as the fitness function of GPSO-based feature selection algorithm.

Particle Swarm Optimization based Feature Selection

Selection is a pre-processing step in knowledge discovery from data (KDD) which aims at retrieving relevant data from the database beforehand. It imparts quality to the results of data mining tasks by selecting optimal feature set from larger set of features. Various feature selection techniques have been proposed in past which, unfortunately, suffer from unavoidable problems such as high computational cost and getting stuck into the local optima. Evolutionary algorithms such as Particle Swarm Optimization (PSO) possess immense abilities to explore a large search space and rarely fall into local optima thus making them a nice choice for feature selection. In this paper, we have explored pros and cons of traditional and PSO based feature selection techniques and suggested some effective changes in existing approaches. KeywordsSwarm Optimization (PSO), Evolutionary Algorithm

Performance Analysis of GA and PSO based Feature Selection Techniques for Improving Classification Accuracy in Remote Sensing Images

Background/Objectives: - Feature Selection is applicable to decrease the number of features in various applications wherein the data include hundreds and thousands of features. The objective of this study is to choose Genetic Algorithm for feature selection to obtain better fitness function. Methods/Statistical Analysis: Particle Swarm Optimization (PSO) approach is used for selecting the subset from the combination of texture based features and providing the better fitness values. In this paper PSO is used to obtain the feature sets and the performance is compared with genetic algorithm. Support vector machine classifier is used to improve the classification accuracy. Findings: The experimental results shows that PSO overall accuracy is improved to LISS IV 1.7%, 1.4% and 2.9% and the kappa coefficient is improved to 0.06%, 0.012% and 0.39% as compared to GA. Application/Improvements: The Fitness value obtained by GA is more complex and not accurate. To reduce the complexity and increase the accuracy Particle Swarm optimization is used. Hence PSO improved the quality of texture based images.

Particle swarm optimization-based feature selection in sentiment classification

Sentiment classification is one of the important tasks in text mining, which is to classify documents according to their opinion or sentiment. Documents in sentiment classification can be represented in the form of feature vectors, which are employed by machine learning algorithms to perform classification. For the feature vectors, the feature selection process is necessary. In this paper, we will propose a feature selection method called fitness proportionate selection binary particle swarm optimization (F-BPSO). Binary particle swarm optimization (BPSO) is the binary version of particle swam optimization and can be applied to feature selection domain. F-BPSO is a modification of BPSO and can overcome the problems of traditional BPSO including unreasonable update formula of velocity and lack of evaluation on every single feature. Then, some detailed changes are made on the original F-BPSO including using fitness sum instead of average fitness in the fitness proportionate selection step. The modified method is, thus, called fitness sum proportionate selection binary particle swarm optimization (FS-BPSO). Moreover, further modifications are made on the FS-BPSO method to make it more suitable for sentiment classification-oriented feature selection domain. The modified method is named as SCO-FS-BPSO where SCO stands for "sentiment classification-oriented". Experimental results show that in benchmark datasets original F-BPSO is superior to traditional BPSO in feature selection performance and FS-BPSO outperforms original F-BPSO. Besides, in sentiment classification domain, SCO-FS-BPSO which is modified specially for sentiment classification is superior to traditional feature selection methods on subjective consumer review datasets.

Prediction of protein subcellular localization by incorporating multiobjective PSO-based feature subset selection into the general form of Chou's PseAAC.

In this article, the possible subcellular location of a protein is predicted using multiobjective particle swarm optimization-based feature selection technique. In general form of pseudo-amino acid composition, the protein sequences are used for constructing protein features. Here, the different amino acids compositions are used to construct the feature sets. Therefore, the data are presented as sample of protein versus amino acid compositions as features. The proposed algorithm tries to maximize the feature relevance and minimize the feature redundancy simultaneously. After proposed algorithm is executed on the multiclass dataset, some features are selected. On this resultant feature subset, tenfold cross-validation is applied and corresponding accuracy, F score, entropy, representation entropy and average correlation are calculated. The performance of the proposed method is compared with that of its single objective versions, sequential forward search, sequential backward search, minimum redundancy maximum relevance with two schemes, CFS, CBFS, [Formula: see text], Fisher discriminant and a Cluster-based technique.