Wrapper-based Subset Selection Research Articles

Facial emotion recognition using enhanced multi-verse optimizer method

In recent years, facial emotion recognition has gained significant improvement and attention. This technology utilizes advanced algorithms to analyze facial expressions, enabling computers to detect and interpret human emotions accurately. Its applications span over a wide range of fields, from improving customer service through sentiment analysis, to enhancing mental health support by monitoring emotional states. However, there are several challenges in facial emotion recognition, including variability in individual expressions, cultural differences in emotion display, and privacy concerns related to data collection and usage. Lighting conditions, occlusions, and the need for diverse datasets also impacts accuracy. To solve these issues, an enhanced multi-verse optimizer (EMVO) technique is proposed to improve the efficiency of recognizing emotions. Moreover, EMVO is used to improve the convergence speed, exploration-exploitation balance, solution quality, and the applicability in different types of optimization problems. Two datasets were used to collect the data, namely YouTube and surrey audio-visual expressed emotion (SAVEE) datasets. Then, the classification is done using the convolutional neural networks (CNN) to improve the performance of emotion recognition. When compared to the existing methods shuffled frog leaping algorithm-incremental wrapper-based subset selection (SFLA-IWSS), hierarchical deep neural network (H-DNN) and unique preference learning (UPL), the proposed method achieved better accuracies, measured at 98.65% and 98.76% on the YouTube and SAVEE datasets, respectively.

P.1.a.003 - PDE7B, NMBR and EPM2A variants and schizophrenia: a case-control and pharmacogenetics study

Using a large set of ultrasound features does not necessarily ensure improved quantitative classification of breast tumors; rather, it often degrades the performance of a classifier. In this paper, we propose an effective feature reduction approach in the transform domain for improved multi-class classification of breast tumors. Feature transformation methods, such as empirical mode decomposition (EMD) and discrete wavelet transform (DWT), followed by a filter- or wrapper-based subset selection scheme are used to extract a set of non-redundant and more potential transform domain features through decorrelation of an optimally ordered sequence of N ultrasonic bi-modal (i.e., quantitative ultrasound and elastography) features. The proposed transform domain bi-modal reduced feature set with different conventional classifiers will classify 201 breast tumors into benign-malignant as well as BI-RADS ⩽ 3, 4, and 5 categories. For the latter case, an inadmissible error probability is defined for the subset selection using a wrapper/filter. The classifiers use train truth from histopathology/cytology for binary (i.e., benign-malignant) separation of tumors and then bi-modal BI-RADS scores from the radiologists for separating malignant tumors into BI-RADS category 4 and 5. A comparative performance analysis of several widely used conventional classifiers is also presented to assess their efficacy for the proposed transform domain reduced feature set for classification of breast tumors. The results show that our transform domain bimodal reduced feature set achieves improvement of 5.35%, 3.45%, and 3.98%, respectively, in sensitivity, specificity, and accuracy as compared to that of the original domain optimal feature set for benign-malignant classification of breast tumors. In quantitative classification of breast tumors into BI-RADS categories ⩽ 3, 4, and 5, the proposed transform domain reduced feature set attains improvement of 3.49%, 9.07%, and 3.06%, respectively, in likelihood of malignancy and 4.48% in inadmissible error probability compared to that of the original domain optimal subset. In summary, the construction of a transform domain reduced feature set by extracting complementary information from a large set of available bi-modal features and use of qualitative bi-modal BI-RADS can contribute to improved quantitative classification of breast tumors and thereby help reduce the number of unnecessary biopsies, securing a nearly minimum chance of a life-endangering diagnosis.

EMD-DWT based transform domain feature reduction approach for quantitative multi-class classification of breast lesions

Using a large set of ultrasound features does not necessarily ensure improved quantitative classification of breast tumors; rather, it often degrades the performance of a classifier. In this paper, we propose an effective feature reduction approach in the transform domain for improved multi-class classification of breast tumors. Feature transformation methods, such as empirical mode decomposition (EMD) and discrete wavelet transform (DWT), followed by a filter- or wrapper-based subset selection scheme are used to extract a set of non-redundant and more potential transform domain features through decorrelation of an optimally ordered sequence of N ultrasonic bi-modal (i.e., quantitative ultrasound and elastography) features. The proposed transform domain bi-modal reduced feature set with different conventional classifiers will classify 201 breast tumors into benign-malignant as well as BI-RADS⩽3, 4, and 5 categories. For the latter case, an inadmissible error probability is defined for the subset selection using a wrapper/filter. The classifiers use train truth from histopathology/cytology for binary (i.e., benign-malignant) separation of tumors and then bi-modal BI-RADS scores from the radiologists for separating malignant tumors into BI-RADS category 4 and 5. A comparative performance analysis of several widely used conventional classifiers is also presented to assess their efficacy for the proposed transform domain reduced feature set for classification of breast tumors. The results show that our transform domain bimodal reduced feature set achieves improvement of 5.35%, 3.45%, and 3.98%, respectively, in sensitivity, specificity, and accuracy as compared to that of the original domain optimal feature set for benign-malignant classification of breast tumors. In quantitative classification of breast tumors into BI-RADS categories⩽3, 4, and 5, the proposed transform domain reduced feature set attains improvement of 3.49%, 9.07%, and 3.06%, respectively, in likelihood of malignancy and 4.48% in inadmissible error probability compared to that of the original domain optimal subset. In summary, the construction of a transform domain reduced feature set by extracting complementary information from a large set of available bi-modal features and use of qualitative bi-modal BI-RADS can contribute to improved quantitative classification of breast tumors and thereby help reduce the number of unnecessary biopsies, securing a nearly minimum chance of a life-endangering diagnosis.

On the Stability of Feature Selection Methods in Software Quality Prediction: An Empirical Investigation

Software quality modeling is the process of using software metrics from previous iterations of development to locate potentially faulty modules in current under-development code. This has become an important part of the software development process, allowing practitioners to focus development efforts where they are most needed. One difficulty encountered in software quality modeling is the problem of high dimensionality, where the number of available software metrics is too large for a classifier to work well. In this case, many of the metrics may be redundant or irrelevant to defect prediction results, thereby selecting a subset of software metrics that are the best predictors becomes important. This process is called feature (metric) selection. There are three major forms of feature selection: filter-based feature rankers, which uses statistical measures to assign a score to each feature and present the user with a ranked list; filter-based feature subset evaluation, which uses statistical measures on feature subsets to find the best feature subset; and wrapper-based subset selection, which builds classification models using different subsets to find the one which maximizes performance. Software practitioners are interested in which feature selection methods are best at providing the most stable feature subset in the face of changes to the data (here, the addition or removal of instances). In this study we select feature subsets using fifteen feature selection methods and then use our newly proposed Average Pairwise Tanimoto Index (APTI) to evaluate the stability of the feature selection methods. We evaluate the stability of feature selection methods on a pair of subsamples generated by our fixed-overlap partitions algorithm. Four different levels of overlap are considered in this study. 13 software metric datasets from two real-world software projects are used in this study. Results demonstrate that ReliefF (RF) is the most stable feature selection method and wrapper based feature subset selection shows least stability. In addition, as the overlap of partitions increased, the stability of the feature selection strategies increased.

IMPROVING INCREMENTAL WRAPPER-BASED SUBSET SELECTION VIA REPLACEMENT AND EARLY STOPPING

This paper deals with the problem of feature subset selection in classification-oriented datasets with a (very) large number of attributes. In such datasets complex classical wrapper approaches become intractable due to the high number of wrapper evaluations to be carried out. One way to alleviate this problem is to use the so-called filter-wrapper approach or Incremental Wrapper-based Subset Selection (IWSS), which consists of the construction of a ranking among the predictive attributes by using a filter measure, and then a wrapper approach is used by following the rank. In this way the number of wrapper evaluations is linear on the number of predictive attributes. In this paper we present two contributions to the IWSS approach. The first one is related with obtaining more compact subsets, and enables not only the addition of new attributes but also their interchange with some of those already included in the selected subset. Our second contribution, termed early stopping, sets an adaptive threshold on the number of attributes in the ranking to be considered. The advantages of these new approaches are analyzed both theoretically and experimentally. The results over a set of 12 high-dimensional datasets corroborate the success of our proposals.