A hybrid filter-wrapper feature selection using Fuzzy KNN based on Bonferroni mean for medical datasets classification: A COVID-19 case study

Abstract

Several feature selection methods have been developed to extract the optimal features from a dataset in medical datasets classification. Creating an efficient technique has become a challenge because of the high dimensions, noise, and redundant information. In this paper, we propose a hybrid filter-wrapper approach for feature selection. An ensemble of filter methods, ReliefF and Fuzzy Entropy (RFE) is developed, and the union of top-n features from each method are considered. The Equilibrium Optimizer (EO) technique is combined with Opposition Based Learning (OBL), Cauchy Mutation operator and a novel search strategy to enhance its capabilities. The OBL strategy improves the diversity of the population in the search space. The Cauchy Mutation operator enhances its ability to evade the local optima during the search, and the novel search strategy improves the exploration capability of the algorithm. This enhanced form of EO is integrated with eight time-varying S and V-shaped transfer functions to convert the solutions into binary form, Binary Enhanced Equilibrium Optimizer (BEE). The features from the ensemble are given as input to the Binary Enhanced Equilibrium Optimizer to extract the essential features. Fuzzy KNN based on Bonferroni mean is used as the learning algorithm. Twenty-two benchmark datasets and four microarray datasets are used to test the algorithm’s efficiency. This method is also applied to a COVID-19 case study. The results demonstrate the superiority of the proposed approach, RFE-BEE, among other methods in terms of fitness values, accuracy, precision, sensitivity, and F-measure, among several other state-of-the-art algorithms. RFE-BEE can be applied to various biomedical, computer vision and engineering applications such as electromyography pattern recognition, COVID-19 diagnosis, face recognition and fault diagnosis.