Genetic Algorithm Based Feature Selection Research Articles

A genetic algorithm-based feature selection approach for diabetes prediction

<p>Genetic algorithms have emerged as a powerful optimization technique for feature selection due to their ability to search through a vast feature space efficiently. This study discusses the importance of feature selection for prediction in healthcare and prominently focuses on diabetes mellitus. Feature selection is essential for improving the performance of prediction models, by finding significant features and removing unnecessary among them. The study aims to identify the most informative subset of features. Diabetes is a chronic metabolic disorder that poses significant health challenges worldwide. For the experiment, two datasets related to diabetes were downloaded from Kaggle and the results of both (datasets) with and without feature selection using the genetic algorithm were compared. Machine learning classifiers and genetic algorithms were combined to increase the precision of diabetes risk prediction. In the preprocessing phase, feature selection, machine learning classifiers, and performance metrics methods were applied to make this study feasible. The results of the experiment showed that genetic algorithm + logistic regression i.e., 80% (accuracy) works better for PIMA diabetes, and for Germany diabetes dataset genetic algorithm + random forest and genetic algorithm + K-Nearest Neighbor i.e., 98.5% performed better than other chosen classifiers. The researchers can better comprehend the importance of feature selection in healthcare through this study.</p>

Machine learning for detecting fake accounts and genetic algorithm-based feature selection

Abstract People rely extensively on online social networks (OSNs) in Africa, which aroused cyber attackers’ attention for various nefarious actions. This global trend has not spared African online communities, where the proliferation of OSNs has provided new opportunities and challenges. In Africa, as in many other regions, a burgeoning black-market industry has emerged, specializing in the creation and sale of fake accounts to serve various purposes, both malicious and deceptive. This paper aims to build a set of machine-learning models through feature selection algorithms to predict the fake account, increase performance, and reduce costs. The suggested approach is based on input data made up of features that describe the profiles being investigated. Our findings offer a thorough comparison of various algorithms. Furthermore, compared to machine learning without feature selection and Boruta, machine learning employing the suggested genetic algorithm-based feature selection offers a clear runtime advantage. The final prediction model achieves AUC values between 90% and 99.6%. The findings showed that the model based on the features chosen by the GA algorithm provides a reasonable prediction quality with a small number of input variables, less than 31% of the entire feature space, and therefore permits the accurate separation of fake from real users. Our results demonstrate exceptional predictive accuracy with a significant reduction in input variables using the genetic algorithm, reaffirming the effectiveness of our approach.

A feature selection based on genetic algorithm for intrusion detection of industrial control systems

With the popularity of Internet technology, industrial control systems (ICS) have started to access the Internet, which significantly facilitates engineers to manage ICS remotely but also exposes risks. Usually, an intrusion detection system (IDS) is used to secure network systems. Feature selection plays a crucial role in IDSs because detecting anomalies from high-dimensional network traffic features is time-consuming. However, few specific studies have been conducted for ICS. Many redundant features and data imbalance problems in ICS data lead to poor performance and low efficiency of generic IDS classification. In this paper, we design a genetic algorithm-based feature selection method for ICS characteristics. The proposed method incorporates a feature ranking fusion mechanism in the genetic algorithm for eliminating redundant features, enhances the global merit-seeking speed using the growing tree clustering idea, and we also design a new fitness function for ICS characteristics. The effectiveness and advancement of the proposed method are demonstrated on a real ICS dataset.

Identification of ZIP8-induced ferroptosis as a major type of cell death in monocytes under sepsis conditions

Sepsis is a heterogenous syndrome with concurrent hyperinflammation and immune suppression. A prominent feature of immunosuppression during sepsis is the dysfunction and loss of monocytes; however, the major type of cell death contributing to this depletion, as well as its underlying molecular mechanisms, are yet to be identified. In this study, we confirmed the monocyte loss in septic patients based on a pooled gene expression data of periphery leukocytes. Using the collected reference gene sets from databases and published studies, we identified ferroptosis with a greater capacity to distinguish between sepsis and control samples than other cell death types. Further investigation on the molecular drivers, by a genetic algorithm-based feature selection and a weighted gene co-expression network analysis, revealed that zrt-/irt-like protein 8 (ZIP8), encoded by SLC39A8, was closely associated with ferroptosis of monocytes during sepsis. We validated the increase of ZIP8 of monocytes with in vivo and in vitro experiments. The in vitro studies also showed that downregulation of ZIP8 alleviated the lipopolysaccharide-induced lipid peroxidation, as well as restoring the reduction of GPX4, FTH1 and xCT. These findings suggest that ferroptosis might be a key factor in the loss of monocytes during sepsis, and that the heightened expression of ZIP8 may facilitate this progression.

Imbalance-learning road crash assessment under reduced visibility settings: A proactive multicriteria decision-making system

Road crash prediction is a fundamental key in designing efficient intelligent transportation systems. There has been a pronounced progress in the use of machine learning models for crash events assessment by the transportation safety research community in recent years. However, little attention has been paid so far to evaluating reduced-visibility crash occurrences within a heuristic ensemble system. This study presents a proactive multicriteria decision-making system that can predict crash occurrences based on real-time roadway properties, land zones’ characteristics, vehicle telemetry, driver inputs and weather conditions collected using a desktop driving simulator. A key novelty of this work is implementing a genetic algorithm-based feature selection approach along with ensemble modeling strategies using AdaBoost, XGBoost and RF techniques to establish effective crash predictions. Furthermore, since crash events occur in rare instances tending to be underrepresented in the dataset, an imbalance-learning methodology to overcome the issue was adopted on the basis of several data resampling approaches to increase the predictive performance namely SMOTE, Borderline-SMOTE, SMOTE-Tomek Links and ADASYN strategies. To our knowledge, there has been a limited interest at adopting an ensemble-based imbalance-learning strategy examining the impact of real-time features’ combinations on the prediction of road crash events under reduced visibility settings.

WCGAN-GP based synthetic attack data generation with GA based feature selection for IDS

Cyber-attack is one of the alarming issues in today's era. Firewalls, Intrusion Detection Systems (IDSs), and other techniques are popularly applied to prevent those attacks. Intrusion Detection System (IDS) works as the watchdog to monitor the network traffic and identify an alert when an unauthorized action is detected. However, most IDSs are designed on traditional datasets, which do not address the data imbalance problem. As a result, their performance is not good enough against minority class samples. In order to overcome the aforementioned problem and detect cyber-attacks with higher precision, this paper proposes a novel IDS applying Wasserstein Conditional Generative Adversarial Network – Gradient Penalty (WCGAN-GP) and Genetic Algorithm (GA). The objective of the two components- WCGAN-GP and Genetic Algorithm are introduced in the proposed work for synthetic data generation, feature optimization, and attack detection system. The proposed model generates synthetic samples that follow the underlying data distribution of actual data. This paper uses a novel fitness function for the convergence of the Genetic algorithm and produces an optimal feature vector for the classification problem. In this work, an extensive experimental study applying NSL-KDD and UNSW-NB15 datasets in combination with generated samples and reduced feature set from the proposed model is carried out to evaluate the performance of different machine learning models. Observations show that Xgboost gives the best performances among others. To justify using a genetic algorithm for feature optimization, this paper has compared the proposed model with other traditional feature selection approaches such as PCA, Autoencoder, and T-SNE on the proposed model. It is found that the proposed GA-based feature selection outperforms others. The reason behind it is that the GA-based feature selection technique offers certain advantages over PCA and Autoencoder-based dimensionality reduction techniques, such as the ability to handle non-linearity between features in the data, enhanced flexibility in feature selection, interpretability, and human insight, handling high-dimensional data, robustness to noise and outliers. It also offers an advantage over T-SNE, a nonlinear dimensionality reduction technique in terms of computational efficiency. Furthermore, the model is also compared with other state-of-the-art which address data imbalance problems. Our proposed model with Xgboost classifier gives better results than other existing approaches in terms of accuracy (95.54%), precision (92.61%), recall (95.54%), F1-score (93.41%), and false alarm rate (4.30%) on the NSL-KDD dataset and accuracy (89.58%), precision (89.46%), recall (89.58%), F1-score (88.89%) and false alarm rate (1.18%) on the UNSW-NB15 dataset.

Extended Mammogram Classification From Textural Features

"The efficient analysis of digital mammograms has an important role in the early detection of breast cancer and can lead to a higher percentage of recovery. This paper presents an extended computer-aided diagnosis system for the classification of mammograms into three classes (normal, benign and malignant). The performance of the system is evaluated for two different mammogram databases (MIAS and DDSM) in order to assess its robustness. We discuss the changes required in the system, particularly at the level of the image preprocessing and feature extraction. Computational experiments are performed based on different methods for feature extraction, selection and classification. The results indicate an accuracy of 66.95% for the MIAS dataset and 54.1% for DDSM obtained using genetic algorithm based feature selection and Random Forest classification. Keywords: Breast cancer detection, Mammogram classification, GLRLM, Feature selection, Random Forests, MIAS, DDSM. "

Genetic algorithm-based feature selection with manifold learning for cancer classification using microarray data

BackgroundMicroarray data have been widely utilized for cancer classification. The main characteristic of microarray data is “large p and small n” in that data contain a small number of subjects but a large number of genes. It may affect the validity of the classification. Thus, there is a pressing demand of techniques able to select genes relevant to cancer classification.ResultsThis study proposed a novel feature (gene) selection method, Iso-GA, for cancer classification. Iso-GA hybrids the manifold learning algorithm, Isomap, in the genetic algorithm (GA) to account for the latent nonlinear structure of the gene expression in the microarray data. The Davies–Bouldin index is adopted to evaluate the candidate solutions in Isomap and to avoid the classifier dependency problem. Additionally, a probability-based framework is introduced to reduce the possibility of genes being randomly selected by GA. The performance of Iso-GA was evaluated on eight benchmark microarray datasets of cancers. Iso-GA outperformed other benchmarking gene selection methods, leading to good classification accuracy with fewer critical genes selected.ConclusionsThe proposed Iso-GA method can effectively select fewer but critical genes from microarray data to achieve competitive classification performance.

Hybrid Filter and Genetic Algorithm-Based Feature Selection for Improving Cancer Classification in High-Dimensional Microarray Data

The advancements in intelligent systems have contributed tremendously to the fields of bioinformatics, health, and medicine. Intelligent classification and prediction techniques have been used in studying microarray datasets, which store information about the ways used to express the genes, to assist greatly in diagnosing chronic diseases, such as cancer in its earlier stage, which is important and challenging. However, the high-dimensionality and noisy nature of the microarray data lead to slow performance and low cancer classification accuracy while using machine learning techniques. In this paper, a hybrid filter-genetic feature selection approach has been proposed to solve the high-dimensional microarray datasets problem which ultimately enhances the performance of cancer classification precision. First, the filter feature selection methods including information gain, information gain ratio, and Chi-squared are applied in this study to select the most significant features of cancerous microarray datasets. Then, a genetic algorithm has been employed to further optimize and enhance the selected features in order to improve the proposed method’s capability for cancer classification. To test the proficiency of the proposed scheme, four cancerous microarray datasets were used in the study—this primarily included breast, lung, central nervous system, and brain cancer datasets. The experimental results show that the proposed hybrid filter-genetic feature selection approach achieved better performance of several common machine learning methods in terms of Accuracy, Recall, Precision, and F-measure.

Mineral content estimation for salt lakes on the Tibetan plateau based on the genetic algorithm-based feature selection method using Sentinel-2 imagery: A case study of the Bieruoze Co and Guopu Co lakes

Salt lakes on the Tibetan Plateau (TP) are rich in lithium (Li), boron (B) and other mineral resources, and accurate assessment of the mineral content and spatial distribution of the brine in those salt lakes is important to guide the development and utilization of their mineral resources. There are few studies estimating the mineral content of salt lakes on the TP due to the lack of in situ investigation data. This study introduced an intelligent prediction model combining a feature selection algorithm with a machine learning algorithm using Sentinel-2 satellite data to estimate the Li, B, and TDS contents of Bieruoze Co and Guopu Co lakes on the TP. First, to enrich the spectral information, four mathematical transformations (reciprocal, logarithmic, reciprocal of logarithm, and first-order derivative) were applied to the original bands. Then, feature selection was performed using the genetic algorithm (GA) to select the optimal input variables for the model. Finally, prediction models were constructed by partial least squares regression (PLSR), multiple linear regression (MLR), and random forest (RF). The results showed that: 1) The spectral mathematical transformation provided rich spectral information for the mineral content estimation. 2) The performance of the estimation model constructed by the feature optimization method using GA was better than that of the estimation model constructed based on all spectral bands. Based on GA for feature optimization, the MAPE of GA-RF for estimating Li, B and TDS contents on the testing set was reduced by 77.52%, 28.54% and 36.79%, respectively. 3) Compared with the GA-MLR and GA-PLSR models, GA-RF estimated Li (R2=0.99, RMSE=1.15 mg L-1, MAPE=3.00%), B (R2=0.97, RMSE=10.65 mg L-1, MAPE=2.73%), and TDS (R2=0.93, RMSE=0.60 g L-1, MAPE=1.82%) all obtained the optimal performance. This study showed that the combination of the GA-based feature selection method and the RF model has excellent performance and applicability for monitoring the content of multiple minerals using Sentinel-2 imagery in salt lakes on the TP.

Liquefaction prediction with robust machine learning algorithms (SVM, RF, and XGBoost) supported by genetic algorithm-based feature selection and parameter optimization from the perspective of data processing

Liquefaction prediction with robust machine learning algorithms (SVM, RF, and XGBoost) supported by genetic algorithm-based feature selection and parameter optimization from the perspective of data processing

Diabetic Retinopathy Detection Using Genetic Algorithm-Based CNN Features and Error Correction Output Code SVM Framework Classification Model

Diabetic retinopathy (DR) is a type of eye disease that may be caused in individuals suffering from diabetes which results in vision loss. DR identification and routine diagnosis is a challenging task and may need several screenings. Early identification of DR has the potential to prevent or delay vision loss. For real-time applications, an automated DR identification approach is required to assist and reduce possible human mistakes. In this research work, we propose a deep neural network and genetic algorithm-based feature selection approach. Five advanced convolutional neural network architectures are used to extract features from the fundus images, i.e., AlexNet, NASNet-Large, VGG-19, Inception V3, and ShuffleNet, followed by genetic algorithm for feature selection and ranking features into high rank (optimal) and lower rank (unsatisfactory). The nonoptimal feature attributes from the training and validation feature vectors are then dropped. Support vector machine- (SVM-) based classification model is used to develop diabetic retinopathy recognition model. The model performance is evaluated using accuracy, precision, recall, and F1 score. The proposed model is tested on three different datasets: the Kaggle dataset, a self-generated custom dataset, and an enhanced custom dataset with 97.9%, 94.76%, and 96.4% accuracy, respectively. In the enhanced custom dataset, data augmentation has been performed due to the smaller size of the dataset and to eliminate the noise in fundus images.

Machine Learning Approaches for Developing Land Cover Mapping.

In remote sensing data processing, cover classification on decimeter-level data is a well-studied but tough subject that has been well-documented. The majority of currently existent works make use of orthographic photographs or orthophotos and digital surface models that go with them (DSMs). Urban land cover classification plays a significant role in the field of remote sensing to enhance the quality of different applications including environment protection, sustainable development, and resource management and planning. Novelty of the research done in this area is focused on extracting features from high-resolution satellite images to be used in the classification process. However, it is well known in machine learning literature that some of the extracted features are irrelevant to the classification process with a negative or no effect on its accuracy. In this work, a genetic algorithm-based feature selection approach is used to enhance the performance of urban land cover classification. Neural networks (NNs) and random forest (RF) classifiers were used to evaluate the proposed approach on a recent urban land cover dataset of nine different classes. Experimental results show that the proposed approach achieved better performance with RF classifier using only 27% of the features. The random forest tree has achieved highest accuracy 84.27%; it is concluded that the RF algorithm is an appropriate algorithm for classifying cover land.

Feature selection for urban land cover classification employing genetic algorithm

Feature selection has attained substantial research interest in image processing, computer vision, pattern recognition and so on due to tremendous dimensional reduction in image analysis. This research addresses a genetic algorithm based feature selection strategy for urban land cover classification. The principal purpose of this research is to monitor the land cover alterations in satellite imagery for urban planning. The method is based on object based classification by detecting the object area of a given image with the knowledge of visual information of the object from remote sensing images. The classification system is organized through a multilayer perceptron with genetic algorithm (MLPGA). Experimental results explicitly indicate that this MLPGA based hybrid feature selection procedure performs classification with sensitivity 94%, specificity 90% and precision 89%, respectively. This MLPGA centered hybrid feature selection scheme attains better performance than the counterpart methods in terms of classification accuracy.

Novel dynamic k-modes clustering of categorical and non categorical dataset with optimized genetic algorithm based feature selection

Novel dynamic k-modes clustering of categorical and non categorical dataset with optimized genetic algorithm based feature selection

Synergy of optical and synthetic aperture radar data for early-stage crop yield estimation: a case study over a state of Germany

Traditional crop cutting experiment-based yield estimation method captures the regional yield variability but lacks field-level information. Satellite images hold enormous crop information at finer spatial resolution. Crop yield mapping with optical images is particularly challenging if cloud-free images are unavailable during the crucial crop developmental stages. All-weather availability and sensitivity to crop structure, dielectric properties make synthetic aperture radar (SAR) images an excellent resource for yield estimation. Both types of data provide complementary information about crop conditions. A random forest regression model with genetic algorithm-based feature selection is developed to exploit the Sentinel-2 optical and Sentinel-1 SAR images for yield estimation. We utilized the crop harvest and quality survey (BEE) yield data set collected by the Hessisches Statistisches Landesamt (HSL), Wiesbaden, Germany, over 490 fields. We prepared 20 m resolution yield maps for winter wheat, winter barley, winter rye and winter rapeseed. Input features for the yield estimation model are selected based on the prior knowledge of remote sensing of vegetation. Baseline random forest regression models are developed for all the four crop types with optical and SAR input features. An optimized random forest regression model with genetic algorithm-based feature selection results in performance improvement. Dissimilarity in genetic algorithm selected image features highlights the significance of crop-specific feature selection for yield estimation. The optimized models reliably estimate yield by achieving correlation coefficient (r) of 0.65–0.86, mean absolute error 0.93–1.16 t ha–1 and root mean square error 1.12–1.56 t ha–1 with BEE yield on testing data set. The proposed models could estimate the intra-field yield variation when winter wheat, winter barley, winter rye were in the shooting phase to the beginning of ear-shifting, and winter rapeseed began to flower or was already flowering. These results demonstrate the merits of our model for early-stage crop yield estimation at the field level with mono-temporal image and adaptability for the cropping season with high cloud cover.

CNN Based Multi-Object Segmentation and Feature Fusion for Scene Recognition

Latest advancements in vision technology offer an evident impact on multi-object recognition and scene understanding. Such scene-understanding task is a demanding part of several technologies, like augmented reality-based scene integration, robotic navigation, autonomous driving, and tourist guide. Incorporating visual information in contextually unified segments, convolution neural networks-based approaches will significantly mitigate the clutter, which is usual in classical frameworks during scene understanding. In this paper, we propose a convolutional neural network (CNN) based segmentation method for the recognition of multiple objects in an image. Initially, after acquisition and preprocessing, the image is segmented by using CNN. Then, CNN features are extracted from these segmented objects, and discrete cosine transform (DCT) and discrete wavelet transform (DWT) features are computed. After the extraction of CNN features and computation of classical machine learning features, fusion is performed using a fusion technique. Then, to select the minimal set of features, genetic algorithm-based feature selection is used. In order to recognize and understand the multi-objects in the scene, a neuro-fuzzy approach is applied. Once objects in the scene are recognized, the relationship between these objects is examined by employing the object-to-object relation approach. Finally, a decision tree is incorporated to assign the relevant labels to the scenes based on recognized objects in the image. The experimental results over complex scene datasets including SUN Red Green Blue-Depth (RGB-D) and Cityscapes’ demonstrated a remarkable performance.

Towards a Support System for Digital Mammogram Classification

Cancer is the illness of the 21th century. With the development of technology some of these lesions became curable, if they are in an early stage. Researchers involved with image processing started to conduct experiments in the field of medical imaging, which contributed to the appearance of systems that can detect and/or diagnose illnesses in an early stage. This paper’s aim is to create a similar system to help the detection of breast cancer. First, the region of interest is defined using filtering and two methods, Seeded Region Growing and Sliding Window Algorithm, to remove the pectoral muscle. The region of interest is segmented using k-means and further used together with the original image. Gray-Level Run-Length Matrix features (in four direction) are extracted from the image pairs. To filter the important features from resulting set Principal Component Analysis and a genetic algorithm based feature selection is used. For classification K-Nearest Neighbor, Support Vector Machine and Decision Tree classifiers are experimented. To train and test the system images of Mammographic Image Analysis Society are used. The best performance is achieved features for directions {45◦ , 90◦ , 135◦ }, applying GA feature selection and DT classification (with a maximum depth of 30). This paper presents a comprehensive analysis of the different combinations of the algorithms mentioned above, where the best performence repored is 100% and 59.2% to train and test accuracies respectively.

Gene expression data classification using genetic algorithm-based feature selection

In this study, hybrid methods are proposed for feature selection and classification of gene expression datasets. In the proposed genetic algorithm/support vector machine (GA-SVM) and genetic algorithm/k nearest neighbor (GA-KNN) hybrid methods, genetic algorithm is improved using Pearson's correlation coefficient, Relief-F, or mutual information. Crossover and selection operations of the genetic algorithm are specialized. Eight different gene expression datasets are used for classification process. The classification performances of the proposed methods are compared with the traditional GA-KNN and GA-SVM wrapper methods and other studies in the literature. Classification results demonstrate that higher accuracy rates are obtained with the proposed methods compared to the other methods for all datasets.

Android Malware Detection Using Machine Learning with Feature Selection Based on the Genetic Algorithm

Since the discovery that machine learning can be used to effectively detect Android malware, many studies on machine learning-based malware detection techniques have been conducted. Several methods based on feature selection, particularly genetic algorithms, have been proposed to increase the performance and reduce costs. However, because they have yet to be compared with other methods and their many features have not been sufficiently verified, such methods have certain limitations. This study investigates whether genetic algorithm-based feature selection helps Android malware detection. We applied nine machine learning algorithms with genetic algorithm-based feature selection for 1104 static features through 5000 benign applications and 2500 malwares included in the Andro-AutoPsy dataset. Comparative experimental results show that the genetic algorithm performed better than the information gain-based method, which is generally used as a feature selection method. Moreover, machine learning using the proposed genetic algorithm-based feature selection has an absolute advantage in terms of time compared to machine learning without feature selection. The results indicate that incorporating genetic algorithms into Android malware detection is a valuable approach. Furthermore, to improve malware detection performance, it is useful to apply genetic algorithm-based feature selection to machine learning.