Fast Correlation-based Filter Research Articles

An optimized multi-layer ensemble model for airborne networks intrusion detection

In view of the characteristics of airborne networks, such as the traffic data of 1553B data bus and public networks, numerous redundant and irrelevant data, and fewer but more types of attack behaviors, a highly representative balanced data subset is generated by combining K-means with synthetic minority oversampling technique (SMOTE). A feature selection (FS) method of fast correlation-based filter combined with information gain (IG-FCBF) is proposed to filter the key characteristics with 90 % cumulative importance. Aiming at the problem that it is not easy for a single classifier to accurately classify various types of attacks, as well as the difficulty in obtaining the best prediction results by adjusting default and manual parameters, a multi-layer ensemble model based on Bayesian optimization tree-structured Parzen estimator (BO-TPE) is proposed for airborne networks intrusion detection, combining the advantages of supervised learning, stacking ensemble method and hyperparameter optimization (HPO). The experimental results show the superiority and effectiveness of the model, as well as its universality in Integrated Avionics Systems (IAS) and onboard public networks, which provides a new approach for airborne networks intrusion identification and protection.

Enhancing metastatic colorectal cancer prediction through advanced feature selection and machine learning techniques

Background and aimsColorectal cancer (CRC) is the third most prevalent cancer globally, posing a significant challenge due to its high rate of metastasis. Approximately 20% of patients with CRC present with distant metastases at diagnosis, and over 50% develop metastases within five years. Accurate prediction of metastasis is crucial for improving survival outcomes in patients with CRC. MethodsThis study introduces an innovative cost-sensitive fast correlation-based filter (CS-FCBF) algorithm for feature selection, integrated with machine learning techniques to predict metastatic CRC. The CS-FCBF algorithm effectively reduced the number of genomic features from 184 to 9 critical genes: CXCL9, C2CD4B, RGCC, GFI1, BEX2, CXCL3, FOXQ1, PBK, and PLAG1. The methodology combined in vitro, in vivo, and analysis of publicly available single-cell RNA-seq datasets to validate the findings. ResultsThe application of the CS-FCBF algorithm led to a significant improvement in prediction model performance, with an average 21.16% increase in the area under the precision-recall curve. The nine identified genes hold potential as diagnostic biomarkers and therapeutic targets for metastatic CRC. ConclusionsThis study highlights the critical role of advanced feature selection methods, combined with machine learning, in addressing the challenge of class imbalance in medical diagnosis, particularly for CRC. Early detection of metastasis is vital, and the identified genes underscore their importance in the metastatic process of CRC. The methodology applied here offers valuable insights and paves the way for future research in other cancers or diseases that face similar diagnostic challenges.

Geographic authentication of argentinian teas by combining one-class models and discriminant methods for modeling near infrared spectra

In this study, 110 tea samples from South American countries (Argentina, Brazil, and Paraguay) and Asian countries (India and China) were analyzed using near-infrared spectroscopy (NIRS) together with a two-step chemometric authentication strategy (class modeling techniques and discriminant analysis) to authenticate commercial teas from Argentina. In the first step, one-class models were built and validated to authenticate South American teas using preprocessed NIRS data. For this purpose, data-driven soft independent modeling of class analogy (DD-SIMCA) and one-class partial least squares (OC-PLS) were used. The DD-SIMCA model gave the best results, with a sensitivity of 93.10%, specificity of 100%, and efficiency of 95.00%. In the second step, a support vector machine (SVM) was used to build and validate a multiclass model to discriminate between tea samples from Argentina and neighboring countries of South America. The best model was the combination of nine variables selected by the fast correlation-based filter (FCBF) method, with an accuracy of 98.30%. Therefore, we conclude that the combination of NIRS and two-step chemometric tools can be used to authenticate the geographical origin of samples with high inter-class similarity.

Short-Term Energy Consumption Prediction of Large Public Buildings Combined with Data Feature Engineering and Bilstm-Attention

Accurate building energy consumption prediction is a crucial condition for the sustainable development of building energy management systems. However, the highly nonlinear nature of data and complex influencing factors in the energy consumption of large public buildings often pose challenges in improving prediction accuracy. In this study, we propose a combined prediction model that combines signal decomposition, feature screening, and deep learning. First, we employ the Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) to decompose energy consumption data. Next, we propose the Maximum Mutual Information Coefficient (MIC)-Fast Correlation Based Filter (FCBF) combined feature screening method for feature selection on the decomposed components. Finally, the selected input features and corresponding components are fed into the Bi-directional Long Short-Term Memory Attention Mechanism (BiLSTMAM) model for prediction, and the aggregated results yield the energy consumption forecast. The proposed approach is validated using energy consumption data from a large public building in Shaanxi Province, China. Compared with the other five comparison methods, the RMSE reduction of the CEEMDAN-MIC-FCBF-BiLSTMAM model proposed in this study ranged from 57.23% to 82.49%. Experimental results demonstrate that the combination of CEEMDAN, MIC-FCBF, and BiLSTMAM modeling markedly improves the accuracy of energy consumption predictions in buildings, offering a potent method for optimizing energy management and promoting sustainability in large-scale facilities.

Intrusion detection system for vehicular ad hoc network attacks based on machine learning techniques

ABSTRACT The vehicular ad-hoc network (VANET) is a new subcategory of mobile ad-hoc networks that has excellent potential application in intelligent transportation systems. The cyberattack on vehicles can lead to privacy leaks and financial losses and could even become a national public safety issue. In this paper, a multi-level Intrusion Detection System based on Machine Learning (ML) algorithms is developed in order to detect multiple types of attacks on VANET. The proposed model combines two feature selection techniques: random forest (RF) and fast correlation-based filter (FCBF) and four tree-based algorithms: extreme gradient boosting decision tree, RF, decision tree, and ExtraTrees, for classification performance. Moreover, the model is evaluated using CICIDS2017 dataset and Python ML libraries in Jupyter Notebook such as scikit-learn and Pandas. Experiment results show that the proposed model using the stacking method achieves 99.86% attack detection accuracy, 99.85% precision with hypo-parameter (HPO), and 99.83% attack detection accuracy without using HPO. The experimental findings on the vehicular network demonstrate the feasibility of the proposed solution and the ability to implement it in real-time environments.

Lung adenocarcinoma identification based on hybrid feature selections and attentional convolutional neural networks.

Lung adenocarcinoma, a chronic non-small cell lung cancer, needs to be detected early. Tumor gene expression data analysis is effective for early detection, yet its challenges lie in a small sample size, high dimensionality, and multi-noise characteristics. In this study, we propose a lung adenocarcinoma convolutional neural network (LATCNN), a deep learning model tailored for accurate lung adenocarcinoma prediction and identification of key genes. During the feature selection stage, we introduce a hybrid algorithm. Initially, the fast correlation-based filter (FCBF) algorithm swiftly filters out irrelevant features, followed by applying the k-means-synthetic minority over-sampling technique (k-means-SMOTE) method to address category imbalance. Subsequently, we enhance the particle swarm optimization (PSO) algorithm by incorporating fast-decay dynamic inertia weights and utilizing the classification and regression tree (CART) as the fitness function for the second stage of feature selection, aiming to further eliminate redundant features. In the classifier construction stage, we present an attention convolutional neural network (atCNN) that incorporates an attention mechanism. This improved model conducts feature selection post lung adenocarcinoma gene expression data analysis for classification and prediction. The results show that LATCNN effectively reduces the feature dimensions and accurately identifies 12 key genes with accuracy, recall, F1 score, and MCC of 99.70%, 99.33%, 99.98%, and 98.67%, respectively. These performance metrics surpass those of other comparative models, highlighting the significance of this research for advancing lung adenocarcinoma treatment.

Cross-subject emotion recognition using hierarchical feature optimization and support vector machine with multi-kernel collaboration

Objective. Due to individual differences, it is greatly challenging to realize the multiple types of emotion identification across subjects. Approach. In this research, a hierarchical feature optimization method is proposed in order to represent emotional states effectively based on peripheral physiological signals. Firstly, sparse learning combined with binary search is employed to achieve feature selection of single signals. Then an improved fast correlation-based filter is proposed to implement fusion optimization of multi-channel signal features. Aiming at overcoming the limitations of the support vector machine (SVM), which uses a single kernel function to make decisions, the multi-kernel function collaboration strategy is proposed to improve the classification performance of SVM. Main results. The effectiveness of the proposed method is verified on the DEAP dataset. Experimental results show that the proposed method presents a competitive performance for four cross-subject types of emotion identification with an accuracy of 84% (group 1) and 85.07% (group 2). Significance. The proposed model with hierarchical feature optimization and SVM with multi-kernel function collaboration demonstrates superior emotion recognition accuracy compared to state-of-the-art techniques. In addition, the analysis based on DEAP dataset composition characteristics presents a novel perspective to explore the emotion recognition issue more objectively and comprehensively.

MicroBiomeGSM: the identification of taxonomic biomarkers from metagenomic data using grouping, scoring and modeling (G-S-M) approach

Numerous biological environments have been characterized with the advent of metagenomic sequencing using next generation sequencing which lays out the relative abundance values of microbial taxa. Modeling the human microbiome using machine learning models has the potential to identify microbial biomarkers and aid in the diagnosis of a variety of diseases such as inflammatory bowel disease, diabetes, colorectal cancer, and many others. The goal of this study is to develop an effective classification model for the analysis of metagenomic datasets associated with different diseases. In this way, we aim to identify taxonomic biomarkers associated with these diseases and facilitate disease diagnosis. The microBiomeGSM tool presented in this work incorporates the pre-existing taxonomy information into a machine learning approach and challenges to solve the classification problem in metagenomics disease-associated datasets. Based on the G-S-M (Grouping-Scoring-Modeling) approach, species level information is used as features and classified by relating their taxonomic features at different levels, including genus, family, and order. Using four different disease associated metagenomics datasets, the performance of microBiomeGSM is comparatively evaluated with other feature selection methods such as Fast Correlation Based Filter (FCBF), Select K Best (SKB), Extreme Gradient Boosting (XGB), Conditional Mutual Information Maximization (CMIM), Maximum Likelihood and Minimum Redundancy (MRMR) and Information Gain (IG), also with other classifiers such as AdaBoost, Decision Tree, LogitBoost and Random Forest. microBiomeGSM achieved the highest results with an Area under the curve (AUC) value of 0.98% at the order taxonomic level for IBDMD dataset. Another significant output of microBiomeGSM is the list of taxonomic groups that are identified as important for the disease under study and the names of the species within these groups. The association between the detected species and the disease under investigation is confirmed by previous studies in the literature. The microBiomeGSM tool and other supplementary files are publicly available at: https://github.com/malikyousef/microBiomeGSM.

Machine learning-based classification of physiological and pathological high-frequency oscillations recorded by stereoelectroencephalography

ObjectiveHigh-frequency oscillations (HFOs) are an efficient indicator to locate the epileptogenic zone (EZ). However, physiological HFOs produced in the normal brain region may interfere with EZ localization. The present study aimed to build a machine learning-based classifier to distinguish the properties of each HFO event based on features in different domains. MethodsHFOs were detected in focal epilepsy patients from two different hospitals who underwent stereoelectroencephalography and subsequent resection surgery. Subsequently, 37 features in four different domains (time, frequency and time-frequency, entropy-based and nonlinear) were extracted for each HFO. After extraction, a fast correlation-based filter (FCBF) algorithm was applied for feature selection. The machine learning classifier was trained on the feature matrix with and without FCBF and then tested on the data set from patients in another hospital. ResultsA dataset was compiled, consisting of 89,844 pathological HFOs and 23,613 physiological HFOs from 17 patients assigned to the training dataset. Additionally, 12,695 pathological HFOs and 5,599 physiological HFOs from 9 patients were assigned to the testing dataset. Four features (ripple band power, arithmetic mean, Petrosian fractal dimension and zero crossings) were obtained for classifier training after FCBF. The classifier showed an area under the curve (AUC) of 0.95/0.98 for FCBF/no FCBF features in the training dataset and AUC of 0.82/0.90 for FCBF/no FCBF features in the testing dataset. Our findings indicated that the classifier utilizing all features demonstrated superior performance compared to the one relying on FCBF-processed features. ConclusionOur classifier could reliably differentiate pathological HFOs from physiological ones, which could promote the development of HFOs in EZ localization.

Comparing Support Vector Machine and Naïve Bayes Methods with A Selection of Fast Correlation Based Filter Features in Detecting Parkinson's Disease

Dopamine levels fall due to brain nerve cell destruction, producing Parkinson's symptoms. Humans with this illness experience central nervous system damage, which lowers the quality of life. This disease is not deadly, but when people's quality of life decreases, they cannot perform daily activities as people do. Even in one case, this disease can cause death indirectly. Contrast support vector machines (SVM) and naive Bayesian approaches with and without fast correlation-based filter (FCBF) feature selection, this study attempts to determine the optimum model to detect Parkinson's disease categorization. In this study, datasets from the UCI Machine Learning Repository are used. The results showed that SVM with FCBF achieved the highest accuracy among all the models tested. SVM with FCBF provides an accuracy of 86.1538%, sensitivity of 93.8775%, and specificity of 62.5000%. Both methods, SVM and Naive Bayes, have improved in performance due to FCBF, with SVM showing a more significant increase in accuracy. This research contributed to helping paramedics determine if a patient has Parkinson's disease or not using characteristics obtained from data, such as movement, sound, or other pertinent factors.

An Efficient Filter and Wrapper based Selection Methods along With Random Forest and Support Vector Machines Classification Technique in Health Care System

Health care Management System (HMS) is a key to successful management of any health care industry. Health care management systems have so many research dimensions such as identifying disease and diagnostic, drug discovery manufacturing, Bioinformatics’ problem, personalized treatments, Patient image analysis and so on. Heart Disease Prediction (HDP) is a process of identifying heart disease in advance and recognizes patient health condition by applying techniques on patient heart related symptoms. Now a day’s the problem of identifying heart diseases is solved by machine learning techniques. In this paper we construct a heart disease prediction method using combined feature selection and classification machine learning techniques. According to the existing study the one of the main difficult in heart disease prediction system is that the available data in open sources are not properly recorded the necessary characteristics and there is some lagging in finding the useful features from the available features. The process of removing inappropriate features from an available feature set while preserving sufficient classification accuracy is known as feature selection. A methodology is proposed in this paper that consists of two phases: Phase one employs two broad categories of feature selection techniques to identify the efficient feature sets and it is given to the input of our second phase such as classification. In this work we will concentrate on filter-based method for feature selection such as Chi-square, Fast Correlation Based Filter (FCBF), Gini Index (GI), RelifeF, and wrapper-based method for feature selection such as Backward Feature Elimination (BFE), Exhaustive Feature Selection (EFS), Forward Feature Selection (FFS), and Recursive Feature Elimination (RFE). The UCI heart disease data set is used to evaluate the output in this study. Finally, the proposed system's performance is validated by various experiments setups.

Fault Diagnosis of ME Marine Diesel Engine Fuel Injector with Novel IRCMDE Method

Abstract As an important component of the fuel injection system, the fuel injector is crucial for ensuring the power, economy, and emissions for a whole ME (machine electronically-controlled) marine diesel engine. However, injectors are most prone to failures such as reduced pressure at the opening valve, clogged spray holes and worn needle valves, because of the harsh working conditions. The failure characteristics are non-stationary and non-linear. Therefore, to efficiently extract fault features, an improved refined composite multi-scale dispersion entropy (IRCMDE) is proposed, which uses the energy distribution of sampling points as weights for coarse-grained calculation, then fast correlation-based filter(FCBF) and support vector machine (SVM) are used for feature selection and fault classification, respectively. The experimental results from a MAN B&W 6S35ME-B9 marine diesel engine show that the proposed algorithm can achieve 92.12% fault accuracy for injector faults, which is higher than multiscale dispersion entropy (MDE), refined composite multiscale dispersion entropy (RCMDE) and multiscale permutation entropy (MPE). Moreover, the experiment has also proved that, due to the double-walled structure of the high-pressure fuel pipe, the fuel injection pressure signal is more accurate than the vibration signal in reflecting the injector operating conditions.

StrokeNet: An automated approach for segmentation and rupture risk prediction of intracranial aneurysm.

Intracranial Aneurysms (IA) present a complex challenge for neurosurgeons as the risks associated with surgical intervention, such as Subarachnoid Hemorrhage (SAH) mortality and morbidity, may outweigh the benefits of aneurysmal occlusion in some cases. Hence, there is a critical need for developing techniques that assist physicians in assessing the risk of aneurysm rupture to determine which aneurysms require treatment. However, a reliable IA rupture risk prediction technique is currently unavailable. To address this issue, this study proposes a novel approach for aneurysm segmentation and multidisciplinary rupture prediction using 2D Digital Subtraction Angiography (DSA) images. The proposed method involves training a fully connected convolutional neural network (CNN) to segment aneurysm regions in DSA images, followed by extracting and fusing different features using a multidisciplinary approach, including deep features, geometrical features, Fourier descriptor, and shear pressure on the aneurysm wall. The proposed method also adopts a fast correlation-based filter approach to drop highly correlated features from the set of fused features. Finally, the selected fused features are passed through a Decision Tree classifier to predict the rupture severity of the associated aneurysm into four classes: Mild, Moderate, Severe, and Critical. The proposed method is evaluated on a newly developed DSA image dataset and on public datasets to assess its generalizability. The system's performance is also evaluated on DSA images annotated by expert neurosurgeons for the rupture risk assessment of the segmented aneurysm. The proposed system outperforms existing state-of-the-art segmentation methods, achieving an 85 % accuracy against annotated DSA images for the risk assessment of aneurysmal rupture.

A two-stage hybrid biomarker selection method based on ensemble filter and binary differential evolution incorporating binary African vultures optimization

BackgroundIn the field of genomics and personalized medicine, it is a key issue to find biomarkers directly related to the diagnosis of specific diseases from high-throughput gene microarray data. Feature selection technology can discover biomarkers with disease classification information.ResultsWe use support vector machines as classifiers and use the five-fold cross-validation average classification accuracy, recall, precision and F1 score as evaluation metrics to evaluate the identified biomarkers. Experimental results show classification accuracy above 0.93, recall above 0.92, precision above 0.91, and F1 score above 0.94 on eight microarray datasets.MethodThis paper proposes a two-stage hybrid biomarker selection method based on ensemble filter and binary differential evolution incorporating binary African vultures optimization (EF-BDBA), which can effectively reduce the dimension of microarray data and obtain optimal biomarkers. In the first stage, we propose an ensemble filter feature selection method. The method combines an improved fast correlation-based filter algorithm with Fisher score. obviously redundant and irrelevant features can be filtered out to initially reduce the dimensionality of the microarray data. In the second stage, the optimal feature subset is selected using an improved binary differential evolution incorporating an improved binary African vultures optimization algorithm. The African vultures optimization algorithm has excellent global optimization ability. It has not been systematically applied to feature selection problems, especially for gene microarray data. We combine it with a differential evolution algorithm to improve population diversity.ConclusionCompared with traditional feature selection methods and advanced hybrid methods, the proposed method achieves higher classification accuracy and identifies excellent biomarkers while retaining fewer features. The experimental results demonstrate the effectiveness and advancement of our proposed algorithmic model.

Can radiomic features extracted from intra-oral radiographs predict physiological bone remodelling around dental implants? A hypothesis-generating study.

The rate of physiological bone remodelling (PBR) occurring after implant placement has been associated with the later onset of progressive bone loss and peri-implantitis, leading to medium- and long-term implant therapy failure. It is still questionable, however, whether PBR is associated with specific bone characteristics. The aim of this study was to assess whether radiomic analysis could reveal not readily appreciable bone features useful for the prediction of PBR. Radiomic features were extracted from the radiographs taken at implant placement (T0) using LifeX software. Because of the multi-centre design of the source study, ComBat harmonization was applied to the cohort. Different machine-learning models were trained on selected radiomic features to develop and internally validate algorithms capable of predicting high PBR. In addition, results of the algorithm were included in a multivariate analysis with other clinical variables (tissue thickness and depth of implant position) to test their independent correlation with PBR. Specific radiomic features extracted at T0 are associated with higher PBR around tissue-level implants after 3months of unsubmerged healing (T1). In addition, taking advantage of machine-learning methods, a naive Bayes model was trained using radiomic features selected by fast correlation-based filter (FCBF), which showed the best performance in the prediction of PBR (AUC=0.751, sensitivity=66.0%, specificity=68.4%, positive predictive value=73.3%, negative predictive value=60.5%). In addition, results of the whole model were included in a multivariate analysis with tissue thickness and depth of implant position, which were still found to be independently associated with PBR (p-value < .01). The combination of radiomics and machine-learning methods seems to be a promising approach for the early prediction of PBR. Such an innovative approach could be also used for the study of not readily disclosed bone characteristics, thus helping to explain not fully understood clinical phenomena. Although promising, the performance of the radiomic model should be improved in terms of specificity and sensitivity by further studies in this field.

Research on the feature representation of motor imagery electroencephalogram signal based on individual adaptation

Aiming at the problem of low recognition accuracy of motor imagery electroencephalogram signal due to individual differences of subjects, an individual adaptive feature representation method of motor imagery electroencephalogram signal is proposed in this paper. Firstly, based on the individual differences and signal characteristics in different frequency bands, an adaptive channel selection method based on expansive relevant features with label F (ReliefF) was proposed. By extracting five time-frequency domain observation features of each frequency band signal, ReliefF algorithm was employed to evaluate the effectiveness of the frequency band signal in each channel, and then the corresponding signal channel was selected for each frequency band. Secondly, a feature representation method of common space pattern (CSP) based on fast correlation-based filter (FCBF) was proposed (CSP-FCBF). The features of electroencephalogram signal were extracted by CSP, and the best feature sets were obtained by using FCBF to optimize the features, so as to realize the effective state representation of motor imagery electroencephalogram signal. Finally, support vector machine (SVM) was adopted as a classifier to realize identification. Experimental results show that the proposed method in this research can effectively represent the states of motor imagery electroencephalogram signal, with an average identification accuracy of (83.0±5.5)% for four types of states, which is 6.6% higher than the traditional CSP feature representation method. The research results obtained in the feature representation of motor imagery electroencephalogram signal lay the foundation for the realization of adaptive electroencephalogram signal decoding and its application.

Optimizing the quality control of multivariate processes under an improved Mahalanobis–Taguchi system

Quality characteristics in manufacturing are correlated and do not follow a normal distribution. This study proposes a quality control method for multivariate manufacturing processes that are based on an improved Mahalanobis–Taguchi System (IMTS). The MTS has no data distribution assumptions and identifies anomalies through the Mahalanobis distance (MD). However, a covariance distance can consider the correlation between variables. Further, to address the shortcomings of the MTS in feature selection and threshold determination. A joint optimization model is proposed in this paper. Under this approach, the IMTS is employed to perform composite analyses on multiple quality characteristics and reduce dimensionality to identify abnormalities and the key quality characteristics that lead to anomalies. Further, various models are compared to construct the optimal non-parametric prediction models for each key quality characteristic. Finally, a conceptual model of process parameter optimization is proposed, which improves the Taguchi method to obtain the optimal combination of process parameters and their importance ranking, as the basis for process adjustment. By applying the proposed method, results show that the IMTS has an abnormality identification rate of 99.5%, which is higher than other methods such as MTS, support vector machine (SVM), back propagation neural network (BPNN), fast correlation-based filter solution SVM (FCBF-SVM) and sequential backward selection BPNN (SBS-BPNN). The dimensionality reduction rate is 0.5, which is higher than MTS, SVM, BPNN, and SBS-BPNN methods. The random forest (RF) algorithm is used for accurate predictions of all five key quality characteristics, the improved Taguchi method guided adjustments to manufacturing processes objectively, effectively, and economically.

Feature Selection Using Neighborhood based Entropy

Feature selection plays an important role as a preprocessing step for pattern recognition and machine learning. The goal of feature selection is to determine an optimal subset of relevant features out of a large number of features. The neighborhood discrimination index (NDI) is one of the newest and the most efficient measures to determine distinguishing ability of a feature subset. NDI is computed based on a neighborhood radius (E). Due to the significant impact of E on NDI, selecting an appropriate value of E for each data set might be challenging and very time-consuming. This paper proposes a new approach based on targEt PointS To computE neIgh- borhood relatioNs (EPSTEIN). At first, all the data points are sorted in the descending order of their density. Then, the highest density data points are selected as many as the number of classes. To determine the neighborhood relations, the circles centered on the target points are drawn and the points inside or on the circles are considered to be neighbors. In the next step, the significance of each feature is computed and a greedy algorithm selects appropriate features. The performance of the proposed approach is compared to both the commonest and newest methods of feature selection. The experimental results show that EPSTEIN could select more efficient subsets of features and improve the prediction accuracy of classifiers in comparison to the other state-of-the-art methods such as Correlation-based Feature Selection (CFS), Fast Correlation-Based Filter (FCBF), Heuris- tic Algorithm Based on Neighborhood Discrimination Index (HANDI), Ranking Based Feature Inclusion for Optimal Feature Subset (KNFI), Ranking Based Feature Elimination (KNFE) and Principal Component Analysis and Information Gain (PCA-IG).

A two-stage hybrid gene selection algorithm combined with machine learning models to predict the rupture status in intracranial aneurysms.

An IA is an abnormal swelling of cerebral vessels, and a subset of these IAs can rupture causing aneurysmal subarachnoid hemorrhage (aSAH), often resulting in death or severe disability. Few studies have used an appropriate method of feature selection combined with machine learning by analyzing transcriptomic sequencing data to identify new molecular biomarkers. Following gene ontology (GO) and enrichment analysis, we found that the distinct status of IAs could lead to differential innate immune responses using all 913 differentially expressed genes, and considering that there are numerous irrelevant and redundant genes, we propose a mixed filter- and wrapper-based feature selection. First, we used the Fast Correlation-Based Filter (FCBF) algorithm to filter a large number of irrelevant and redundant genes in the raw dataset, and then used the wrapper feature selection method based on the he Multi-layer Perceptron (MLP) neural network and the Particle Swarm Optimization (PSO), accuracy (ACC) and mean square error (MSE) were then used as the evaluation criteria. Finally, we constructed a novel 10-gene signature (YIPF1, RAB32, WDR62, ANPEP, LRRCC1, AADAC, GZMK, WBP2NL, PBX1, and TOR1B) by the proposed two-stage hybrid algorithm FCBF-MLP-PSO and used different machine learning models to predict the rupture status in IAs. The highest ACC value increased from 0.817 to 0.919 (12.5% increase), the highest area under ROC curve (AUC) value increased from 0.87 to 0.94 (8.0% increase), and all evaluation metrics improved by approximately 10% after being processed by our proposed gene selection algorithm. Therefore, these 10 informative genes used to predict rupture status of IAs can be used as complements to imaging examinations in the clinic, meanwhile, this selected gene signature also provides new targets and approaches for the treatment of ruptured IAs.

A Short-Term Photovoltaic Power Forecasting Method Combining a Deep Learning Model with Trend Feature Extraction and Feature Selection

High precision short-term photovoltaic (PV) power prediction can reduce the damage associated with large-scale photovoltaic grid-connection to the power system. In this paper, a combination deep learning forecasting method based on variational mode decomposition (VMD), a fast correlation-based filter (FCBF) and bidirectional long short-term memory (BiLSTM) network is developed to minimize PV power forecasting error. In this model, VMD is used to extract the trend feature of PV power, then FCBF is adopted to select the optimal input-set to reduce the forecasting error caused by the redundant feature. Finally, the input-set is put into the BiLSTM network for training and testing. The performance of this model is tested by a case study using the public data-set provided by a PV station in Australia. Comparisons with common short-term PV power forecasting models are also presented. The results show that under the processing of trend feature extraction and feature selection, the proposed methodology provides a more stable and accurate forecasting effect than other forecasting models.