Selection Method Research Articles

A New Performance Metric to Evaluate Filter Feature Selection Methods in Text Classification

A New Performance Metric to Evaluate Filter Feature Selection Methods in Text Classification

Automatic recognition of excavator working cycles using supervised learning and motion data obtained from inertial measurement units (IMUs)

This paper proposes an automatic method for excavator working cycle recognition using supervised classification methods and motion information obtained from four inertial measurement units (IMUs) attached to moving parts of an excavator. Monitoring and analyzing tasks that have been performed by heavy-duty mobile machines (HDMMs) are significantly required to assist management teams in productivity and progress monitoring, efficient resource allocation, and scheduling. Nevertheless, traditional methods depend on human observations, which are costly, time-consuming, and error-prone. There is a lack of a method to automatically detect excavator major activities. In this paper, a data-driven method is presented to identify excavator activities, including loading, trenching, grading, and idling, using motion information, such as angular velocities and joint angles, obtained from moving parts, including swing body, boom, arm, and bucket. Firstly, a dataset lasting 3 h is collected using a medium-rated excavator. One experienced and one inexperienced operator performed tasks under different working conditions, such as different types of material, swing angle, digging depth, and weather conditions. Four classification methods, including support vector machine (SVM), k-nearest neighbor (KNN), decision tree (DT), and naive Bayes, are off-line trained. The results show that the proposed method can effectively identify excavator working cycles with a high accuracy of 99%. Finally, the impacts of parameters, such as time window, overlapping configuration, and feature selection methods, on the classification accuracy are comprehensively analyzed.

Matrix-Based Incremental Feature Selection Method Using Weight-Partitioned Multigranulation Rough Set

Incremental feature selection methods have gained increasing research attention as they improve the efficiency of feature selection for dynamic datasets. Multigranulation rough set, as an extension of rough set theory, allows for a comprehensive and rational analysis of problems from multiple hierarchical and granular perspectives.However, existing research on granularity partitioning relies on the decision maker's subjective experience, which lacks convincing power. In this paper, we propose a generalized multigranulation neighborhood rough set based on weight partition model, using a matrix form. We discuss several properties and define a new entropy measure to evaluate feature importance. A heuristic feature selection algorithm is developed based on this entropy to search for the optimal subset. Furthermore, we discuss dynamic updating mechanism and design two incremental feature selection algorithms. Finally, we conduct experiments on 12 public datasets to evaluate the performance of the proposed algorithms and validate their effectiveness and efficiency in feature selection for both static and dynamic datasets.

REACT: Autonomous intrusion response system for intelligent vehicles

Autonomous and connected vehicles are rapidly evolving, integrating numerous technologies and software. This progress, however, has made them appealing targets for cybersecurity attacks. As the risk of cyber threats escalates with this advancement, the focus is shifting from solely preventing these attacks to also mitigating their impact. Current solutions rely on vehicle security operation centers, where attack information is analyzed before deciding on a response strategy. However, this process can be time-consuming and faces scalability challenges, along with other issues stemming from vehicle connectivity. This paper proposes a dynamic intrusion response system integrated within the vehicle. This system enables the vehicle to respond to a variety of incidents almost instantly, thereby reducing the need for interaction with the vehicle security operation center. The system offers a comprehensive list of potential responses, a methodology for response evaluation, and various response selection methods. The proposed solution was implemented on an embedded platform. Two distinct cyberattack use cases served as the basis for evaluating the system. The evaluation highlights the system’s adaptability, its ability to respond swiftly, its minimal memory footprint, and its capacity for dynamic system parameter adjustments. The proposed solution underscores the necessity and feasibility of incorporating dynamic response mechanisms in smart vehicles. This is a crucial factor in ensuring the safety and resilience of future smart mobility.

Rapid Nuclease-Assisted Selection of High-Affinity Small-Molecule Aptamers.

Aptamers are nucleic acid bioreceptors that have been widely utilized for a variety of biosensing applications, including in vivo detection methods that would not be possible with antibody-based systems. However, it remains challenging to generate high-quality aptamers for small molecule targets, particularly for use under physiological conditions. We present a highly effective aptamer selection technology for small-molecule targets that utilizes the nuclease EcoRI to remove nonspecific or weakly binding sequences in solution phase, rapidly enriching high-affinity target binders within just a few rounds of selection. As proof-of-concept, we used our nuclease-assisted SELEX (NA-SELEX) method to isolate aptamers for a synthetic cannabinoid, AB-FUBINACA. Within five rounds, we identified two highly specific aptamers that exhibit nanomolar affinity at physiological temperature. We also demonstrate the robustness and reproducibility of NA-SELEX by performing the same selection experiment with fresh reagents and libraries, obtaining the same two aptamers as well as two other high-quality aptamer candidates. Finally, we compare NA-SELEX against a conventional library-immobilized SELEX screen for AB-FUBINACA using the same screening conditions, identifying aptamers with 25-100-fold weaker affinity after 11 rounds of selection. NA-SELEX therefore could be an effective selection method for the isolation of high-quality aptamers for small-molecule targets.

Groundwater salinity modeling and mapping using machine learning approaches: a case study in Sidi Okba region, Algeria.

The groundwater salinization process complexity and the lack of data on its controlling factors are the main challenges for accurate predictions and mapping of aquifer salinity. For this purpose, effective machine learning (ML) methodologies are employed for effective modeling and mapping of groundwater salinity (GWS) in the Mio-Pliocene aquifer in the Sidi Okba region, Algeria, based on limited dataset of electrical conductivity (EC) measurements and readily available digital elevation model (DEM) derivatives. The dataset was randomly split into training (70%) and testing (30%) sets, and three wrapper selection methods, recursive feature elimination (RFE), forward feature selection (FFS), and backward feature selection (BFS) are applied to train the data. The resulting combinations are used as inputs for five ML models, namely random forest (RF), hybrid neuro-fuzzy inference system (HyFIS), K-nearest neighbors (KNN), cubist regression model (CRM), and support vector machine (SVM). The best-performing model is identified and applied to predict and map GWS across the entire study area. It is highlighted that the applied methods yield input variation combinations as critical factors that are often overlocked by many researchers, which substantially impacts the models' accuracy. Among different alternatives the RF model emerged as the most effective for predicting and mapping GWS in the study area, which led to the high performance in both the training (RMSE = 1.016, R = 0.854, and MAE = 0.759) and testing (RMSE = 1.069, R = 0.831, and MAE = 0.921) phases. The generated digital map highlighted the alarming situation regarding excessive GWS levels in the study area, particularly in zones of low elevations and far from the Foum Elgherza dam and Elbiraz wadi. Overall, this study represents a significant advancement over previous approaches, offering enhanced predictive performance for GWS with the minimum number of input variables.

Empirical comparison of genomic selection to phenotypic selection for biomass yield of switchgrass

AbstractSwitchgrass (Panicum virgatum L.) is one of several grass species being bred for use as a biomass crop to support the biofuel industry. Increases in biomass yield are imperative to ensure that crops such as switchgrass can sustainably meet the needs of this industry. Genomic selection is one strategy that can accelerate breeding gains for complex traits such as biomass yield. The goal of this study was to conduct three cycles of genomic selection in a previously trained Liberty switchgrass population and compare that to one cycle of phenotypic selection, both of which required 3 years to complete. The advanced lines were tested across five locations and three hardiness zones in the Central United States using a randomized complete block design with four replicates. There were strong genotype × location interactions, but the first two generations of genomic selection were superior to Liberty at four of the five evaluation locations. Conversely, phenotypic selection failed to result in significant gains in biomass yield for any of the five evaluation locations. Based on these results from Liberty switchgrass, genomic selection methods are expected to at least double the rates of gain in biomass yield relative to previous estimates using phenotypic selection methods.

Secondary Cytoreductive Surgery in Relapsed Platinum-Sensitive Epithelial Ovarian Cancer: A Systematic Review of Randomized Controlled Trials

Secondary cytoreductive surgery is a treatment option for relapsed platinum-sensitive epithelial ovarian cancer, but no clear indications are defined for the procedure. This systematic review aims to establish clear indications and compare outcomes versus standard-of-care chemotherapy. We conducted an electronic literature search across three databases and identified 2033 articles, including three phase 3 randomized controlled trials (RCT). The review adhered to PRISMA 2020 guidelines and was registered in PROSPERO (no. CRD42022379817). Despite varying patient selection methods, surgery plus chemotherapy demonstrated significantly prolonged progression-free survival compared to chemotherapy alone. However, overall survival outcomes were inconsistent: while GOG-0213 did not show extended overall survival, recent studies with stricter defined criteria for surgery (SOC-1 and DESKTOP-III) reported improved overall survival with the addition of surgery. Morbidity and mortality rates were low, with no difference in quality of life between the surgery and no-surgery groups. In conclusion, cytoreductive surgery presents a promising option for recurrent epithelial ovarian cancer treatment. Nonetheless, well-defined selection criteria appear crucial for achieving increased overall survival compared to conventional treatment.

Integrated Optimization of Route and Frequency for Rail Transit Feeder Buses under the Influence of Shared Motorcycles

In this paper, we develop a multi-objective integrated optimization method for feeder buses of rail transit based on realistic considerations. We propose a bus stop selection method that considers the influence of shared motorcycles, which can score the importance of alternative bus stops and select those with the highest scores as objectives. The objective of the model in this paper is to minimize both the travel costs of passengers and the operating costs of the bus company. This is achieved by optimizing feeder bus routes, the frequency of departures, and interchange discounts to enhance the connectivity between feeder buses and rail transit. In addition, to ensure the feasibility of generated routes in the real road network, a genetic algorithm encoded with priority is used to solve this model. We use the Xingyao Road subway station in Kunming as an example, and the results show that the optimization method is effective.

A taxonomy of unsupervised feature selection methods including their pros, cons, and challenges

A taxonomy of unsupervised feature selection methods including their pros, cons, and challenges

Towards Exploring the Limitations of Test Selection Techniques on Graph Neural Networks: An Empirical Study

Graph Neural Networks (GNNs) have gained prominence in various domains, such as social network analysis, recommendation systems, and drug discovery, due to their ability to model complex relationships in graph-structured data. GNNs can exhibit incorrect behavior, resulting in severe consequences. Therefore, testing is necessary and pivotal. However, labeling all test inputs for GNNs can be prohibitively costly and time-consuming, especially when dealing with large and complex graphs. In response to these challenges, test selection has emerged as a strategic approach to alleviate labeling expenses. The objective of test selection is to select a subset of tests from the complete test set. While various test selection techniques have been proposed for traditional deep neural networks (DNNs), their adaptation to GNNs presents unique challenges due to the distinctions between DNN and GNN test data. Specifically, DNN test inputs are independent of each other, whereas GNN test inputs (nodes) exhibit intricate interdependencies. Therefore, it remains unclear whether DNN test selection approaches can perform effectively on GNNs. To fill the gap, we conduct an empirical study that systematically evaluates the effectiveness of various test selection methods in the context of GNNs, focusing on three critical aspects: 1) Misclassification detection: selecting test inputs that are more likely to be misclassified; 2) Accuracy estimation: selecting a small set of tests to precisely estimate the accuracy of the whole testing set; 3) Performance enhancement: selecting retraining inputs to improve the GNN accuracy. Our empirical study encompasses 7 graph datasets and 8 GNN models, evaluating 22 test selection approaches. Our study includes not only node classification datasets but also graph classification datasets. Our findings reveal that: 1) In GNN misclassification detection, confidence-based test selection methods, which perform well in DNNs, do not demonstrate the same level of effectiveness; 2) In terms of GNN accuracy estimation, clustering-based methods, while consistently performing better than random selection, provide only slight improvements; 3) Regarding selecting inputs for GNN performance improvement, test selection methods, such as confidence-based and clustering-based test selection methods, demonstrate only slight effectiveness; 4) Concerning performance enhancement, node importance-based test selection methods are not suitable, and in many cases, they even perform worse than random selection.

Porosity Prediction Based on Ensemble Learning for Feature Selection and an Optimized GRU Improved by the PSO Algorithm

Accurate and reliable prediction of porosity forms the foundational basis for evaluating reservoir quality, which is essential for the systematic deployment of oil and gas exploration and development plans. When data quality of samples is low, and critical model parameters are typically determined through subjective experience, resulting in diminished accuracy and reliability of porosity prediction methods utilizing gated recurrent units (GRU), a committee-voting ensemble learning (EL) method, and an enhanced particle swarm optimization (PSO) algorithm are proposed to optimize the GRU-based porosity prediction model. Initially, outliers are eliminated through box plots and the min–max normalization is applied to enhance data quality. To address issues related to model accuracy and high training costs arising from dimensional complexity, substantial noise, and redundant information in logging data, a committee-voting EL strategy based on four feature selection algorithms is introduced. Following data preprocessing, this approach is employed to identify logging parameters highly correlated with porosity, thereby furnishing the most pertinent data samples for the GRU model, mitigating constraints imposed by single-feature selection methods. Second, an improved PSO algorithm is suggested to tackle challenges associated with low convergence accuracy stemming from random population initialization, alongside the absence of global optimal solutions due to overly rapid particle movement during iteration. This algorithm uses a good-point set for population initialization and incorporates a compression factor to devise an adaptive velocity updating strategy, thereby enhancing search efficacy. The enhanced PSO algorithm’s superiority is substantiated through comparison with four alternative swarm intelligent algorithms across 10 benchmark test functions. Ultimately, optimal hyper-parameters for the GRU model are determined using the improved PSO algorithm, thereby minimizing the influence of human factors. Experimental findings based on approximately 15,000 logging data points from well A01 in an operational field validate that, relative to three other deep learning methodologies, the proposed model proficiently extracts spatiotemporal features from logging data, yielding enhanced accuracy in porosity prediction. The mean squared error on the test set was 7.19 × 10–6, the mean absolute error stood at 0.0082, and coefficient of determination reached 0.99, offering novel insights for predicting reservoir porosity.

Interpretable deep residual network uncovers nucleosome positioning and associated features.

Nucleosomes represent elementary building units of eukaryotic chromosomes and consist of DNA wrapped around a histone octamer flanked by linker DNA segments. Nucleosomes are central in epigenetic pathways and their genomic positioning is associated with regulation of gene expression, DNA replication, DNA methylation and DNA repair, among other functions. Building on prior discoveries that DNA sequences noticeably affect nucleosome positioning, our objective is to identify nucleosome positions and related features across entire genome. Here, we introduce an interpretable framework based on the concepts of deep residual networks (NuPoSe). Trained on high-coverage human experimental MNase-seq data, NuPoSe is able to learn sequence and structural patterns associated with nucleosome organization in human genome. NuPoSe can bealsoapplied to unseen data from different organisms and cell types. Our findings point to 43 informative features, most of them constitute tri-nucleotides, di-nucleotides and one tetra-nucleotide. Most features are significantly associated with the nucleosomal structuralcharacteristics, namely, periodicity of nucleosomal DNA and its location with respect to a histone octamer. Importantly, we show that features derived from the 27 bp linker DNAflanking nucleosomescontribute up to 10% to the quality of the prediction model. This,alongwith the comprehensive training sets, deep-learning architecture, and feature selection method,may contribute totheNuPoSe's 80-89% classificationaccuracy on different independentdatasets.

A two-tier feature selection method for predicting mortality risk in ICU patients with acute kidney injury

Acute kidney injury (AKI) is one of the most important lethal factors for patients admitted to intensive care units (ICUs), and timely high-risk prognostic assessment and intervention are essential to improving patient prognosis. In this study, a stacking model using the MIMIC-III dataset with a two-tier feature selection approach was developed to predict the risk of in-hospital mortality in ICU patients admitted for AKI. External validation was performed using separate MIMIC-IV and eICU-CRD. The area under the curve (AUC) was calculated using the stacking model, and features were selected using the Boruta and XGBoost feature selection methods. This study compares the performance of a stacking model using two-tier feature selection with a model using single-tier feature selection (XGBoost: 85; Boruta: 83; two-tier: 0.91). The predictive effectiveness of the stacking model was further validated by using different datasets (Validation 1: 0.83; Validation 2: 0.85) and comparing it with a simpler model and traditional clinical scores (SOFA: 0.65; APACH IV: 0.61). In addition, this study combined interpretable techniques and causal inference to analyze the causal relationship between features and predicted outcomes.

Pairwise-Constraint-Guided Multi-View Feature Selection by Joint Sparse Regularization and Similarity Learning

Feature selection is a basic and important step in real applications, such as face recognition and image segmentation. In this paper, we propose a new weakly supervised multi-view feature selection method by utilizing pairwise constraints, i.e., the pairwise constraint-guided multi-view feature selection (PCFS for short) method. In this method, linear projections of all views and a consistent similarity graph with pairwise constraints are jointly optimized to learning discriminative projections. Meanwhile, the l2,0-norm-based row sparsity constraint is imposed on the concatenation of projections for discriminative feature selection. Then, an iterative algorithm with theoretically guaranteed convergence is developed for the optimization of PCFS. The performance of the proposed PCFS method was evaluated by comprehensive experiments on six benchmark datasets and applications on cancer clustering. The experimental results demonstrate that PCFS exhibited competitive performance in feature selection in comparison with related models.

The effect of pueraria isoflavones on bone binding around with osteoporosis state based on Micro-CT detection

ObjectivesThe osteoporosis (OP) is the biggest hidden danger for the oral implantation. To discussion the effect of Pueraria lobata isoflavones on osseointegration around implants with osteoporotic stat. Materials and methodsThe bilateral ovarian extraction is a selection method for modeling osteoporosis. The Low dose (25 mg/kg) gavage has no obvious effect. The Medium (50 mg/kg) and High (100 mg/kg) dose gavage can achieve the purpose of promoting new bone formation and bone mineralization around the implant. The three different doses of Pueraria isoflavones were administered for 12 weeks. The data of the experimental group and the Model group were recorded during the treatment. ResultsThe results shown that gavage of Pueraria lobata isoflavones can promote implants Peripheral osseointegration. The Low dose gavage has no obvious effect. The Medium and High dose gavage can achieve the purpose of promoting new bone formation and bone mineralization around the implant. When osseointegration is evaluated by a mechanical force, High dose Pueraria lobata treatment can reached the effect which is closely to the Normal group and Sham-operated group. ConclusionIt is demonstrated that Pueraria lobata isoflavones has important treatment value for postmenopausal osteoporosis.

Allergen Microarrays and New Physical Approaches to More Sensitive and Specific Detection of Allergen-Specific Antibodies

The prevalence of allergic diseases has increased tremendously in recent decades, which can be attributed to growing exposure to environmental triggers, changes in dietary habits, comorbidity, and the increased use of medications. In this context, the multiplexed diagnosis of sensitization to various allergens and the monitoring of the effectiveness of treatments for allergic diseases become particularly urgent issues. The detection of allergen-specific antibodies, in particular, sIgE and sIgG, is a modern alternative to skin tests due to the safety and efficiency of this method. The use of allergen microarrays to detect tens to hundreds of allergen-specific antibodies in less than 0.1 mL of blood serum enables the transition to a deeply personalized approach in the diagnosis of these diseases while reducing the invasiveness and increasing the informativeness of analysis. This review discusses the technological approaches underlying the development of allergen microarrays and other protein microarrays, including the methods of selection of the microarray substrates and matrices for protein molecule immobilization, the obtainment of allergens, and the use of different types of optical labels for increasing the sensitivity and specificity of the detection of allergen-specific antibodies.

Performance Evaluation and Comparison of Deep Neural Network Models for African Soil Properties Prediction

ABSTRACT The significance of soil in agriculture and human survival cannot be overstated. Given its limited supply, improving soil properties is imperative. This study addresses this challenge by predicting five major soil properties—organic carbon, pH values, Mehlich-3 extractable calcium, Mehlich-3 extractable phosphorus, and sand content—utilizing mid-infrared absorbance measurements from the African Soil Information Service (AfSIS) dataset, covering non-desert regions of Africa. With a pressing need for a reliable and efficient model to predict African soil properties using spectral measurements, this study fills a crucial gap, addressing the scarcity of functional soil property databases in Africa. The developed model eliminates costly soil sample preparation and lengthy chemical analysis, applicable in both onsite and laboratory settings for determining soil functional properties. By employing stacked autoencoders for feature dimensionality reduction and combining discrete wavelet transform with two feature selection methods (stepwise regression and random forest) to build robust multi-layer perceptron (MLP) models, the study offers a comprehensive approach. Evaluation metrics including root mean square error (RMSE), scatter index (SI), Variance Accounted For (VAF), Nash-Sutcliffe Model Efficiency (NSE), and Correlation Coefficient (R) demonstrate the superior performance of the MLP model informed by stacked autoencoder-selected features, outperforming models informed by wavelet-transformed features and partial least square regression. This best-performing autoencoder-based model presents a valuable tool for soil scientists tasked with modeling African soil properties.

Machine Learning-Driven Detection of Cross-Site Scripting Attacks

The ever-growing web application landscape, fueled by technological advancements, introduces new vulnerabilities to cyberattacks. Cross-site scripting (XSS) attacks pose a significant threat, exploiting the difficulty of distinguishing between benign and malicious scripts within web applications. Traditional detection methods struggle with high false-positive (FP) and false-negative (FN) rates. This research proposes a novel machine learning (ML)-based approach for robust XSS attack detection. We evaluate various models including Random Forest (RF), Logistic Regression (LR), Support Vector Machines (SVMs), Decision Trees (DTs), Extreme Gradient Boosting (XGBoost), Multi-Layer Perceptron (MLP), Convolutional Neural Networks (CNNs), Artificial Neural Networks (ANNs), and ensemble learning. The models are trained on a real-world dataset categorized into benign and malicious traffic, incorporating feature selection methods like Information Gain (IG) and Analysis of Variance (ANOVA) for optimal performance. Our findings reveal exceptional accuracy, with the RF model achieving 99.78% and ensemble models exceeding 99.64%. These results surpass existing methods, demonstrating the effectiveness of the proposed approach in securing web applications while minimizing FPs and FNs. This research offers a significant contribution to the field of web application security by providing a highly accurate and robust ML-based solution for XSS attack detection.

Design Analysis to Enhance Financial Education for Student Entrepreneurs in University

Telkom University organizes an entrepreneurship program that serves entire students who want to start a business with a selection method to be incubated for one semester or more. Doing business for Student Entrepreneurship (SE) requires financial management expertise because it is very important to ensure that products are in line with expectations and efficient use of resources to maximize business profits. Financial skills are also important in running businesses. From that, the university holds learning finance management in the process of business incubation, but SE feels learning financial management is not interesting. Therefore, this research aims to discuss the needs of financial management for SE, lecturers, and universities with a qualitative approach through focus group discussion. The study's key findings are that SE needs to learn about financial statements. They also expect this to be done automatically on a digital basis that is easy to use, so entrepreneurial students can take advantage of the automatically generated data for proper decision-making and can focus on the creative and innovative aspects of the product. Financial apps for financial statements could potentially be made by digital software developers