Selection Classification Research Articles

Integrated Approach Using Intuitionistic Fuzzy Multicriteria Decision-Making to Support Classifier Selection for Technology Adoption in Patients with Parkinson Disease: Algorithm Development and Validation.

Parkinson disease (PD) is reported to be among the most prevalent neurodegenerative diseases globally, presenting ongoing challenges and increasing burden on health care systems. In an effort to support patients with PD, their carers, and the wider health care sector to manage this incurable condition, the focus has begun to shift away from traditional treatments. One of the most contemporary treatments includes prescribing assistive technologies (ATs), which are viewed as a way to promote independent living and deliver remote care. However, the uptake of these ATs is varied, with some users not ready or willing to accept all forms of AT and others only willing to adopt low-technology solutions. Consequently, to manage both the demands on resources and the efficiency with which ATs are deployed, new approaches are needed to automatically assess or predict a user's likelihood to accept and adopt a particular AT before it is prescribed. Classification algorithms can be used to automatically consider the range of factors impacting AT adoption likelihood, thereby potentially supporting more effective AT allocation. From a computational perspective, different classification algorithms and selection criteria offer various opportunities and challenges to address this need. This paper presents a novel hybrid multicriteria decision-making approach to support classifier selection in technology adoption processes involving patients with PD. First, the intuitionistic fuzzy analytic hierarchy process (IF-AHP) was implemented to calculate the relative priorities of criteria and subcriteria considering experts' knowledge and uncertainty. Second, the intuitionistic fuzzy decision-making trial and evaluation laboratory (IF-DEMATEL) was applied to evaluate the cause-effect relationships among criteria/subcriteria. Finally, the combined compromise solution (CoCoSo) was used to rank the candidate classifiers based on their capability to model the technology adoption. We conducted a study involving a mobile smartphone solution to validate the proposed methodology. Structure (F5) was identified as the factor with the highest relative priority (overall weight=0.214), while adaptability (F4) (D-R=1.234) was found to be the most influencing aspect when selecting classifiers for technology adoption in patients with PD. In this case, the most appropriate algorithm for supporting technology adoption in patients with PD was the A3 - J48 decision tree (M3=2.5592). The results obtained by comparing the CoCoSo method in the proposed approach with 2 alternative methods (simple additive weighting and technique for order of preference by similarity to ideal solution) support the accuracy and applicability of the proposed methodology. It was observed that the final scores of the algorithms in each method were highly correlated (Pearson correlation coefficient >0.8). The IF-AHP-IF-DEMATEL-CoCoSo approach helped to identify classification algorithms that do not just discriminate between good and bad adopters of assistive technologies within the Parkinson population but also consider technology-specific features like design, quality, and compatibility that make these classifiers easily implementable by clinicians in the health care system.

A Dynamic Selection Method for Touch-Based Continuous Authentication On Mobile Devices

Touch biometric is one of the promising modalities to realise continuous authentication (CA) on mobile devices by distinguishing between touch strokes performed by the legitimate and illegitimate users. While the benefit of the scheme is promising, the effectiveness of different classification methods is not thoroughly understood. Little consideration has been given to dynamic selection of classifiers. In this paper, we proposed a dynamic selection method to deal with the security and usability needs of touch-based CA. Instead of classifying all touch samples using the same classifier, the method classifies each touch sample using the most promising classifier(s) from a pool of classifiers based on a certain measure of competence. The classifiers that achieve the highest level of competence will be selected to perform the classification task. We compared the proposed method with other dynamic selection methods, well-known single classifiers, as well as static ensemble methods. The experimental results show the potential and feasibility of the proposed method to improve the authentication performance of touch-based CA against the benchmark methods. We found that the proposed method can produce promising results with relatively low equal error rate in many scenarios of the datasets, with relatively high consistency.

Deep Learning-Based Prediction Models for the Detection of Vitamin D Deficiency and 25-Hydroxyvitamin D Levels Using Complete Blood Count Tests

Vitamin D (VitD) is an essential nutrient that is critical for the well-being of both adults and children, and its deficiency is recognized as a precursor to several diseases. In previous studies, researchers have approached the problem of detecting vitamin D deficiency (VDD) as a single "sufficient/deficient" classification problem using machine learning or statistics-based methods. The main objective of this study is to predict a patient's VitD status (i.e., sufficiency, insufficiency, or deficiency), severity of VDD (i.e., mild, moderate, or severe), and 25-hydroxyvitamin D (25(OH)D) level in a separate deep learning (DL)-based models. An original dataset consisting of complete blood count (CBC) tests from 907 patients, including 25(OH)D concentrations, collected from a public health laboratory was used for this purpose. CNN, RNN, LSTM, GRU and Auto-encoder algorithms were used to develop DL-based models. The top 25 features in the CBC tests were carefully selected by implementing the Extra Trees Classifier and Multi-task LASSO feature selection algorithms. The performance of the models was evaluated using metrics such as accuracy, F1-score, mean absolute error, root mean square error and R-squared. Remarkably, all three models showed satisfactory results when compared to the existing literature; however, the CNN-based prediction models proved to be the most successful.

Boosting Commit Classification Based on Multivariate Mixed Features and Heterogeneous Classifier Selection

Commit classification plays a crucial role in software maintenance, as it permits developers to make informed decisions regarding resource allocation and code review. There are several approaches for automatic commit classification, yet they do not sufficiently explore the features related to commits and consider the advantages of ensemble models over individual models. Therefore, there is some room for improvement. In this paper, we propose MuheCC, a commit classification approach based on multivariate mixed features and heterogeneous classifier selection to address these challenges. It mainly consists of three phases: (1) Multivariate mixed feature extraction, which extracts features from commit messages, changed code and handcrafted features to construct comprehensive mixed features; (2) Hyperparameter tuning based on genetic algorithm, which utilizes genetic algorithm to optimize candidate traditional models and ensemble models; (3) Heterogeneous classifier selection, which selects the optimal combinations of traditional and ensemble models, respectively, to build a heterogeneous classifier for commit classification. To evaluate this approach, we extend an existing dataset with code changes for each commit and compare MuheCC with three baselines on this real-world dataset. The results show that MuheCC outperforms all baselines, especially improving the best baseline by 7.25% for accuracy, 6.88% for precision, 7.25% for recall and 7.06% for [Formula: see text]-score. Furthermore, the ablation experiments validate that the performance advantage of MuheCC is mainly attributed to the multivariate features (e.g. 12.55% contributions to accuracy) and the heterogeneous classifier (e.g. 12.26% contributions to accuracy). We further discuss the impact of hyperparameter tuning and heterogeneous classifier selection on the performance of MuheCC. These results prove the superiority and potential practical value of MuheCC.

Gesture Recognition Framework for Teleoperation of Infrared (IR) Consumer Devices Using a Novel pFMG Soft Armband.

Wearable technologies represent a significant advancement in facilitating communication between humans and machines. Powered by artificial intelligence (AI), human gestures detected by wearable sensors can provide people with seamless interaction with physical, digital, and mixed environments. In this paper, the foundations of a gesture-recognition framework for the teleoperation of infrared consumer electronics are established. This framework is based on force myography data of the upper forearm, acquired from a prototype novel soft pressure-based force myography (pFMG) armband. Here, the sub-processes of the framework are detailed, including the acquisition of infrared and force myography data; pre-processing; feature construction/selection; classifier selection; post-processing; and interfacing/actuation. The gesture recognition system is evaluated using 12 subjects' force myography data obtained whilst performing five classes of gestures. Our results demonstrate an inter-session and inter-trial gesture average recognition accuracy of approximately 92.2% and 88.9%, respectively. The gesture recognition framework was successfully able to teleoperate several infrared consumer electronics as a wearable, safe and affordable human-machine interface system. The contribution of this study centres around proposing and demonstrating a user-centred design methodology to allow direct human-machine interaction and interface for applications where humans and devices are in the same loop or coexist, as typified between users and infrared-communicating devices in this study.

Benchmarking bacterial taxonomic classification using nanopore metagenomics data of several mock communities

Taxonomic classification is crucial in identifying organisms within diverse microbial communities when using metagenomics shotgun sequencing. While second-generation Illumina sequencing still dominates, third-generation nanopore sequencing promises improved classification through longer reads. However, extensive benchmarking studies on nanopore data are lacking. We systematically evaluated performance of bacterial taxonomic classification for metagenomics nanopore sequencing data for several commonly used classifiers, using standardized reference sequence databases, on the largest collection of publicly available data for defined mock communities thus far (nine samples), representing different research domains and application scopes. Our results categorize classifiers into three categories: low precision/high recall; medium precision/medium recall, and high precision/medium recall. Most fall into the first group, although precision can be improved without excessively penalizing recall with suitable abundance filtering. No definitive ‘best’ classifier emerges, and classifier selection depends on application scope and practical requirements. Although few classifiers designed for long reads exist, they generally exhibit better performance. Our comprehensive benchmarking provides concrete recommendations, supported by publicly available code for reassessment and fine-tuning by other scientists.

A new dynamic classifier selection method for text classification

A new dynamic classifier selection method for text classification

Uncovering phishing attacks using principles of persuasion analysis

With the rising of Internet in early ’90s, many fraudulent activities have migrated from physical to digital: one of them is phishing. Phishing is a deceptive practice focused on exploiting the human factor, which is the most vulnerable aspect of any security process. In this scam, social engineering techniques are extensively utilized, specifically focusing on the principles of persuasion, to deceive individuals into disclosing sensitive information or engaging in malicious actions. This research explores the use of message subjectivity for detecting phishing attacks. It does so by assessing the impact of various data representations and classifiers on automatically identifying principles of persuasion. Furthermore, it investigates how these detected principles of persuasion can be leveraged for identifying phishing attacks. The experiments conducted revealed that there is no universal solution for data representation and classifier selection to effectively detect all principles of persuasion. Instead, a tailored combination of data representation and classifiers is required for detecting each principle. The Machine Learning models created automatically detect principles of persuasion with confidence levels ranging from 0.7306 to 0.8191 for AUC-ROC. Next, principles of persuasion detected are used for phishing detection. This study also emphasizes the need for user-friendly and comprehensible models. To validate the proposal presented, several families of classifiers were tested, but among all of them, tree-based models (and Random Forest in particular) stand out as preferred option. These models achieve similar level of effectiveness as alternative methods while offering improved clarity and user-friendliness, with an AUC-ROC of 0.859842.

Personalized Classifier Selection for EEG-Based BCIs

Personalized Classifier Selection for EEG-Based BCIs

Geographical profiling of wood samples via ATR-FTIR spectroscopy and machine learning algorithms: Application in wood forensics

Illegal activities associated with deforestation for the lumber and furniture industries pose significant threats to plant and animal biodiversity, as well as natural resources. Accurate identification of wood sources is vital, yet traditional laboratory techniques often fall short in precisely determining the chemical composition of samples for classification. This study aims to leverage ATR-FTIR spectroscopy alongside machine learning algorithms to construct a robust model for discerning the geographical origins of wood samples from India. By systematically comparing various machine learning classifiers, we address the limitations of subjective visual interpretation and evaluate their accuracy using wood spectral data. Logistic regression emerges as the most effective classifier for distinguishing Eucalyptus (75 % accuracy), Dalbergia (68 % accuracy), and Populus (81.5 % accuracy) species. Through a methodology encompassing data pre-processing, classifier selection, and performance evaluation, this research offers promising tools for combating challenges posed by illegal wood trafficking and transportation. The outcomes hold significant potential for enhancing wildlife crime prevention efforts by facilitating the tracing illicit timber sources, apprehension of perpetrators, and implementation of preventive measures.

Ensemble learning method for classification: Integrating data envelopment analysis with machine learning

In classification tasks with large sample sets, the use of a single classifier carries the risk of overfitting. To overcome this issue, an ensemble of classifier models has often been shown to outperform the use of a single “best” model. Given the rich variety of classifier models available, the selection of the high-efficiency classifiers for a given task dataset remains an urgent challenge. However, most of the previous classifier selection methods only focus on the measurement of classification output performance without considering the computational cost. This paper proposes a new ensemble learning method to improve the classification quality for big datasets by using data envelopment analysis. It contains the following two stages: classifier selection and classifier combination. In the first stage, the commonly used classifiers are evaluated on the basis of their performance on resource consumption and classification output performance using the range directional model (RDM); then, the most efficient classifiers are selected. In the second stage, the classifier confusion matrix is evaluated using the data envelopment analysis (DEA) cross-efficiency model. Then, the weight for the classifier combination is determined to ensure that classifiers with higher performance have greater weights based on the cross-efficiency values. Experimental results demonstrate the superiority of the cross-efficiency model over the BCC model and the benchmark voting method in model ensemble. Furthermore, our method has been shown to save more computational resources and yields better results than existing methods.

Selective classification with machine learning uncertainty estimates improves ACS prediction: A retrospective study in the prehospital setting.

Accurate identification of acute coronary syndrome (ACS) in the prehospital sestting is important for timely treatments that reduce damage to the compromised myocardium. Current machine learning approaches lack sufficient performance to safely rule-in or rule-out ACS. Our goal is to identify a method that bridges this gap. To do so, we retrospectively evaluate two promising approaches, an ensemble of gradient boosted decision trees (GBDT) and selective classification (SC) on consecutive patients transported by ambulance to the ED with chest pain and/or anginal equivalents. On the task of ACS classification with 23 prehospital covariates, we found the fusion of the two (GBDT+SC) improves the best reported sensitivity and specificity by 8% and 23% respectively. Accordingly, GBDT+SC is safer than current machine learning approaches to rule-in and rule-out of ACS in the prehospital setting.

Sequential Datum-wise Feature Acquisition and Classifier Selection

Sequential Datum-wise Feature Acquisition and Classifier Selection

Adaptive K values and training subsets selection for optimal K-NN performance on FPGA

This study introduces an Adaptive K-Nearest Neighbors methodology designed for FPGA platforms, offering substantial improvements over traditional K-Nearest Neighbors implementations. By integrating a dynamic classifier selection system, our approach enhances adaptability, enabling on-the-fly adjustments of K values and subsets of training data. This flexibility results in up to a 10.66% improvement in accuracy and significantly reduces latency, rendering our system up to 3.918 times more efficient than conventional K-Nearest Neighbors techniques. The methodology’s efficacy is validated through experiments across multiple datasets, demonstrating its potential in optimizing both classification accuracy and system efficiency. The adaptive approach’s ability to improve response times, along with its flexibility, positions it as an ideal solution for real-time applications and highlights the advantages of the adaptive K-Nearest Neighbors methodology in overcoming the constraints of hardware-accelerated machine learning.

Adap-BDCM: Adaptive Bilinear Dynamic Cascade Model for Classification Tasks on CNV Datasets.

Copy number variation (CNV) is an essential genetic driving factor of cancer formation and progression, making intelligent classification based on CNV feasible. However, there are a few challenges in the current machine learning and deep learning methods, such as the design of base classifier combination schemes in ensemble methods and the selection of layers of neural networks, which often result in low accuracy. Therefore, an adaptive bilinear dynamic cascade model (Adap-BDCM) is developed to further enhance the accuracy and applicability of these methods for intelligent classification on CNV datasets. In this model, a feature selection module is introduced to mitigate the interference of redundant information, and a bilinear model based on the gated attention mechanism is proposed to extract more beneficial deep fusion features. Furthermore, an adaptive base classifier selection scheme is designed to overcome the difficulty of manually designing base classifier combinations and enhance the applicability of the model. Lastly, a novel feature fusion scheme with an attribute recall submoduleis constructed, effectively avoiding getting stuck in local solutions and missing some valuable information. Numerous experiments have demonstrated that our Adap-BDCM model exhibits optimal performance in cancer classification, stage prediction, and recurrence on CNV datasets. This study can assist physicians in making diagnoses faster and better.

The Contrastive and Referential Function of Specific Classifiers in Xiamen Southern Min—Evidence from a Cognitive Experimental Study

Southern Min is generally known for not using classifiers [CL] for expressing definiteness/indefiniteness as it is associated with the bare classifier construction [CL N]. This paper offers evidence from Xiamen Southern Min (XSM) that the use of a specific classifier vs. the general classifier é contributes to referentiality in an alternative way by supporting object identification as it is due to the semantic specificity present in specific classifiers and absent in the general classifier. In a dialogic cognitive experiment adapted from the “Hidden color-chips” task (Enfield and Bohnemeyer 2001), 18 participants had to manipulate their addressees’ attention toward various objects situated in their immediate physical space through language as well as deictic gestures. The objects were associated with different specific classifiers or with the general classifier, and they were arranged according to the factors of (a) distance from speaker, (b) visibility for speaker, and (c) uniqueness (adjacency of similar items). The results show, among other things, that there is a higher tendency to use the specific CL in the [demonstrative CL N] construction if adjacent similar objects [−unique] are too far away from the speaker for clear identification by a demonstrative or a pointing gesture. This is seen as a last-resort strategy for creating contrast. Further corroboration comes from the use of specific classifiers in later mentions after the general CL failed to achieve clear identification. These findings can be situated in the broader context of other languages with classifiers in contrastive function (Thai, Vietnamese, and Ponapean) and they show the relevance of using dialogic texts for modeling classifier selection in contrast to narrative texts. Finally, dialogic contexts may serve as bridging contexts for grammaticalization from numeral classifiers to definiteness markers.

Enhanced Diabetic Retinopathy Diagnosis: A Comparative Analysis of models with an Ensemble classifier and Deep Q Learning

- A novel method that combines the strengths of different classifiers such as Naive Bayes, Multi-Layer Perceptron (MLP), and Support Vector Machine (SVM) is introduced in this paper. This method tackles the urgent need for cutting-edge diagnostic methods in the field of ophthalmology, mainly for the identification of diabetic retinopathy (DR). The approach is ensemble-based. Classical methods in retinal analysis of images often fail as they are static and are unable to adjust to the unique details that each distinct image presents. This constraint results in less accurate and precise diagnostic results, highlighting the urgent need for more adaptable and dynamic methods. The suggested model differs significantly from previous methods. Through the use of an ensemble approach, it capitalizes on the distinct advantages of each classifier: the MLP process's sophisticated feature extraction skill, Naive Bayes' probabilistic analysis, and SVM's non-linear pattern recognition capacity. By combining these techniques, the inherent drawbacks of utilizing a single strategy are addressed, guaranteeing a more thorough examination of retinal samples and images. The core of this idea is the system using Deep Q Learning (DQL) for adaptive classifier selection. Using learned Q Values for various contexts, this reinforcement learning technique selects the best classifier adaptively for each unique retinal image, hence optimizing the ensemble. This approach not only advances diagnosis accuracy and precision but also guarantees ongoing learning and adaptation to keep up with changing data patterns and advances in imaging technology. Extensive experiments on the IDRiD & EyePACS Dataset show the effectiveness of this model with a 5.5% increase in overall accuracy with other performance metrics, the results show a significant improvement over the current method. They represent a significant advancement in the timely and accurate identification of diabetic retinopathy, which will ultimately benefit patients and lessen the strain on healthcare systems. Thus, this work represents a major step forward in patient care as well as a technological advance, opening the door to more efficient supervision and treatment of retinal illnesses.

Meta-learning-based sample discrimination framework for improving dynamic selection of classifiers under label noise

Many real-world datasets encounter the issue of label noise (LN), which significantly degrades the learning performances of classification models. While ensemble learning (EL) has been widely employed to tackle this problem, the Dynamic Selection (DS) of classifiers, as a promising EL branch, is particularly sensitive to LN. To address this issue, a meta-learning-based sample discrimination (MSD) framework is proposed in this paper. Initially, this paper analyzes how LN affects the performance of DS methods through a visual example. Subsequently, under the premise that DS methods are only applicable to samples whose neighborhood is minimally affected or unaffected by LN, a meta-learning dataset is generated in the framework, where the meta-features and meta-labels are derived from the characteristics and the real class distribution of local regions of the samples, respectively. With this dataset, a meta-learner is constructed to determine the feasibility of using DS methods directly to classify a given sample in the presence of LN. For samples that DS methods cannot handle, a novel DS process based on the Genetic Algorithm is designed to mitigate the negative impact of LN. The effectiveness of the MSD framework is validated through extensive experiments conducted on thirty real datasets. These experiments demonstrate the capability of the MSD framework to improve the performances of DS methods across different levels of LN. Furthermore, the efficacy of the proposed MSD framework in handling LN is also highlighted by comparing it with a state-of-the-art method and four mainstream EL methods.

Emotion Modeling in Speech Signals: Discrete Wavelet Transform and Machine Learning Tools for Emotion Recognition System

Speech emotion recognition (SER) is a challenging task due to the complex and subtle nature of emotions. This study proposes a novel approach for emotion modeling using speech signals by combining discrete wavelet transform (DWT) with linear prediction coding (LPC). The performance of various classifiers, including support vector machine (SVM), K-Nearest Neighbors (KNN), Efficient Logistic Regression, Naive Bayes, Ensemble, and Neural Network, was evaluated for emotion classification using the EMO-DB dataset. Evaluation metrics such as area under the curve (AUC), average prediction accuracy, and cross-validation techniques were employed. The results indicate that KNN and SVM classifiers exhibited high accuracy in distinguishing sadness from other emotions. Ensemble methods and Neural Networks also demonstrated strong performance in sadness classification. While Efficient Logistic Regression and Naive Bayes classifiers showed competitive performance, they were slightly less accurate compared to other classifiers. Furthermore, the proposed feature extraction method yielded the highest average accuracy, and its combination with formants or wavelet entropy further improved classification accuracy. On the other hand, Efficient Logistic Regression exhibited the lowest accuracies among the classifiers. The uniqueness of this study was that it investigated a combined feature extraction method and integrated them to compare with various forms of combinations. However, the purposes of the investigation include improved performance of the classifiers, high effectiveness of the system, and the potential for emotion classification tasks. These findings can guide the selection of appropriate classifiers and feature extraction methods in future research and real-world applications. Further investigations can focus on refining classifiers and exploring additional feature extraction techniques to enhance emotion classification accuracy.

Lightweight AC Arc Fault Detection Method by Integration of Event-Based Load Classification

As the main cause of electrical fires, arc fault detection attracts lots of attention in recent years. However, with the growing complexity of electric loads, arc fault detection becomes more difficult. This paper proposes a lightweight arc fault detection method that integrates load classification into fault detection. Firstly, according to the turn-on patterns, we divide loads into resistive, inductive and switchable loads. Load classification is developed using an event-based method. Then, arc detection method is developed for each load category, which is achieved through sequential forward floating selection. Its performance is validated by the experiment data and comparison with other reported methods. Meanwhile, the selection of classifiers, sampling rate, and sampling periods for arc fault detection are also discussed in detail. The results show that the proposed method not only achieves a high fault detection performance but also keeps a relatively low sampling rate and short sampling period. Thus, it is beneficial for practical arc fault interrupter development.