Binary Classification Approach Research Articles

Performance Metrics for Multilabel Emotion Classification: Comparing Micro, Macro, and Weighted F1-Scores

This study compares various F1-score variants—micro, macro, and weighted—to assess their performance in evaluating text-based emotion classification. Lexicon distillation is employed using the multilabel emotion-annotated datasets XED and GoEmotions. The aim of this paper is to understand when each F1-score variant is better suited for evaluating text-based multilabel emotion classification. Unigram lexicons were derived from the annotated GoEmotions and XED datasets through a binary classification approach. The distilled lexicons were then applied to the GoEmotions and XED annotated datasets to calculate their emotional content, and the results were compared. The findings highlight the behavior of each F1-score variant under different class distributions, emphasizing the importance of appropriate metric selection for reliable model performance evaluation in imbalanced multilabel datasets. Additionally, this study also investigates the effect of the aggregation of negative emotions into broader categories on said F1 metrics. The contribution of this study is to provide insights into how different F1-score variants could improve the reliability of multilabel emotion classifier evaluation, particularly in the context of class imbalance present in the case of phishing emails.

Accessible Trail Tourism: Trail Accessibility and Difficulty Rating Approach Designed for Individuals, Including With Mobility Impairments

ABSTRACTThis study introduces a novel approach to trail accessibility and difficulty rating tailored specifically for individuals, including those with mobility impairments, aiming to promote accessible trail tourism. Grounded in theoretical frameworks of inclusive outdoor recreation, equality, and complex adaptive systems, the proposed rating system incorporates criteria addressing physical access, terrain challenges, and amenities to accommodate diverse user needs. This study employed a sensor technology, called wheeled instrumentation sensor package (WISP) within the framework of the high‐efficiency trail assessment process (HETAP) to develop a new quantitatively based trail classification scheme. A case study trail and two hypothetical synthetic data trails were used to demonstrate both the trail wheelchair accessibility binary classification approach and the proposed trail difficulty classification approach. This research pioneers trail accessibility and difficulty rating and underscores the importance of integrating accessibility considerations into trail management practices to create truly inclusive outdoor recreational experiences.

Graph neural network-based subgraph analysis for predicting adverse drug events

PurposeAdverse drug events (ADEs) are a significant global public health concern, and they have resulted in high rates of hospital admissions, morbidity, and mortality. Prior to the use of machine learning and deep learning methods, ADEs may not become well recognized until long after a drug has been approved and is widely used, which poses a significant challenge for ensuring patient safety. Consequently, there is a need to develop computational approaches for earlier identification of ADEs not detected during pre-registration clinical trials. MethodsThis paper presents a state-of-the-art network-based approach that models patients as subgraphs composed of nodes of International Classification of Diseases (ICD) codes and directed edges illustrating disease progression. Four Graph Neural Network (GNN) variants were employed to make sub-graph level predictions that answer three Research Questions (RQ): 1) whether ADE(s) would occur given a patient's prior diagnoses history, 2) when an ADE would occur, and 3) which ADE would occur. The first and second RQs were addressed using a binary classification approach. The third RQ was addressed using a multi-label classification model. ResultsThe proposed network-based approach demonstrated superior performance in predicting ADEs, with the GraphSage model exhibiting the highest accuracy for both RQ 1 (0.8863) and RQ 3 (0.9367), while the Graph Attention Networks (GAT) model was found to perform best for RQ 2 (0.8769). Furthermore, an analysis segmented by ADE classification revealed that while RQs 1 and 3 exhibited minimal variance across different ADE categories, a distinct advantage was observed for categories B, C, and E in the context of RQ 2 when applying this sub-graph method. ConclusionThe network-based approach demonstrates the potential of GNNs in supporting the early detection and prevention of ADEs. Accurately predicting ADEs could enable healthcare professionals to make informed clinical decisions, take preventive measures and adjust medication regimens before serious adverse events occur. The proposed prediction method could also lead to optimized usage of healthcare resources by preventing hospital admissions and reducing the overall burden of adverse drug events on the healthcare systems.

Comparison of Pre-Defined Automatic Machine Learning (AutoML) for MBTI Personality Prediction of Twitter Users using Binary Classification Approach

The Myers-Briggs Type Indicator (MBTI) is a personality test that is globally accepted and used as a method for identifying personality. MBTI uses a four-factor linear model to characterize a person's behaviour patterns. This feature is often used to pursue career opportunities, make decisions, manage leadership, and deal with stress. In particular, MBTI personality prediction has been widely conducted and well performed using Recurrent Neural Network (RNN) based on Twitter data because it indirectly reveals most of a person's personality through their tweets. However, deep understanding is needed in building RNN-based solutions. Hence it will take a lot of time and resources to produce an excellent model architecture and the parameters used. Therefore, this study proposed the Auto Machine Learning (AutoML) method with a pre-defined search space to determine the correct model architecture and hyperparameters based on the results of data analysis. Thus, the search algorithm can exploit environments with suitable configurations in general. There are two pre-defined search spaces employed in this study, i.e. (i) two RNN algorithms, including Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), and (ii) pre-trained Word2Ves as word embedding. In addition, this study compares the model's performance that employs preprocessing and raw data (without preprocessing). The first result shows that the preprocessing increases the F1-Score values for LSTM and GRU by 2.35% and 2.02%, respectively. Subsequently, the LSTM outperformed GRU by the values of F1-Score at 0.35% and accuracy at 0.76%. The implementation of LSTM with pre-processed data in pre-defined AutoML with Word2Vec as a word embedding technique can provide good performance on long and complex data sequences such as Twitter data for predicting its user personality.

Explainable Machine-Learning Models to Predict Weekly Risk of Hyperglycemia, Hypoglycemia, and Glycemic Variability in Patients With Type 1 Diabetes Based on Continuous Glucose Monitoring.

The aim of this study was to develop and validate explainable prediction models based on continuous glucose monitoring (CGM) and baseline data to identify a week-to-week risk of CGM key metrics (hyperglycemia, hypoglycemia, glycemic variability). By having a weekly prediction of CGM key metrics, it is possible for the patient or health care personnel to take immediate preemptive action. We analyzed, trained, and internally tested three prediction models (Logistic regression, XGBoost, and TabNet) using CGM data from 187 type 1 diabetes patients with long-term CGM monitoring. A binary classification approach combined with feature engineering deployed on the CGM signals was used to predict hyperglycemia, hypoglycemia, and glycemic variability based on consensus targets (time above range ≥5%, time below range ≥4%, coefficient of variation ≥36%). The models were validated in two independent cohorts with a total of 223 additional patients of varying ages. A total of 46 593 weeks of CGM data were included in the analysis. For the best model (XGBoost), the area under the receiver operating characteristic curve (ROC-AUC) was 0.9 [95% confidence interval (CI) = 0.89-0.91], 0.89 [95% CI = 0.88-0.9], and 0.8 [95% CI = 0.79-0.81] for predicting hyperglycemia, hypoglycemia, and glycemic variability in the interval validation, respectively. The validation test showed good generalizability of the models with ROC-AUC of 0.88 to 0.95, 0.84 to 0.89, and 0.80 to 0.82 for predicting the glycemic outcomes. Prediction models based on real-world CGM data can be used to predict the risk of unstable glycemic control in the forthcoming week. The models showed good performance in both internal and external validation cohorts.

FL-DSFA: Securing RPL-Based IoT Networks against Selective Forwarding Attacks Using Federated Learning.

The Internet of Things (IoT) is a significant technological advancement that allows for seamless device integration and data flow. The development of the IoT has led to the emergence of several solutions in various sectors. However, rapid popularization also has its challenges, and one of the most serious challenges is the security of the IoT. Security is a major concern, particularly routing attacks in the core network, which may cause severe damage due to information loss. Routing Protocol for Low-Power and Lossy Networks (RPL), a routing protocol used for IoT devices, is faced with selective forwarding attacks. In this paper, we present a federated learning-based detection technique for detecting selective forwarding attacks, termed FL-DSFA. A lightweight model involving the IoT Routing Attack Dataset (IRAD), which comprises Hello Flood (HF), Decreased Rank (DR), and Version Number (VN), is used in this technique to increase the detection efficiency. The attacks on IoT threaten the security of the IoT system since they mainly focus on essential elements of RPL. The components include control messages, routing topologies, repair procedures, and resources within sensor networks. Binary classification approaches have been used to assess the training efficiency of the proposed model. The training step includes the implementation of machine learning algorithms, including logistic regression (LR), K-nearest neighbors (KNN), support vector machine (SVM), and naive Bayes (NB). The comparative analysis illustrates that this study, with SVM and KNN classifiers, exhibits the highest accuracy during training and achieves the most efficient runtime performance. The proposed system demonstrates exceptional performance, achieving a prediction precision of 97.50%, an accuracy of 95%, a recall rate of 98.33%, and an F1 score of 97.01%. It outperforms the current leading research in this field, with its classification results, scalability, and enhanced privacy.

Optimized differential evolution and hybrid deep learning for superior drug-target binding affinity prediction

Investigating Drug-Target Interactions (DTI) is crucial for drug repositioning and discovery tasks. However, discovering DTIs through experimental approaches is time-consuming and requires substantial financial resources. To address these challenges, machine learning-based methodologies have been adopted to reduce costs and save time. Unfortunately, the effectiveness of these methods has been limited due to the binary classification approach and the lack of empirically validated negative samples. The availability of abundant DTI datasets and protein structure data has enabled the development of new approaches, such as redefining the DTI problem as a regression task. Given this context, we propose an innovative deep-learning approach to predict binding affinities between drugs and targets. Our model, named the Convolution Self-Attention Network with Attention-based Bidirectional Long Short-Term Memory Network (CSAN-BiLSTM-Att), integrates convolutional neural network (CNN) blocks with self-attention mechanisms to create an attention-based bidirectional long short-term memory (BiLSTM) model, followed by fully connected layers. Due to the model's complexity, proper hyperparameter tuning is essential. To optimize this, we employ the Differential Evolution (DE) technique to select the most suitable hyperparameters. Experimental results demonstrate that the DE-based CSAN-BiLSTM-Att model outperforms previous approaches. Specifically, the model achieved a concordance index of 0.898 and a mean square error of 0.228 on the DAVIS dataset, and a concordance value of 0.971 with a mean square error of 0.014 on the KIBA dataset.

Question Similarity Detection in Indonesian Language Consumer Health Forums with Feature-based Binary Classification Approach

Question Similarity Detection in Indonesian Language Consumer Health Forums with Feature-based Binary Classification Approach

Two-step hierarchical binary classification of cancerous skin lesions using transfer learning and the random forest algorithm

Skin lesion classification plays a crucial role in the early detection and diagnosis of various skin conditions. Recent advances in computer-aided diagnostic techniques have been instrumental in timely intervention, thereby improving patient outcomes, particularly in rural communities lacking specialized expertise. Despite the widespread adoption of convolutional neural networks (CNNs) in skin disease detection, their effectiveness has been hindered by the limited size and data imbalance of publicly accessible skin lesion datasets. In this context, a two-step hierarchical binary classification approach is proposed utilizing hybrid machine and deep learning (DL) techniques. Experiments conducted on the International Skin Imaging Collaboration (ISIC 2017) dataset demonstrate the effectiveness of the hierarchical approach in handling large class imbalances. Specifically, employing DenseNet121 (DNET) as a feature extractor and random forest (RF) as a classifier yielded the most promising results, achieving a balanced multiclass accuracy (BMA) of 91.07% compared to the pure deep-learning model (end-to-end DNET) with a BMA of 88.66%. The RF ensemble exhibited significantly greater efficiency than other machine-learning classifiers in aiding DL to address the challenge of learning with limited data. Furthermore, the implemented predictive hybrid hierarchical model demonstrated enhanced performance while significantly reducing computational time, indicating its potential efficiency in real-world applications for the classification of skin lesions.

PredCoffee: A binary classification approach specifically for coffee odor

Compared to traditional methods, using machine learning to assess or predict the odor of molecules can save costs in various aspects. Our research aims to collect molecules with coffee odor and summarize the regularity of these molecules, ultimately creating a binary classifier that can determine whether a molecule has a coffee odor. In this study, a total of 371 coffee-odor molecules and 9,700 non-coffee-odor molecules were collected. The Knowledge-guided Pre-training of Graph Transformer (KPGT), support vector machine (SVM), random forest (RF), multi-layer perceptron (MLP), and message-passing neural networks (MPNN) were used to train the data. The model with the best performance was selected as the basis of the predictor. The prediction accuracy value of the KPGT model exceeded 0.84 and the predictor has been deployed as a webserver PredCoffee.

A Hybrid Approach for Binary Classification of Imbalanced Data

Binary classification with an imbalanced dataset is challenging. Models tend to consider all samples as belonging to the majority class. Although existing solutions such as sampling methods, cost-sensitive methods, and ensemble learning methods improve the poor accuracy of the minority class, these methods are limited by overfitting or cost parameters that are difficult to decide. This paper proposes a hybrid approach with dimension reduction that consists of data block construction, dimensionality reduction, and ensemble learning with deep neural network classifiers. The performance is evaluated on eight imbalanced public datasets in terms of recall, G-mean, AUC, F-measure, and balanced accuracy. The results show that the proposed model outperforms state-of-the-art methods.

Preserving multi-dimensional information: A hypersphere method for parameter space analysis

BackgroundPhysiological modelling often involves models described by large numbers of variables and significant volumes of clinical data. Mathematical interpretation of such models frequently necessitates analysing data points in high-dimensional spaces. Existing algorithms for analysing high-dimensional points either lose important dimensionality or do not describe the full position of points. Hence, there is a need for an algorithm which preserves this information. MethodsThe most-distant uncovered point (MDUP) hypersphere method is a binary classification approach which defines a collection of equidistant N-dimensional points as the union of hyperspheres. The method iteratively generates hyperspheres at the most distant point in the interest region not yet contained within any hypersphere, until the entire region of interest is defined by the union of all generated hyperspheres. This method is tested on a 7-dimensional space with up to 35.8 million points representing feasible and infeasible spaces of model parameters for a clinically validated cardiovascular system model. ResultsFor different numbers of input points, the MDUP hypersphere method tends to generate large spheres away from the boundary of feasible and infeasible points, but generates the greatest number of relatively much smaller spheres around the boundary of the region of interest to fill this space. Runtime scales quadratically, in part because the current MDUP implementation is not parallelised. ConclusionsThe MDUP hypersphere method can define points in a space of any dimension using only a collection of centre points and associated radii, making the results easily interpretable. It can identify large continuous regions, and in many cases capture the general structure of a region in only a relative few hyperspheres. The MDUP method also shows promise for initialising optimisation algorithm starting conditions within pre-defined feasible regions of model parameter spaces, which could improve model identifiability and the quality of optimisation results.

Intelligent parking space management: a binary classification approach for detecting vacant spots

Intelligent parking space management: a binary classification approach for detecting vacant spots

Mlp4green: A Binary Classification Approach Specifically for Green Odor.

Fresh green leaves give off a smell known as "green odor." It has antibacterial qualities and can be used to attract or repel insects. However, a common method for evaluating green odor molecules has never existed. Machine learning techniques are widely used in research to forecast molecular attributes for binary classification. In this work, the green odor molecules were first trained and learned using machine learning methods, and then clustering analysis and molecular docking were performed to further explore their molecular characteristics and mechanisms of action. For comparison, four algorithmic models were employed, MLP performed the best in all metrics, including Accuracy, Precision, Average Precision, Matthews coefficient, and Area under curve. We determined by difference analysis that, in comparison to non-green odor molecules, green odor molecules have a lower molecular mass and fewer electrons. Based on the MLP algorithm, we constructed a binary classification prediction website for green odors. The first application of deep learning techniques to the study of green odor molecules can be seen as a signal of a new era in which green odor research has advanced into intelligence and standardization.

New Recruitment Approach Based on Logistic Regression Model

Artificial intelligence (AI) is a pivotal technological advancement developed by humans with the aim of enhancing the quality of human existence. It signifies the capacity of a computerized machine resembling a robot to execute tasks typically performed by humans and replicate human behavior. Machine learning (ML), a subfield of AI, involves the construction of systems that acquire the ability to make predictions about new output values by leveraging existing data, without the need for human interaction. Currently, ML has been incorporated into various fields, including but not limited to medical diagnosis, image processing, prediction, classification, learning association, commerce, finance, and natural language processing. This project aims to employ ML techniques within the human resource (HR) department. The implemented model will enable the human resources department to effectively identify the most appropriate candidates for a job opening throughout the recruitment process, utilizing a comprehensive dataset and considering many criteria, all without the need for manual intervention. The construction of the model involves the utilization of an authentic dataset comprising recruitment tasks. Initially, the dataset undergoes a process of selecting the most pertinent elements from both pre-existing and extracted factors. These selected factors include educational level, age, and past experience. Furthermore, taking into consideration these aforementioned factors, a decision system is constructed utilizing the Binary classification approach. The logistic regression classifier is utilized in this investigation. Subsequently, the dataset is partitioned into two distinct subsets, namely the training subset and the testing subset. The effectiveness of the model is demonstrated by the utilization of various evaluation metrics, including the confusion matrix, recall, precision, accuracy, and F-measure values.

Convolutional neural network-based real-time mosquito genus identification using wingbeat frequency: A binary and multiclass classification approach

Global rises in dengue hemorrhagic fever, especially in Asia and Latin America, underscore the necessity for enhanced public health interventions. Aedes spp. mosquitoes are the primary vectors; however, species such as Culex quinquefasciatus pose significant health risks by transmitting diseases such as filariasis, impacting millions of people worldwide. This study introduces a real-time convolutional neural network-based mosquito classification system using wingbeat frequency for identifying various mosquito species, with emphasis on Aedes sp. We proposed and assessed two models: a binary classification and a multiclass system. The binary system exhibited an outstanding accuracy of 91.76% in distinguishing between Aedes aegypti and Culex quinquefasciatus. The multiclass system accurately identified female and male Aedes aegypti and Culex quinquefasciatus with a precision of 87.16%. This innovative approach serves as a potential tool for dengue infection control and a versatile instrument for combating various mosquito-borne illnesses, enhancing vector surveillance for comprehensive disease management.

Development and Validation of a Machine Learning Model to Predict Weekly Risk of Hypoglycemia in Patients with Type 1 Diabetes Based on Continuous Glucose Monitoring.

Aim: The aim of this study was to develop and validate a prediction model based on continuous glucose monitoring (CGM) data to identify a week-to-week risk profile of excessive hypoglycemia. Methods: We analyzed, trained, and internally tested two prediction models using CGM data from 205 type 1 diabetes patients with long-term CGM monitoring. A binary classification approach (XGBoost) combined with feature engineering deployed on the CGM signals was utilized to predict excessive hypoglycemia risk defined by two targets (time below range [TBR] >4% and the upper TBR 90th percentile limit) of TBR the following week. The models were validated in two independent cohorts with a total of 253 additional patients. Results: A total of 61,470 weeks of CGM data were included in the analysis. The XGBoost models had an area under the receiver operating characteristic curve (ROC-AUC) of 0.83-0.87 (95% confidence interval; 0.83-0.88) in the test dataset. The external validation showed ROC-AUCs of 0.81-0.90. The most discriminative features included the low blood glucose index, the glycemic risk assessment diabetes equation (GRADE), hypoglycemia, the TBR, waveform length, the coefficient of variation and mean glucose during the previous week. This highlights that the pattern of hypoglycemia combined with glucose variability during the past week contains information on the risk of future hypoglycemia. Conclusion: Prediction models based on real-world CGM data can be used to predict the risk of hypoglycemia in the forthcoming week. The models showed good performance in both the internal and external validation cohorts.

An automated approach for binary classification on imbalanced data

Imbalanced data are present in various business sectors and must be handled with the proper resampling methods and classification algorithms. To handle imbalanced data, there are numerous resampling and learning method combinations; nonetheless, their effective use necessitates specialised knowledge. In this paper, several approaches, ranging from more accessible to more advanced in the domain of data resampling techniques, will be considered to handle imbalanced data. The application developed delivers recommendations of the most suitable combinations of techniques for a specific dataset by extracting and comparing dataset meta-feature values recorded in a knowledge base. It facilitates effortless classification and automates part of the machine learning pipeline with comparable or better results than state-of-the-art solutions and with a much smaller execution time.

Deep learning prediction of esophageal squamous cell carcinoma invasion depth from arterial phase enhanced CT images: a binary classification approach

BackgroundPrecise prediction of esophageal squamous cell carcinoma (ESCC) invasion depth is crucial not only for optimizing treatment plans but also for reducing the need for invasive procedures, consequently lowering complications and costs. Despite this, current techniques, which can be invasive and costly, struggle with achieving the necessary precision, highlighting a pressing need for more effective, non-invasive alternatives.MethodWe developed ResoLSTM-Depth, a deep learning model to distinguish ESCC stages T1-T2 from T3-T4. It integrates ResNet-18 and Long Short-Term Memory (LSTM) networks, leveraging their strengths in spatial and sequential data processing. This method uses arterial phase CT scans from ESCC patients. The dataset was meticulously segmented by an experienced radiologist for effective training and validation.ResultsUpon performing five-fold cross-validation, the ResoLSTM-Depth model exhibited commendable performance with an accuracy of 0.857, an AUC of 0.901, a sensitivity of 0.884, and a specificity of 0.828. These results were superior to the ResNet-18 model alone, where the average accuracy is 0.824 and the AUC is 0.879. Attention maps further highlighted influential features for depth prediction, enhancing model interpretability.ConclusionResoLSTM-Depth is a promising tool for ESCC invasion depth prediction. It offers potential for improvement in the staging and therapeutic planning of ESCC.

A New Method for Diagnosis of Leukemia Utilizing a Hybrid DL-ML Approach for Binary and Multi-Class Classification on a Limited-Sized Database

A New Method for Diagnosis of Leukemia Utilizing a Hybrid DL-ML Approach for Binary and Multi-Class Classification on a Limited-Sized Database