Multi-class Classification Method Research Articles

Screening of BindingDB database ligands against EGFR, HER2, Estrogen, Progesterone and NF-[formula omitted]B receptors based on machine learning and molecular docking

Breast cancer, the second most prevalent cancer among women worldwide, necessitates the exploration of novel therapeutic approaches. To target the four subgroups of breast cancer “hormone receptor-positive and HER2-negative, hormone receptor-positive and HER2-positive, hormone receptor-negative and HER2-positive, and hormone receptor-negative and HER2-negative” it is crucial to inhibit specific targets such as EGFR, HER2, ER, NF-κB, and PR.In this study, we evaluated various methods for binary and multiclass classification. Among them, the GA-SVM-SVM:GA-SVM-SVM model was selected with an accuracy of 0.74, an F1-score of 0.73, and an AUC of 0.92 for virtual screening of ligands from the BindingDB database. This model successfully identified 4454, 803, 438, and 378 ligands with over 90% precision in both active/inactive and target prediction for the classes of EGFR+HER2, ER, NF-κB, and PR, respectively, from the BindingDB database. Based on to the selected ligands, we created a dendrogram that categorizes different ligands based on their targets. This dendrogram aims to facilitate the exploration of chemical space for various therapeutic targets.Ligands that surpassed a 90% threshold in the product of activity probability and correct target selection probability were chosen for further investigation using molecular docking. The binding energy range for these ligands against their respective targets was calculated to be between −15 and −5 kcal/mol. Finally, based on general and common rules in medicinal chemistry, we selected 2, 3, 3, and 8 new ligands with high priority for further studies in the EGFR+HER2, ER, NF-κB, and PR classes, respectively.

Predicting Students' Academic Performances Using Machine Learning Algorithms in Educational Data Mining

In every culture and era, education is considered the most fundamental reality and rule that societies prioritize and deem essential. Throughout the process spanning thousands of years, from the emergence of writing to the present day, education has undergone various forms and formats of change. Education has been a continuous guide for shaping, influencing, sustaining societies, and maintaining its dynamics throughout these historical processes. The continuous evolution and growth of education systems and formats worldwide, with changes affecting the quality of education, have the potential to influence nations and societies in every field, ultimately leading to the emergence of an informed society, achievable only through quality education. In this study, the aim is to determine the factors affecting students' academic performance and predict students' end-of-term academic grades using machine learning algorithms within the scope of Earned Value Management (EVM). Such studies have great potential to increase efficiency in education, improve student achievement and improve education policies. With the use of machine learning algorithms, these goals can be achieved more quickly and efficiently. Five different machine learning algorithms, namely RF, KA, KNN, SVM, and NB, have been employed in the study. Binary and multiclass classification methods were used in prediction processes, and among these methods, the Random Forest (RF) algorithm achieved the highest success prediction rates of 0.97 and 0.93, respectively, in both classification methods.

A hybrid capsule attention-based convolutional bi-GRU method for multi-class mental task classification based brain-computer Interface

Electroencephalography analysis is critical for brain computer interface research. The primary goal of brain–computer interface is to establish communication between impaired people and others via brain signals. The classification of multi-level mental activities using the brain–computer interface has recently become more difficult, which affects the accuracy of the classification. However, several deep learning-based techniques have attempted to identify mental tasks using multidimensional data. The hybrid capsule attention-based convolutional bidirectional gated recurrent unit model was introduced in this study as a hybrid deep learning technique for multi-class mental task categorization. Initially, the obtained electroencephalography data is pre-processed with a digital low-pass Butterworth filter and a discrete wavelet transform to remove disturbances. The spectrally adaptive common spatial pattern is used to extract characteristics from pre-processed electroencephalography data. The retrieved features were then loaded into the suggested classification model, which was used to extract the features deeply and classify the mental tasks. To improve classification results, the model’s parameters are fine-tuned using a dung beetle optimization approach. Finally, the proposed classifier is assessed for several types of mental task classification using the provided dataset. The simulation results are compared with the existing state-of-the-art techniques in terms of accuracy, precision, recall, etc. The accuracy obtained using the proposed approach is 97.87%, which is higher than that of the other existing methods.

An Efficient and Versatile Variational Method for High-Dimensional Data Classification

High-dimensional data classification is a fundamental task in machine learning and imaging science. In this paper, we propose an efficient and versatile multi-class semi-supervised classification method for classifying high-dimensional data and unstructured point clouds. To begin with, a warm initialization is generated by using a fuzzy classification method such as the standard support vector machine or random labeling. Then an unconstraint convex variational model is proposed to purify and smooth the initialization, followed by a step which is to project the smoothed partition obtained previously to a binary partition. These steps can be repeated, with the latest result as a new initialization, to keep improving the classification quality. We show that the convex model of the smoothing step has a unique solution and can be solved by a specifically designed primal–dual algorithm whose convergence is guaranteed. We test our method and compare it with the state-of-the-art methods on several benchmark data sets. Thorough experimental results demonstrate that our method is superior in both the classification accuracy and computation speed for high-dimensional data and point clouds.

Utilizing Multi-Class Classification Methods for Automated Sleep Disorder Prediction

Even from infancy, a human’s day-life alternates from a period of wakefulness to a period of sleep at night, during the 24-hour cycle. Sleep is a normal process necessary for human physical and mental health. A lack of sleep makes it difficult to control emotions and behaviour, reduces productivity at work, and can even increase stress or depression. In addition, poor sleep affects health; when sleep is insufficient, the chances of developing serious diseases greatly increase. Researchers in sleep medicine have identified an extensive list of sleep disorders, and thus leveraged Artificial Intelligence (AI) to automate their analysis and gain a deeper understanding of sleep patterns and related disorders. In this research, we seek a Machine Learning (ML) solution that will allow for efficient classification of unlabeled instances as being Sleep Apnea, Insomnia or Normal (subjects without a specific sleep disorder) by assessing the performance of two well-established strategies for multi-class classification tasks: the One-Vs-All (OVA) and One-Vs-One (OVO). In the context of the specific strategies, two well-known binary classification models were assumed, Logistic Regression (LR) and Support Vector Machines (SVMs). Both strategies’ validity was verified upon a dataset of diverse information related to the profiles (anthropometric data, sleep metrics, lifestyle and cardiovascular health factors) of potential patients or individuals not exhibiting any specific sleep disorder. Performance evaluation was carried out by comparing the weighted average results in all involved classes that represent these two specific sleep disorders and no-disorder occurrence; accuracy, kappa score, precision, recall, f-measure, and Area Under the ROC curve (AUC) were recorded and compared to identify an effective and robust model and strategy, both class-wise and on average. The experimental evaluation unveiled that after feature selection, 2-degree polynomial SVM under both strategies was the least complex and most efficient, recording an accuracy of 91.44%, a kappa score of 84.97%, precision, recall and f-measure equal to 0.914, and an AUC of 0.927.

Sigmoni: classification of nanopore signal with a compressed pangenome index.

Improvements in nanopore sequencing necessitate efficient classification methods, including pre-filtering and adaptive sampling algorithms that enrich for reads of interest. Signal-based approaches circumvent the computational bottleneck of basecalling. But past methods for signal-based classification do not scale efficiently to large, repetitive references like pangenomes, limiting their utility to partial references or individual genomes. We introduce Sigmoni: a rapid, multiclass classification method based on the r-index that scales to references of hundreds of Gbps. Sigmoni quantizes nanopore signal into a discrete alphabet of picoamp ranges. It performs rapid, approximate matching using matching statistics, classifying reads based on distributions of picoamp matching statistics and co-linearity statistics, all in linear query time without the need for seed-chain-extend. Sigmoni is 10-100× faster than previous methods for adaptive sampling in host depletion experiments with improved accuracy, and can query reads against large microbial or human pangenomes. Sigmoni is the first signal-based tool to scale to a complete human genome and pangenome while remaining fast enough for adaptive sampling applications. Sigmoni is implemented in Python, and is available open-source at https://github.com/vshiv18/sigmoni.

Performance Analysis of Skin Cancer Multi-Class Dataset Classification Method Using KNN and HOG

Detection of skin cancer in its early phase is a challenge even for dermatologists. This study aims to analyze the performance of classification methods on multiclass skin cancer datasets using K-nearest neighbor (KNN) and histogram of oriented gradients (HOG). The dataset is taken publicly under the name Skin Cancer MNIST dataset: HAM10000 dataset totaling 10,015 data. The first experiment used the pixels per cell parameter of 8.8 and cells per block of 2.2 to get an accuracy of 60.58%. The second experiment used the pixels per cell parameter of 8.8 and cells per block of 2.2 to get an accuracy of 60.58%. The last experiment using the pixels per cell parameter of 8.8 and cells per block of 2.2 got the best accuracy of 61.43%.

Multiclass skin lesion classification using deep learning networks optimal information fusion

A serious, all-encompassing, and deadly cancer that affects every part of the body is skin cancer. The most prevalent causes of skin lesions are UV radiation, which can damage human skin, and moles. If skin cancer is discovered early, it may be adequately treated. In order to diagnose skin lesions with less effort, dermatologists are increasingly turning to machine learning (ML) techniques and computer-aided diagnostic (CAD) systems. This paper proposes a computerized method for multiclass lesion classification using a fusion of optimal deep-learning model features. The dataset used in this work, ISIC2018, is imbalanced; therefore, augmentation is performed based on a few mathematical operations. After that, two pre-trained deep learning models (DarkNet-19 and MobileNet-V2) have been fine-tuned and trained on the selected dataset. After training, features are extracted from the average pool layer and optimized using a hybrid firefly optimization technique. The selected features are fused in two ways: (i) original serial approach and (ii) proposed threshold approach. Machine learning classifiers are used to classify the chosen features at the end. Using the ISIC2018 dataset, the experimental procedure produced an accuracy of 89.0%. Whereas, 87.34, 87.57, and 87.45 are sensitivity, precision, and F1 score respectively. At the end, comparison is also conducted with recent techniques, and it shows the proposed method shows improved accuracy along with other performance measures.

Multi-class multi-label classification of social media texts for typhoon damage assessment: a two-stage model fully integrating the outputs of the hidden layers of BERT

ABSTRACT With the development of social media, it has become increasingly important to quickly and accurately identify social media texts related to disasters (e.g. typhoon) to aid in rescue and recovery efforts. Currently, multi-class classification and pre-trained language model Bidirectional Encoder Representations from Transformers (BERT) are widely used for text classification. However, most studies on typhoon damage classification are multi-class single-label, which contradicts to the reality that a social media text may correspond to multiple types of damage. Moreover, the outputs of the hidden layers of BERT are not fully utilized. This paper proposes a two-stage multi-class multi-label classification method for typhoon damage assessment by fully integrating the outputs of the hidden layers of BERT. In the first stage, sentence vectors are adopted to identify typhoon damage-related texts. In the second stage, word matrices are applied for multi-class multi-label classification to further classify the texts into five damage categories (i.e. transportation, public, electricity, forestry, and waterlogging). The two stages are trained end-to-end to identify typhoon damage from social media texts. Experiments on SinaWeibo texts during typhoon landfall in Chinese coastal regions demonstrate that the proposed method can effectively improve the accuracy of text classification and comprehensively assess typhoon damage.

Partial label learning for automated classification of single-cell transcriptomic profiles.

Single-cell RNA sequencing (scRNASeq) data plays a major role in advancing our understanding of developmental biology. An important current question is how to classify transcriptomic profiles obtained from scRNASeq experiments into the various cell types and identify the lineage relationship for individual cells. Because of the fast accumulation of datasets and the high dimensionality of the data, it has become challenging to explore and annotate single-cell transcriptomic profiles by hand. To overcome this challenge, automated classification methods are needed. Classical approaches rely on supervised training datasets. However, due to the difficulty of obtaining data annotated at single-cell resolution, we propose instead to take advantage of partial annotations. The partial label learning framework assumes that we can obtain a set of candidate labels containing the correct one for each data point, a simpler setting than requiring a fully supervised training dataset. We study and extend when needed state-of-the-art multi-class classification methods, such as SVM, kNN, prototype-based, logistic regression and ensemble methods, to the partial label learning framework. Moreover, we study the effect of incorporating the structure of the label set into the methods. We focus particularly on the hierarchical structure of the labels, as commonly observed in developmental processes. We show, on simulated and real datasets, that these extensions enable to learn from partially labeled data, and perform predictions with high accuracy, particularly with a nonlinear prototype-based method. We demonstrate that the performances of our methods trained with partially annotated data reach the same performance as fully supervised data. Finally, we study the level of uncertainty present in the partially annotated data, and derive some prescriptive results on the effect of this uncertainty on the accuracy of the partial label learning methods. Overall our findings show how hierarchical and non-hierarchical partial label learning strategies can help solve the problem of automated classification of single-cell transcriptomic profiles, interestingly these methods rely on a much less stringent type of annotated datasets compared to fully supervised learning methods.

Non-invasive glucose prediction and classification using NIR technology with machine learning

In this paper, a dual wavelength short near-infrared system is described for the detection of glucose levels. The system aims to improve the accuracy of blood glucose detection in a cost-effective and non-invasive way. The accuracy of the method is evaluated using real-time samples collected with the reference finger prick glucose device. A feed forward neural network (FFNN) regression method is employed to predict glucose levels based on the input data obtained from NIR technology. The system calculates glucose evaluation metrics and performs Surveillance error grid (SEG) analysis. The coefficient of determination R2 and mean absolute error are observed 0.99 and 2.49 mg/dl, respectively. Additionally, the system determines the root mean square error (RMSE) as 3.02 mg/dl. It also shows that the mean absolute percentage error (MAPE) is 1.94% and mean squared error (MSE) is 9.16 (mg/dl)2 for FFNN. The SEG analysis shows that the glucose values measured by the system fall within the clinically acceptable range when compared to the reference method. Finally, the system uses the multi-class classification method of the multilayer perceptron (MLP) and K-nearest neighbors (KNN) classifier to classify glucose levels with an accuracy of 99%.

A hybrid machine learning with process analytics for predicting customer experience in online insurance services industry

It is essential to innovate and improve service levels by predicting possible process outcomes due to the growth of online service providers. This study estimates the customer satisfaction level based on customer experience analysis. In doing so, we answer recent calls for research about a more thorough exploration of customer behavior using predictive process monitoring techniques. In particular, a hybrid framework of supervised/unsupervised machine learning methods is proposed to predict the outcomes of customers’ experiences while dealing with the problem of high intra-class variance. This problem occurs due to the large dispersion of traces identified in the customer journeys. In this regard, customer journeys are first matched with the event log format aiming to implement a Density-Based Spatial Clustering of Applications with Noise (DBSCAN) clustering technique based on the similarity between the customer journeys. After summarizing the journeys by removing low-value activities, the multi-class decision tree classification method is applied, and the level of customer satisfaction is predicted. Due to the imbalanced nature of the data, the oversampling for imbalanced classification is applied to achieve good results in accuracy indicators such as recall, precision, and F1-score. Finally, the proposed approach has been evaluated on a real-life event log, BPI Challenge 2016, to investigate unsatisfied customers. The results of the machine learning models on the test data show a high degree of accuracy in predicting customer dissatisfaction.

Machine Learning Based Open Switch Fault Detection and Localization of Inverters

The location and detection of switch faults is a crucial step in improving the dependability of inverters, which is a requirement for critical applications. This paper focuses on a machine learning-based approach for the open-switch fault detection system for cascaded H-bridge (CHB) multilevel inverters (MLI) used in high- and medium-power applications. Each switch failure is taken into account in this analysis, and the problem is used to model logically different machine learning algorithms, namely Gaussian Naive Bayes (GNB), support vector machines (SVM) and multinomial logistic regression (MLR) models for fault identification and localization based on multi-class classification (MCC) methods. This work includes the simulation and hardware-based data collection from five-level CHB-MLI and correlation-based selection of prominent features in the final dataset. The results of three MCC models for all possible combinations of predictors (features) prove that the mean voltage of bridges is the dominant feature for fault detection in the CHB inverter. Other major findings are machine learning-assisted fault identification and diagnosis is undoubtedly accurate and significantly more promising in condition monitoring and fault diagnosis in CHB-MLIs. The results reveal 100% accuracy in fault diagnosis. Therefore, the presented work confirms switch fault detection in CHB-MLI with mean value as dominant fault feature along with machine learning techniques simple, robust and accurate fault detection.

Transforming two-dimensional tensor networks into quantum circuits for supervised learning

There have been numerous quantum neural networks reported, but they struggle to match traditional neural networks in accuracy. Given the huge improvement of the neural network models’ accuracy by two-dimensional tensor network (TN) states in classical tensor network machine learning (TNML), it is promising to explore whether its application in quantum machine learning can extend the performance boundary of the models. Here, we transform two-dimensional TNs into quantum circuits for supervised learning. Specifically, we encode two-dimensional TNs into quantum circuits through rigorous mathematical proofs for constructing model ansätze, including string-bond states, entangled-plaquette states and isometric TN states. In addition, we propose adaptive data encoding methods and combine with TNs. We construct a tensor-network-inspired quantum circuit (TNQC) supervised learning framework for transferring TNML from classical to quantum, and build several novel two-dimensional TN-inspired quantum classifiers based on this framework. Finally, we propose a parallel quantum machine learning method for multi-class classification to construct 2D TNQC-based multi-class classifiers. Classical simulation results on the MNIST benchmark dataset show that our proposed models achieve the state-of-the-art accuracy performance, significantly outperforming other quantum classifiers on both binary and multi-class classification tasks, and beat simple convolutional classifiers on a fair track with identical inputs. The noise resilience of the models makes them successfully run and work in a real quantum computer.

Discriminative Regression With Adaptive Graph Diffusion.

In this article, we propose a new linear regression (LR)-based multiclass classification method, called discriminative regression with adaptive graph diffusion (DRAGD). Different from existing graph embedding-based LR methods, DRAGD introduces a new graph learning and embedding term, which explores the high-order structure information between four tuples, rather than conventional sample pairs to learn an intrinsic graph. Moreover, DRAGD provides a new way to simultaneously capture the local geometric structure and representation structure of data in one term. To enhance the discriminability of the transformation matrix, a retargeted learning approach is introduced. As a result of combining the above-mentioned techniques, DRAGD can flexibly explore more unsupervised information underlying the data and the label information to obtain the most discriminative transformation matrix for multiclass classification tasks. Experimental results on six well-known real-world databases and a synthetic database demonstrate that DRAGD is superior to the state-of-the-art LR methods.

Multiclass Classification With Fuzzy-Feature Observations: Theory and Algorithms.

The theoretical analysis of multiclass classification has proved that the existing multiclass classification methods can train a classifier with high classification accuracy on the test set, when the instances are precise in the training and test sets with same distribution and enough instances can be collected in the training set. However, one limitation with multiclass classification has not been solved: how to improve the classification accuracy of multiclass classification problems when only imprecise observations are available. Hence, in this article, we propose a novel framework to address a new realistic problem called multiclass classification with imprecise observations (MCIMO), where we need to train a classifier with fuzzy-feature observations. First, we give the theoretical analysis of the MCIMO problem based on fuzzy Rademacher complexity. Then, two practical algorithms based on support vector machine and neural networks are constructed to solve the proposed new problem. The experiments on both synthetic and real-world datasets verify the rationality of our theoretical analysis and the efficacy of the proposed algorithms.

A Novel and Effective Multi-Class Classification Method for Imbalanced Medical Transcriptions

Natural Language Processing (NLP) techniques are used to glean information from Electronic Health Records (EHR) for identifying patients with unique clinical characteristics and defining phenotypes. The classification of imbalanced datasets is also one of the vital concerns in medical diagnosis. We built an improved framework for automating the multi-class classification of imbalanced medical transcriptions [1] into 40 medical specialties, by creating a set of important phenotypes/features. We implemented and tested five machine learning models out of which Random Forest Classifier has achieved the highest performance of 0.99 F1 score (precision 0.99, recall 0.99) and roc-auc-score of 0.99 on test data.

Noise signature identification using mobile phones for indoor localization

Indoor localization is still nowadays a challenge with room to improve. Even though there are many different approaches that have evidenced as effective, most of them require specific hardware or infrastructure deployed along the building that can be discarded in many potential scenarios. Others that do not require such on-site infrastructure, like inertial navigation-based systems, entail certain accuracy problems due to the accumulation of errors. However, this error-accumulation can be mitigated using beacons that support the recalibration of the system. The more frequently beacons are detected, the smaller will be the accumulated error. In this work, we evaluate the use of the noise signature of the rooms of a building to pinpoint the current location of a low-cost Android device. Despite this strategy is not a complete indoor localization system (two rooms could share the same signature), it allows us to generate beacons automatically. The noise recorded by the device is preprocessed performing audio filtering, audio frame segmentation, and feature extraction. We evaluated binary (determining if the ambient sound recording belonged to a specific room) and multi-class (identifying which room an ambient noise recording belonged to by comparing it amongst the remaining 18 rooms from the original 19 rooms sampled) classification methods. Our results indicate that the two Stacking techniques and K-Nearest Neighbor (KNN) machine learning classifier are the most successful methods in binary classification with an average accuracy of 99.19%, 99,08%, and 99.04%. In multi-class classification the average accuracy for KNN is 90.77%, and 90.52% and 90.15% for both Voting techniques.

A GAN-Based Data Augmentation Method for Imbalanced Multi-Class Skin Lesion Classification

A GAN-Based Data Augmentation Method for Imbalanced Multi-Class Skin Lesion Classification

Enhanced Image-Based Malware Multiclass Classification Method with the Ensemble Model and SVM

Enhanced Image-Based Malware Multiclass Classification Method with the Ensemble Model and SVM