Performance Of Classification Models Research Articles

Optimizing Diabetic Neuropathy Severity Classification Using Electromyography Signals Through Synthetic Oversampling Techniques

Electromyography signals are electrical signals generated by muscle activity and are very useful for analyzing the health conditions of muscles and nerves. Data imbalance is a prevalent issue in EMG signal data, especially when addressing patients with varied health conditions and restricted data availability. A major difficulty for machine learning models is class imbalance in datasets, which frequently leads to biased predictions favoring the dominant class and neglecting the minority classes. The data augmentation method employs the Synthetic Minority Over Sampling Technique (SMOTE) and Random Over Sampling (ROS) to address data imbalances and enhance the performance of classification models for underrepresented classes. This study employs an oversampling technique to enhance the efficacy of the XG Boost model. SMOTE exhibits better efficacy relative to competing methods; the application of appropriate oversampling techniques allows models to integrate patterns from both majority and often neglected minority data.

Feature selection integrating Shapley values and mutual information in reinforcement learning: An application in the prediction of post-operative outcomes in patients with end-stage renal disease

Background:In predicting post-operative outcomes for patients with end-stage renal disease, our study faced challenges related to class imbalance and a high-dimensional feature space. Therefore, with a focus on overcoming class imbalance and improving interpretability, we propose a novel feature selection approach using multi-agent reinforcement learning. Methods:We proposed a multi-agent feature selection model based on a comprehensive reward function that combines classification model performance, Shapley additive explanations values, and the mutual information. The definition of rewards in reinforcement learning is crucial for model convergence and performance improvement. Initially, we set a deterministic reward based on the mutual information between variables and the target class, selecting variables that are highly dependent on the class, thus accelerating convergence. We then prioritised variables that influence the minority class on a sample basis and introduced a dynamic reward distribution strategy using shapley additive explanations values to improve interpretability and solve the class imbalance problem. Results:Involving the integration of electronic medical records, anesthesia records, operating room vital signs, and pre-operative anesthesia evaluations, our approach effectively mitigated class imbalance and demonstrated superior performance in ablation analysis. Our model achieved a 16% increase in the minority class F1 score and an 8.2% increase in the overall F1 score compared to the baseline model without feature selection. Conclusion:This study contributes important research findings that show that the multi-agent-based feature selection method can be a promising approach for solving the class imbalance problem.

Research on the Application of Improved BERT‐DPCNN Model in Chinese News Text Classification

ABSTRACTThis paper introduces an enhanced BERT‐DPCNN model for the task of Chinese news text classification. The model addresses the common challenge of balancing accuracy and computational efficiency in existing models, especially when dealing with large‐scale, high‐dimensional text data. To tackle this issue, the paper proposes an improved BERT‐DPCNN model that integrates BERT's pre‐trained language model with DPCNN's efficient convolutional structure to capture deep semantic information and key features from the text. Additionally, the paper incorporates the zebra optimization algorithm (ZOA) to dynamically optimize the model's hyperparameters, overcoming the limitations of manual tuning in traditional models. By automatically optimizing hyperparameters such as batch size, learning rate, and the number of filters through ZOA, the model's classification performance is significantly enhanced. Experimental results demonstrate that the improved ZOA‐BERT‐DPCNN model outperforms traditional methods on the THUCNEWS Chinese news dataset, not only verifying its effectiveness in news text classification tasks but also showcasing its potential to enhance classification performance.

Hate Comment Detection On Twitter Using Long Short Term Memory (LSTM) With Genetic Algorithm (GA)

In the era of social media like today, one social media that is currently quite popular is Twitter. This study explores the use of the Long Short Term Memory (LSTM) method optimized with the Genetic Algorithm (GA) to detect hate speech in Twitter data in Indonesia. We use TF-IDF and GloVe feature extraction techniques to produce effective word vector representations in natural language processing. This study also introduces feature expansion and similarity corpus construction to improve the performance of the LSTM classification model. Evaluation is carried out through a confusion matrix to measure accuracy, precision, recall, and F1 score. The results show that the LSTM model with TF-IDF and GloVe feature extraction achieves the best performance with an accuracy of up to 92.91%. We also found that the combination of Unigram + Bigram + Trigram, max feature 10000, and Glove corpus with Top 20 similarity gave optimal results. In addition, parameter optimization using genetic algorithms has been shown to improve accuracy and F1-Score. The resulting LSTM model is able to classify test data with high accuracy, which has the potential to help in the detection and handling of hate speech on social media, as well as improving the model's ability to identify and understand text content in the Indonesian language context.

Aprimoramento do diagnóstico automatizado de eletrocardiograma (ECG) por meio de pré-treinamento multimodal com laudos em texto

Objective: Heart diseases are the leading cause of death worldwide, and the electrocardiogram (ECG) is the primary diagnostic tool for assessing cardiac activity. Automated and remote ECG diagnosis can help the healthcare system with timely and high-quality cardiac assessments, especially for peripheral regions and rural areas. Automatic ECG classification has been extensively researched, but it is still challenging to build accurate models for such a wide spectrum of scenarios. Method: This study enhances the performance of ECG deep learning classification models using a multimodal pre-training stage with physician's reports. Results: Our approach improves the state-of-the-art model and achieves a mean F1 score of 0.755 over six categories using the full dataset, which is a relevant improvement for a relatively larger unlabeled corpus. Conclusion: The results demonstrate the potential to improve automated cardiac assessment with text pretraining.

A NOVEL METHOD FOR ENTREPRENEURIAL STUDENT MENTAL HEALTH ASSESSMENT USING EEG SIGNAL ANALYSIS ENHANCED BY GENERATIVE ADVERSARIAL NETWORKS

Objective: This study aims to evaluate the mental health of college students who have failed in entrepreneurship by analyzing their electroencephalogram (EEG) signals. Long-term negative emotions are closely related to mental health problems. This study explores how to evaluate the mental health of college students who have failed in entrepreneurship through EEG signals and the use of generative adversarial networks (GANs) to improve classification accuracy. Methods: We first collected EEG data from college students who have failed in entrepreneurship. These data were used to extract multiple features, including time domain features, frequency domain features, and nonlinear features. To improve the accuracy and robustness of the classification model, we introduced GAN. GAN enhances the diversity of the training data set by generating more samples, thereby improving the performance of the EEG signal classification model. This process includes training the generator to generate samples similar to real data and training the discriminator to distinguish between real and generated data. Through this adversarial process, the classification model is continuously optimized. Experimental results show that the EEG signal analysis method based on GAN can effectively classify the long-term emotional state of college students who have failed in entrepreneurship and accurately identify negative emotions such as depression and anxiety. The additional samples generated by GAN significantly improve the classification model’s ability to identify emotional states, making the assessment of mental health status more accurate. Conclusion: This study successfully improved the accuracy of EEG signal classification by introducing GAN technology, thus providing an effective tool for evaluating the mental health status of college students who failed in entrepreneurship. This method not only enhances the ability to detect negative emotions of college students but also provides a novel and practical solution for mental health assessment and intervention in colleges and universities, which helps to detect and intervene in potential mental health problems of college students who failed in entrepreneurship as early as possible.

Investigating the Surface Damage to Fuzhou’s Ancient Houses (Gu-Cuo) Using a Non-Destructive Testing Method Constructed via Machine Learning

As an important part of traditional Chinese architecture, Fuzhou’s ancient houses have unique cultural and historical value. However, over time, environmental factors such as efflorescence and plant growth have caused surface damage to their gray brick walls, leading to a decline in the quality of the buildings’ structure and even posing a threat to the buildings’ safety. Traditional damage detection methods mainly rely on manual labor, which is inefficient and consumes a lot of human resources. In addition, traditional non-destructive detection methods, such as infrared imaging and laser scanning, often face difficulty in accurately identifying specific types of damage, such as efflorescence and plant growth, on the surface of gray bricks and are easily hampered by diverse surface features. This study uses the YOLOv8 machine learning model for the automated detection of two common types of damage to the gray brick walls of Fuzhou’s ancient houses: efflorescence and plant growth. We establish an efficient gray brick surface damage detection model through dataset collection and annotation, experimental parameter optimization, model evaluation, and analysis. The research results reveal the following. (1) Reasonable hyperparameter settings and model-assisted annotation significantly improve the detection accuracy and stability. (2) The model’s average precision (AP) is improved from 0.30 to 0.90, demonstrating good robustness in detecting complex backgrounds and high-resolution real-life images. The F1 value of the model’s gray brick detection efficiency is improved (classification model performance index) from 0.22 to 0.77. (3) The model’s ability to recognize the damage details of gray bricks under high-resolution conditions is significantly enhanced, demonstrating its ability to cope with complex environments. (4) The simplified data enhancement strategy effectively reduces the feature extraction interference and enhances the model’s adaptability in different environments.

Early prediction of Mycobacterium tuberculosis transmission clusters using supervised learning models

Identifying individuals with tuberculosis (TB) with a high risk of onward transmission can guide disease prevention and public health strategies. Here, we train classification models to predict the first sampled isolates in Mycobacterium tuberculosis transmission clusters from demographic and disease data. We find that supervised learning, in particular balanced random forests, can be used to develop predictive models to identify people with TB that are more likely associated with TB cluster growth, with good model performance and AUCs of ≥ 0.75. We also identified the most important patient and disease characteristics in the best performing classification model, including host demographics, site of infection, TB lineage, and age at diagnosis. This framework can be used to develop predictive tools for the early assessment of potential cluster growth to prioritise individuals for enhanced follow-up with the aim of reducing transmission chains.

Enhancing Image Classification with Super-Resolution Techniques: A Comparative Study of SRResNet and SRGAN

Abstract. This paper explores the use of super-resolution (SR) approaches to enhance the performance of image classification, with particular attention to the effects of various SR models on classification accuracy. Using the ImageNet Dogs dataset for assessment, the paper examines two SR techniques: Super Resolution Generative Adversarial Networks (SRGAN) and Super Resolution Residual Networks (SRResNet). The research demonstrates that deep learning-based SR methods can enhance classification accuracy. Notably, SRResNet is identified as the superior method for improving classification performance, despite generating less visually appealing images compared to SRGAN. These finding highlights that while Generative Adversarial Networks (GANs) and perceptual loss functions can enhance image quality, their impact on classification accuracy may not always be substantial. The study offers important new perspectives on the relative merits of different SR approaches, highlighting the necessity of choosing the right SR methods in accordance with the particular demands of picture classification tasks. The results suggest that SRResNet, with its focus on accuracy over visual appeal, is more effective for boosting classification model performance, offering guidance for optimizing SR methods in practical image classification applications.

Analysis of K-NN with the Integration of Bag of Words, TF-IDF, and N-Grams for Hate Speech Classification on Twitter

Social media has emerged as one of the primary communication channels in the modern world, but it has simultaneously become a platform where hate speech can spread easily. This study attempts to evaluate the performance of a hate speech classification model using the K-Nearest Neighbors (K-NN) algorithm along with various feature extraction techniques, specifically Bag of Words (BoW), Term Frequency-Inverse Document Frequency (TF-IDF), and N-Grams. The dataset used in this study consists of 13169 entries, which represent a diverse range of hate speech examples commonly encountered on social media platforms. In this experimental investigation, we assess the efficacy of the model using each feature extraction technique. The findings reveal that the K-NN model exhibits optimal performance when the k parameter is set to 3 (k=3). Under this configuration, the model achieves an accuracy of 86.88%, with a precision of 88.27%, a recall of 86.88%, and an F1-Score of 86.50%. These results show that the integration of TF-IDF feature extraction technique with K-NN algorithm produces superior performance in hate speech classification.

Enhancing Medical Image Classification with Unified Model Agnostic Computation and Explainable AI

Background: Advances in medical image classification have recently benefited from general augmentation techniques. However, these methods often fall short in performance and interpretability. Objective: This paper applies the Unified Model Agnostic Computation (UMAC) framework specifically to the medical domain to demonstrate its utility in this critical area. Methods: UMAC is a model-agnostic methodology designed to develop machine learning approaches that integrate seamlessly with various paradigms, including self-supervised, semi-supervised, and supervised learning. By unifying and standardizing computational models and algorithms, UMAC ensures adaptability across different data types and computational environments while incorporating state-of-the-art methodologies. In this study, we integrate UMAC as a plug-and-play module within convolutional neural networks (CNNs) and Transformer architectures, enabling the generation of high-quality representations even with minimal data. Results: Our experiments across nine diverse 2D medical image datasets show that UMAC consistently outperforms traditional data augmentation methods, achieving a 1.89% improvement in classification accuracy. Conclusions: Additionally, by incorporating explainable AI (XAI) techniques, we enhance model transparency and reliability in decision-making. This study highlights UMAC’s potential as a powerful tool for improving both the performance and interpretability of medical image classification models.

ODHEPDC: Optimal Trained Deep Hybrid Ensemble of Classifier for Plant Disease Classification With Improved Deep Fuzzy Clustering

ABSTRACTPlant diseases are the major factors that affects the quality production as it affects or interrupts the plant's vital functions. The early detection of crop disease could assist farmers in implementing the right preventative measures at the right moment to eradicate it. The main goal of the ODHEPDC (Optimal Trained Deep Hybrid Ensemble of Classifier for Classification of Plant Disease) model is the classification of diseases leaf images. The primary step is to improve the input image by using the MF model to remove the noise. This is considered as the preprocessing step. Improved fuzzy clustering algorithm, leading to the identification of the regions, ROI as well as non‐ROI. Next to this, the appropriate features are extracted to define the feature set that includes MPPT feature, PHOG feature, and MTP features as well. However, the curse of dimensionality is the greatest crisis in the classification problem, hence, improved feature level fusion is progressed, which is the simple concatenation of the extracted features. In this, the improved calculation of information gain ensures the reduction and fusion of feature set. The fused features are the inputs to ensemble classification model with the classifiers like CNN, RNN, and DBN classifiers, which gives the classified results. To boost up the performance of classification model, the Deep Maxout model in the ensemble is optimally trained by a new Bald Eagle Search Updated Pelican Optimization (BESUPO) Algorithm via optimal weights tuning as the model determines the final classification outcome. The validation results prove the disease classification performance via the given architecture than extant schemes.

A novel image classification framework based on variational quantum algorithms

Image classification is a crucial task in machine learning with widespread practical applications. The existing classical framework for image classification typically utilizes a global pooling operation at the end of the network to reduce computational complexity and mitigate overfitting. However, this operation often results in a significant loss of information, which can affect the performance of classification models. To overcome this limitation, we introduce a novel image classification framework that leverages variational quantum algorithms (VQAs) hybrid approaches combining quantum and classical computing paradigms within quantum machine learning. The major advantage of our framework is the elimination of the need for the global pooling operation at the end of the network. In this way, our approach preserves more discriminative features and fine-grained details in the images, which enhances classification performance. Additionally, employing VQAs enables our framework to have fewer parameters than the classical framework, even in the absence of global pooling, which makes it more advantageous in preventing overfitting. We apply our method to different state-of-the-art image classification models and demonstrate the superiority of the proposed quantum architecture over its classical counterpart through a series of state vector simulation experiments on public datasets. Our experiments show that the proposed quantum framework achieves up to a 9.21% increase in accuracy and up to a 15.79% improvement in F1 score, compared to the classical framework. Additionally, we explore the impact of shot noise on our method through shot-based simulation and find that increasing the number of measurements does not always lead to better results. Selecting an appropriate number of measurements can yield optimal results, even surpassing those obtained from state vector simulation.

Enhancing COVID-19 disease severity classification through advanced transfer learning techniques and optimal weight initialization schemes

ObjectiveMedical imaging plays a central role in medicine today by supporting diagnosis and treatment. For small medical image datasets, training from scratch is a time-consuming process and transfer learning emerges as a solution. In these cases, ImageNet weights are usually used as initial weights, after which fine-tuning is performed. We propose a methodology for COVID-19 severity classification (mild, moderate, severe, critical) in chest X-ray images based on transfer learning using DenseNet121 architecture as a base model. MethodsThe novelty of the approach mainly lies in the investigation of three different weight initialization schemes (i) ImageNet (ii) CheXNeXt (iii) DeepCOVID-XR, which are similar in a graded manner in terms of image nature, with ImageNet being the least similar, CheXNeXt similar as they were trained on different lung diseases not including COVID-19 and DeepCOVID-XR the most similar as they were obtained by training specifically on COVID-19 X-ray images. ResultsThe results show that the worst results are achieved using ImageNet as initial weights (average AUC = 0.700), followed by the better results with DeepCOVID-XR (average AUC = 0.774) while CheXNeXt performed significantly better (average AUC = 0.917). The results of weaker performing classification models were improved when the severe and critical classes were merged, to account for the similarity between these classes in the dataset (average AUC for initialization schemes were ImageNet AUC = 0.867, CheXNeXt AUC = 0.900 and DeepCOVID-XR AUC = 0.794). ConclusionThis leads to a conclusion that, in the medical domain, where image datasets are usually small and highly imbalanced, if initial weights are chosen to be in nature similar to the new dataset, achieved results are better. However, there is no need to start from weights obtained during training on the same disease, as this may cause overfitting. There are significant discrepancies between ImageNet and medical imaging datasets and the results from this paper could help in guiding future implementations of transfer learning in medical applications.

Improving cross-regional model transfer performance in crop classification by crop time series correction

ABSTRACT Cross-Regional Model Transfer (CRMT) provides a solution to crop classification challenges in target regions with limited labeled samples. However, when the source region (source domain) and the target region (target domain) are spatially distant, a shift in crop Satellite Image Time Series (SITS) occurs, resulting in suboptimal performance of SITS-based classification models in the target domain. To address this issue, we propose a novel domain adaptation method, named SITS Correction. This method mitigates the SITS shift by introducing correction factors to improve the classification performance of CRMT. The correction factors consist of source domain correction units and target domain correction units, which are from variables associated with the SITS shift. In cases where labeled samples are available in the target domain, the SITS have calculated Barycenter (i.e. SitsB) as the correction units, which then combine the source domain and the target domain’s SitsB to form a SITS-based correction factor. When no labeled samples are available, the correction units are substituted by Barycenter of the temperature variables time series (i.e. temperature indicator) influencing crop growth, and the correction factors are composed of temperature indicators from both the source and target domains. We validate SITS Correction through transfer experiments conducted in four regions, encompassing various years, crops, and classification methods. Experimental results demonstrate a significant improvement in crop classification performance with SITS Correction in both scenarios – target domain with labeled samples (accuracy increased by 39.1%) and target domain without labeled samples (accuracy increased by 14.8%). This research provides a practical option for crop classification in target regions with either limited or no labeled samples.

Statistical models for classification by handedness of Olympic Trap shooters in digital training services and remote coaching

AbstractIn this paper, we address the problem of classification by handedness of Olympic Trap shooters applying statistical methods to newly available data gathered from the field. We assess the performance of binary classification models based on KNN and Binary Regression, with both symmetric and asymmetric link functions, in a context characterized by unbalanced data. Our results show promising classification performance, suitable for first non-critical applications in data driven training services and remote coaching, encouraging further future research.

An ensemble deep learning model for fast classification of Twitter spam

Twitter spam needs to be detected and arrested quickly. The paper examines methods for classification of spam in terms of determination of important features, comparative performance of classification models, and improvement in time performance for classification. It presents a conceptualization of several novel rich, deep, and naïve features. The extraction processes for rich and deep features increase the time complexity of spam classification. To address this, the proposed model selectively segregates and combines features to enable near real-time processing. This supersedes the time performance of standard machine learning and deep learning models, with no compromise on the quality of classification.

Machine learning framework for predicting water quality classification

ABSTRACT Groundwater serves as the source for nearly half of the world's drinking water, yet understanding of global groundwater resources remains incomplete, and management of aquifers falls short, particularly concerning groundwater quality. This research offers insights into the groundwater quality in 242 stations of Maharashtra and Union Territory of Dadra and Nagar Haveli and nine parameters (pH, TDS, TH, Calcium (Ca2+), Magnesium (Mg2+), Chloride (Cl−), Sulphate (SO42−), Nitrate (NO3−), Fluoride (F−)) were considered for computing the Water Quality Index (WQI) and hence Water Quality Classification (WQC) based on Water Quality Index (WQI). This research introduces the utilisation of Machine Learning (ML) models, specifically, Random Forest, Adaptive Boosting (AdaBoost), Gradient Boosting, XGBoost, Support Vector Machine (SVM) and K-Nearest Neighbor (KNN) model for predicting WQC and models are tested. Grid search method as a hyperparameter tuning of parameters is utilized to achieve the best possible performance of ML models. The performance metrics that are used for evaluating and reporting the performance of classification models are Accuracy, Precision, Recall or Sensitivity, F1 Score. SVM achieved the highest performance in predicting WQC. With accurate predictions of WQC, these findings have the potential to enhance NEP concerning water resources by facilitating ongoing improvements in water quality.

A novel ensemble over-sampling approach based Chebyshev inequality for imbalanced multi-label data

With the development of intelligent technology, data exhibits characteristics of multi-label and imbalanced distribution, which lead to the degradation of classification model performance. Therefore, addressing multi-label class imbalance has become a hot research topic. Nowadays, over-sampling approaches aim to generate a superset of the original dataset to deal with imbalanced data. However, traditional over-sampling methods only employ the central data point and its nearest neighbor samples to synthesize samples without considering the impact of data distribution. To address these issues, in this paper, we propose an ensemble multi-label over-sampling algorithm (MLCIO) based on Chebyshev inequality and a group optimization strategy. Firstly, to generate more representative and diverse samples, with the seed sample serving as the sphere’s center, Chebyshev inequality is utilized to ensure that synthetic samples fall within its m times the standard deviation. Secondly, a group optimization ranking weighting approach is employed to obtain more reliable and stable label information. Finally, comparative experiments are conducted on 11 imbalanced datasets from various domains using different evaluation metrics. The results demonstrate that our proposal achieves better performance than other approaches.

Monitoring small-scale bioreactor studies for media development using polarized total synchronous fluorescence spectroscopy (pTSFS) and synchronous light scattering (SyLS)

Biopharmaceutical process development often involves the use of small-scale bioreactors (SSBR) for optimizing media formulations and process conditions during scale up to commercial scale production. Two key process parameters (CPP) used in SSBR studies are protein titre and viable cell density (VCD). Here, we explore the efficacy of parallel polarized total synchronous fluorescence spectroscopy (TSFS||) and Synchronous Light Scattering (SyLS||) to qualitatively monitor these CPPs and quantitatively predict titre and VCD for a large-scale cell culture media optimization SSBR study. The study involved 71 different media formulations (50+ components each), and the bioprocess was run for 13 days or more. Samples were extracted at set times (Day 0, 3, 9, and 13) and clarified by centrifugation. TSFS|| spectra showed significant emission changes along with increased light scatter over the course of the bioprocess. SyLS|| measurements strongly correlated with particle size data obtained from Dynamic Light Scattering but did not correlate well with VCD probably because of the centrifugation-based sample preparation. Statistical and principal component analysis (PCA) of the pTSFS data showed that spectral variation was greater between media formulations than due to the evolving bioprocess. This prevented the development of accurate global prediction models for media performance (e.g., predicting product titre at day 9 from media spectra measured at day 0). However, classification methods were successfully used to select media subsets with better quantitative prediction accuracy based on spectral similarities. A practical binary (high/low performance) classification model based on Support Vector Machines was generated for media formulation screening. Combining emission and scatter measurements with multivariate data analysis provides a more holistic, multi-attribute bioprocess monitoring method that minimizes the need to use different offline analytical methods. This methodology can be used to monitor process trajectories and deviations, and ultimately be used to predict bioprocess CPPs when implemented on production scale processes where there is much less compositional variation in the media. We believe this SSBR-pTSFS/SyLS approach will provide a valuable resource to develop the design/parameter space for in-process monitoring at production scale from early-stage process/media development studies.