Performance Of Classifier Research Articles

Comparative Analysis of Machine Learning Models for Predicting Diabetes: Unveiling the Superiority of Advanced Ensemble Methods

This study presents a comprehensive analysis of various machine learning models to predict diabetes. The research evaluates and compares the predictive performance of advanced ensemble techniques Extra Trees Classifier and LightGBM with traditional machine learning algorithms and simpler deep neural network (DNN) architectures. The dataset comprises numerous features pertinent to diabetes diagnosis, such as glucose concentration, BMI, and insulin levels, among others. A methodology, including polynomial feature transformation and ten-fold cross-validation, was employed to ensure the study's reliability and the models' capability to generalize. The advanced ensemble models, Extra Trees and LightGBM, achieved stellar predictive metrics, with the former attaining a near-perfect ROC AUC, accuracy, precision, and an F1 score close to 1. LightGBM followed closely, demonstrating the high efficacy of ensemble methods in complex data settings. These results were contrasted with significantly lower performance metrics from DNNs and respectable, albeit lower, scores from traditional models like Decision Trees, Random Forest, KNN, and XGBoost.

A joint learning framework for optimal feature extraction and multi-class SVM

In high-dimensional data classification, effectively extracting discriminative features while eliminating redundancy is crucial for enhancing the performances of classifiers, such as Support Vector Machine (SVM). However, previous studies have decoupled the process of feature extraction from the development of SVM, leading to suboptimal classification accuracy. To address this problem, we propose a novel joint learning framework that combines optimal feature extraction and multi-class SVM, incorporating a generalized regression form to learn a discriminative latent subspace. The projected data in this subspace are more likely to have a larger margin between different classes and align with the properties of the SVM classification mechanism, enhancing the overall classification performance. Three iterative algorithms were presented to obtain optimal solutions with guaranteed convergence, and theoretical analyses were also conducted to reveal their fundamental nature. The optimal linear projection subspace is equivalent to that obtained from Linear Discriminant Analysis (LDA) in some special cases. We conducted extensive experiments using diverse datasets to evaluate the performances of the proposed algorithms. Our algorithms achieved an accuracy improvement of up to 7.55% compared to other conventional methods.

Enhancing Crop Mapping through Automated Sample Generation Based on Segment Anything Model with Medium-Resolution Satellite Imagery

Crop mapping using satellite imagery is crucial for agriculture applications. However, a fundamental challenge that hinders crop mapping progress is the scarcity of samples. The latest foundation model, Segment Anything Model (SAM), provides an opportunity to address this issue, yet few studies have been conducted in this area. This study investigated the parcel segmentation performance of SAM on commonly used medium-resolution satellite imagery (i.e., Sentinel-2 and Landsat-8) and proposed a novel automated sample generation framework based on SAM. The framework comprises three steps. First, an image optimization automatically selects high-quality images as the inputs for SAM. Then, potential samples are generated based on the masks produced by SAM. Finally, the potential samples are subsequently subjected to a sample cleaning procedure to acquire the most reliable samples. Experiments were conducted in Henan Province, China, and southern Ontario, Canada, using six proven effective classifiers. The effectiveness of our method is demonstrated through the combination of field-survey-collected samples and differently proportioned generated samples. Our results indicated that directly using SAM for parcel segmentation remains challenging, unless the parcels are large, regular in shape, and have distinct color differences from surroundings. Additionally, the proposed approach significantly improved the performance of classifiers and alleviated the sample scarcity problem. Compared to classifiers trained only by field-survey-collected samples, our method resulted in an average improvement of 16% and 78.5% in Henan and Ontario, respectively. The random forest achieved relatively good performance, with weighted-average F1 of 0.97 and 0.996 obtained using Sentinel-2 imagery in the two study areas, respectively. Our study contributes insights into solutions for sample scarcity in crop mapping and highlights the promising application of foundation models like SAM.

An Empirical Research Approach on Confusion Matrix Using Existing Musical Industry Dataset

This paper analyzes the sales of existing music albums from 1973 to 2019. The data shows that the music industry has experienced many changes over the years, with the most significant change being the introduction of digital platforms. Digital platforms have disrupted the traditional music industry model, leading to a decline in sales of physical albums. The paper also analyzes the sales of each medium through which music was distributed worldwide with different machine learning algorithm classifiers consistently exhibiting inadequate predictive power. the lack of a good prognosis highlights a fundamental failure toward well-infected persons in a class. the presence of non-zero false positive rates indicates negative data are distributed among positive errors. analysis of the data reveals worrying inefficiencies in classifier performance Keywords: Precession, Recall, Accuracy, Track, Digital industry, Cost efficiency and confusion matrix

Development of a Real-time Force-based Algorithm for Infusion Failure Detection.

Continuous subcutaneous insulin infusion (CSII) is a common treatment option for people with diabetes (PWD), but insulin infusion failures pose a significant challenge, leading to hyperglycemia, diabetes burnout, and increased hospitalizations. Current CSII pumps' occlusion alarm systems are limited in detecting infusion failures; therefore, a more effective detection method is needed. We conducted five preclinical animal studies to collect data on infusion failures, utilizing both insulin and non-insulin boluses. Data were captured using in-line pressure and flow rate sensors, with additional force data from CSII pumps' onboard sensors in one study. A novel classifier model was developed using this dataset, aimed at detecting different types of infusion failures through direct utilization of force sensor data. Performance was compared against various occlusion alarm thresholds from commercially available CSII pumps. The testing dataset included 251 boluses. The Bagging classifier model showed the highest performance metrics among the models tested, exhibiting high accuracy (96%), sensitivity (94%), and specificity (98%), with lower false-positive and false-negative rate compared with traditional occlusion alarm pressure thresholds. Our study developed a novel non-threshold classifier that outperforms current occlusion alarm systems in CSII pumps in detecting infusion failures. This advancement has the potential to reduce the risk of hyperglycemia and hospitalizations due to undetected infusion failures, offering a more reliable and effective CSII therapy for PWD. Further studies involving human participants are recommended to validate these findings and assess the classifier's performance in a real-world setting.

ORFEO: Ordinal classifier and Regressor Fusion for Estimating an Ordinal categorical target

In this paper we present a novel methodology, referenced as ORFEO (Ordinal classifier and Regressor Fusion for Estimating an Ordinal categorical target), to enhance the performance in ordinal classification problems for which the latent variable is observable. ORFEO is an artificial neural network model incorporating two outputs, one for ordinal classification, using the cumulative link model, and one for regression, using a linear model. Both outputs are simultaneously optimised considering a loss function that linearly combines both classification and regression losses. The main motivation behind developing the proposed approach is to enhance the performance of a standard ordinal classifier. This improvement is facilitated by considering the regression output, which allows the model to differentiate between patterns within the same category. The ORFEO model is applied to two problems in the field of marine and ocean engineering: short-term prediction of both significant wave height and flux of energy. Both problems are addressed considering four different coastal zones of the United States of America, using 13 datasets formed by buoys measurements and reanalysis data. A comprehensive comparison against 20 methodologies, including regression and nominal/ordinal classification approaches is performed, by using diverse nominal and ordinal performance metrics. Ranks achieved indicate that ORFEO outperforms all the compared methodologies in terms of all the performance measures, demonstrating the efficacy and robustness of the proposal. Finally, a statistical analysis is conducted, concluding that there are statistically significant differences across ordinal and nominal performance metrics in favour of the proposed ORFEO model.

Machine learning algorithms to predict colistin-induced nephrotoxicity from electronic health records in patients with multidrug-resistant Gram-negative infection

ObjectivesColistin-induced nephrotoxicity prolongs hospitalisation and increases mortality. The study aimed to construct machine learning models to predict colistin-induced nephrotoxicity in patients with multidrug-resistant Gram-negative infection. MethodsPatients receiving colistin from three hospitals in the Clinical Research Database were included. Data were divided into a derivation cohort (2011–2017) and a temporal validation cohort (2018–2020). Fifteen machine learning models were established by categorical boosting, light gradient boosting machine and random forest. Classifier performances were compared by the sensitivity, F1 score, Matthews correlation coefficient (MCC), area under the receiver operating characteristic (AUROC) curve, and area under the precision-recall curve (AUPRC). SHapley Additive exPlanations plots were drawn to understand feature importance and interactions. ResultsThe study included 1392 patients, with 360 (36.4%) and 165 (40.9%) experiencing nephrotoxicity in the derivation and temporal validation cohorts, respectively. The categorical boosting with oversampling achieved the highest performance with a sensitivity of 0.860, an F1 score of 0.740, an MCC of 0.533, an AUROC curve of 0.823, and an AUPRC of 0.737. The feature importance demonstrated that the days of colistin use, cumulative dose, daily dose, latest C-reactive protein, and baseline haemoglobin were the most important risk factors, especially for vulnerable patients. A cutoff colistin dose of 4.0 mg/kg body weight/d was identified for patients at higher risk of nephrotoxicity. ConclusionsMachine learning techniques can be an early identification tool to predict colistin-induced nephrotoxicity. The observed interactions suggest a modification in dose adjustment guidelines. Future geographic and prospective validation studies are warranted to strengthen the real-world applicability.

Optimizing bearing health condition monitoring: exploring correlation feature selection algorithm

Vibration signals are a critical source of information for detecting and diagnosing bearing faults, making this research particularly relevant to the condition monitoring of industrial machinery, particularly bearings using vibration signals. This study delves into how feature selection can be done using Pearson’s Correlation Co-efficient within the context of monitoring bearing health conditions, utilizing two distinct approaches. Approach-1 involves feature selection without considering labels, while Approach-2 incorporates labels for feature selection. Comparative analysis is conducted against outcomes obtained when all features are selected. The research scrutinizes the impact of feature selection on classifier performance, accuracy, and execution times, utilizing various machine learning algorithms such as Decision Tree (DT), K Nearest Neighbor (KNN), Support Vector Machine (SVM), and Naïve Bayes (NB). The findings underscore that feature selection significantly enhances classifier accuracy while reducing execution times. Specifically, only DT and KNN with 50 neighbors achieved 100% accuracy when all features were considered. However, with feature selection using Approach-1 (without labels), DT, KNN, SVM (excluding 100 neighbors), and NB (with Normal/Gaussian kernel) attained 100% accuracy. Employing Approach-2 (with labeled features), DT with 0.7 and 0.9 thresholds, SVM-G with all thresholds (0.6, 0.7, and 0.9), KNN with all thresholds (except 100 neighbors), and NB-n (with all thresholds) achieved 100% accuracy. The study emphasizes the pivotal role of feature selection using Pearson’s Correlation Coefficient in enhancing machine learning classifier performance, offering promising avenues for future research and practical applications across diverse domains.

An Ensemble Feature Selection Approach-Based Machine Learning Classifiers for Prediction of COVID-19 Disease.

The respiratory disease of coronavirus disease 2019 (COVID-19) has wreaked havoc on the economy of every nation by infecting and killing millions of people. This deadly disease has taken a toll on the life of the entire human race, and an exact cure for it is still not developed. Thus, the control and cure of this disease mainly depend on restricting its transmission rate through early detection. The detection of coronavirus infection facilitates the isolation and exclusive care of infected patients. This research paper proposes a novel data mining system that combines the ensemble feature selection method and machine learning classifier for the effective identification of COVID-19 infection. Different feature selection approaches including chi-square test, recursive feature elimination (RFE), genetic algorithm (GA), particle swarm optimization (PSO), and random forest are evaluated for their effectiveness in enhancing the classification accuracy of the machine learning classifiers. The classifiers that are considered in this research work are decision tree, naïve Bayes, K-nearest neighbor (KNN), multilayer perceptron (MLP), and support vector machine (SVM). Two COVID-19 datasets were used for testing from which the best features supporting the dataset were extracted by the proposed system. The performance of the machine learning classifiers based on the ensemble feature selection methods is analyzed.

Sex classification from functional brain connectivity: Generalization to multiple datasets.

Machine learning (ML) approaches are increasingly being applied to neuroimaging data. Studies in neuroscience typically have to rely on a limited set of training data which may impair the generalizability of ML models. However, it is still unclear which kind of training sample is best suited to optimize generalization performance. In the present study, we systematically investigated the generalization performance of sex classification models trained on the parcelwise connectivity profile of either single samples or compound samples of two different sizes. Generalization performance was quantified in terms of mean across-sample classification accuracy and spatial consistency of accurately classifying parcels. Our results indicate that the generalization performance of parcelwise classifiers (pwCs) trained on single dataset samples is dependent on the specific test samples. Certain datasets seem to "match" in the sense that classifiers trained on a sample from one dataset achieved a high accuracy when tested on the respected other one and vice versa. The pwCs trained on the compound samples demonstrated overall highest generalization performance for all test samples, including one derived from a dataset not included in building the training samples. Thus, our results indicate that both a large sample size and a heterogeneous data composition of a training sample have a central role in achieving generalizable results.

Identification of Depression from the Speech of a Person

The world’s population has experienced profound psychological effects over time due to stress, anxiety, and fast-paced modern lifestyles. Accurate mapping of the diverse forms of human biology is made possible by the global technological development in healthcare, which digitizes scopious data more than usual measuring methods. Healthcare data analysis can now be done more effectively with the use of machine learning (ML), thanks to its vast volume of data. To forecast the likelihood of mental illnesses and, consequently, carry out possible treatment outcomes, machine learning techniques are being applied to the field of mental health. This review paper outlines many machine learning techniques that are employed in the identification of depression. Classification, Deep learning, and ensemble—are used to group the machine learning-based depression detection systems. A comprehensive approach for identification depression is introduced, which includes data extraction, pre-processing, ML classifier training, detection, classification, and performance assessment. Additionally, it provides a summary that identifies the goals and constraints of various research projects that have been presented in the field of depression detection. It also covers potential directions for future research in the realm of depression diagnosis

Utilizing synthetic images to enhance the automated recognition of small-sized construction tools

Previous studies on vision-based classifiers often overlooked the need for detecting small-sized construction tools. Considering the substantial variations in these tools' size and shape, it is essential to train models using synthetic images that encompass diverse angles and distances. This study aimed to improve the performance of classifiers for small-sized construction tools by leveraging synthetic data. Three classifiers were proposed using YOLOv8 algorithm, varying in data composition: (i) ‘Real-4000’: 4000 authentic images; (ii) ‘Hybrid-4000’: 2000 authentic and 2000 synthetic images; (iii) ‘Hybrid-8000’: 4000 authentic and 4000 synthetic images. To assess practical applicability, a test dataset of 144 samples for each type was collected directly from construction sites. Results revealed that the ‘Hybrid-8000’ model, utilizing synthetic images, excelled at 94.8% of mAP_0.5. This represented a significant 15.2% improvement, affirming its practical applicability. These classifiers hold promise for enhancing safety and advancing real-time automation and robotics in construction.

A Data Augmentation Method for Motor Imagery EEG Signals Based on DCGAN-GP Network.

Motor imagery electroencephalography (EEG) signals have garnered attention in brain-computer interface (BCI) research due to their potential in promoting motor rehabilitation and control. However, the limited availability of labeled data poses challenges for training robust classifiers. In this study, we propose a novel data augmentation method utilizing an improved Deep Convolutional Generative Adversarial Network with Gradient Penalty (DCGAN-GP) to address this issue. We transformed raw EEG signals into two-dimensional time-frequency maps and employed a DCGAN-GP network to generate synthetic time-frequency representations resembling real data. Validation experiments were conducted on the BCI IV 2b dataset, comparing the performance of classifiers trained with augmented and unaugmented data. Results demonstrated that classifiers trained with synthetic data exhibit enhanced robustness across multiple subjects and achieve higher classification accuracy. Our findings highlight the effectiveness of utilizing a DCGAN-GP-generated synthetic EEG data to improve classifier performance in distinguishing different motor imagery tasks. Thus, the proposed data augmentation method based on a DCGAN-GP offers a promising avenue for enhancing BCI system performance, overcoming data scarcity challenges, and bolstering classifier robustness, thereby providing substantial support for the broader adoption of BCI technology in real-world applications.

Physical Activity Detection for Diabetes Mellitus Patients Using Recurrent Neural Networks.

Diabetes mellitus (DM) is a persistent metabolic disorder associated with the hormone insulin. The two main types of DM are type 1 (T1DM) and type 2 (T2DM). Physical activity plays a crucial role in the therapy of diabetes, benefiting both types of patients. The detection, recognition, and subsequent classification of physical activity based on type and intensity are integral components of DM treatment. The continuous glucose monitoring system (CGMS) signal provides the blood glucose (BG) level, and the combination of CGMS and heart rate (HR) signals are potential targets for detecting relevant physical activity from the BG variation point of view. The main objective of the present research is the developing of an artificial intelligence (AI) algorithm capable of detecting physical activity using these signals. Using multiple recurrent models, the best-achieved performance of the different classifiers is a 0.99 area under the receiver operating characteristic curve. The application of recurrent neural networks (RNNs) is shown to be a powerful and efficient solution for accurate detection and analysis of physical activity in patients with DM. This approach has great potential to improve our understanding of individual activity patterns, thus contributing to a more personalized and effective management of DM.

Semantically redundant training data removal and deep model classification performance: A study with chest X-rays

Deep learning (DL) has demonstrated its innate capacity to independently learn hierarchical features from complex and multi-dimensional data. A common understanding is that its performance scales up with the amount of training data. However, the data must also exhibit variety to enable improved learning. In medical imaging data, semantic redundancy, which is the presence of similar or repetitive information, can occur due to the presence of multiple images that have highly similar presentations for the disease of interest. Also, the common use of augmentation methods to generate variety in DL training could limit performance when indiscriminately applied to such data. We hypothesize that semantic redundancy would therefore tend to lower performance and limit generalizability to unseen data and question its impact on classifier performance even with large data. We propose an entropy-based sample scoring approach to identify and remove semantically redundant training data and demonstrate using the publicly available NIH chest X-ray dataset that the model trained on the resulting informative subset of training data significantly outperforms the model trained on the full training set, during both internal (recall: 0.7164 vs 0.6597, p<0.05) and external testing (recall: 0.3185 vs 0.2589, p<0.05). Our findings emphasize the importance of information-oriented training sample selection as opposed to the conventional practice of using all available training data.

Efficient ECG classification based on Chi-square distance for arrhythmia detection

This study introduces a new classifier tailored to address the limitations inherent in conventional classifiers such as K-nearest neighbor (KNN), random forest (RF), decision tree (DT), and support vector machine (SVM) for arrhythmia detection. The proposed classifier leverages the Chi-square distance as a primary metric, providing a specialized and original approach for precise arrhythmia detection. To optimize feature selection and refine the classifier's performance, particle swarm optimization (PSO) is integrated with the Chi-square distance as a fitness function. This synergistic integration enhances the classifier’s capabilities, resulting in a substantial improvement in accuracy for arrhythmia detection. Experimental results demonstrate the efficacy of the proposed method, achieving a noteworthy accuracy rate of 98% with PSO, higher than 89% achieved without any previous optimization. The classifier outperforms machine learning (ML) and deep learning (DL) techniques, underscoring its reliability and superiority in the realm of arrhythmia classification. The promising results render it an effective method to support both academic and medical communities, offering an advanced and precise solution for arrhythmia detection in electrocardiogram (ECG) data.

Refined Detection and Classification of Knee Ligament Injury Based on ResNet Convolutional Neural Networks.

Currently, medical imaging has largely supplanted traditional methods in the realm of diagnosis and treatment planning. This shift is primarily attributable to the non-invasive nature, rapidity, and user-friendliness of medical-imaging techniques. The widespread adoption of medical imaging, however, has shifted the bottleneck to healthcare professionals who must analyze each case post-image acquisition. This process is characterized by its sluggishness and subjectivity, making it susceptible to errors. The anterior cruciate ligament (ACL), a frequently injured knee ligament, predominantly affects a youthful and sports-active demographic. ACL injuries often leave patients with substantial disabilities and alter knee mechanics. Since some of these cases necessitate surgery, it is crucial to accurately classify and detect ACL injury. This paper investigates the utilization of pre-trained convolutional neural networks featuring residual connections (ResNet) along with image-processing methods to identify ACL injury and differentiate between various tear levels. The ResNet employed in this study is not the standard ResNet but rather an adapted version capable of processing 3D volumes constructed from 2D image slices. Achieving a peak accuracy of 97.15% with a custom split, 96.32% through Monte-Carlo cross-validation, and 93.22% via five-fold cross-validation, our approach enhances the performance of three-class classifiers by over 7% in terms of raw accuracy. Moreover, we achieved an improvement of more than 1% across all types of evaluation. It is quite clear that the model's output can effectively serve as an initial diagnostic baseline for radiologists with minimal effort and nearly instantaneous results. This advancement underscores the paper's focus on harnessing deep learning for the nuanced detection and classification of ACL tears, demonstrating a significant leap toward automating and refining diagnostic accuracy in sports medicine and orthopedics.

Development of a multigenomic liquid biopsy (PROSTest) for prostate cancer in whole blood.

We describe the development of a molecular assay from publicly available tumor tissue mRNA databases using machine learning and present preliminary evidence of functionality as a diagnostic and monitoring tool for prostate cancer (PCa) in whole blood. We assessed 1055 PCas (public microarray data sets) to identify putative mRNA biomarkers. Specificity was confirmed against 32 different solid and hematological cancers from The Cancer Genome Atlas (n = 10,990). This defined a 27-gene panel which was validated by qPCR in 50 histologically confirmed PCa surgical specimens and matched blood. An ensemble classifier (Random Forest, Support Vector Machines, XGBoost) was trained in age-matched PCas (n = 294), and in 72 controls and 64 BPH. Classifier performance was validated in two independent sets (n = 263 PCas; n = 99 controls). We assessed the panel as a postoperative disease monitor in a radical prostatectomy cohort (RPC: n = 47). A PCa-specific 27-gene panel was identified. Matched blood and tumor gene expression levels were concordant (r = 0.72, p < 0.0001). The ensemble classifier ("PROSTest") was scaled 0%-100% and the industry-standard operating point of ≥50% used to define a PCa. Using this, the PROSTest exhibited an 85% sensitivity and 95% specificity for PCa versus controls. In two independent sets, the metrics were 92%-95% sensitivity and 100% specificity. In the RPCs (n = 47), PROSTest scores decreased from 72% ± 7% to 33% ± 16% (p < 0.0001, Mann-Whitney test). PROSTest was 26% ± 8% in 37 with normal postoperative PSA levels (<0.1 ng/mL). In 10 with elevated postoperative PSA, PROSTest was 60% ± 4%. A 27-gene whole blood signature for PCa is concordant with tissue mRNA levels. Measuring blood expression provides a minimally invasive genomic tool that may facilitate prostate cancer management.

Deep learning workflow to support in-flight processing of digital aerial imagery for wildlife population surveys.

Deep learning shows promise for automating detection and classification of wildlife from digital aerial imagery to support cost-efficient remote sensing solutions for wildlife population monitoring. To support in-flight orthorectification and machine learning processing to detect and classify wildlife from imagery in near real-time, we evaluated deep learning methods that address hardware limitations and the need for processing efficiencies to support the envisioned in-flight workflow. We developed an annotated dataset for a suite of marine birds from high-resolution digital aerial imagery collected over open water environments to train the models. The proposed 3-stage workflow for automated, in-flight data processing includes: 1) image filtering based on the probability of any bird occurrence, 2) bird instance detection, and 3) bird instance classification. For image filtering, we compared the performance of a binary classifier with Mask Region-based Convolutional Neural Network (Mask R-CNN) as a means of sub-setting large volumes of imagery based on the probability of at least one bird occurrence in an image. On both the validation and test datasets, the binary classifier achieved higher performance than Mask R-CNN for predicting bird occurrence at the image-level. We recommend the binary classifier over Mask R-CNN for workflow first-stage filtering. For bird instance detection, we leveraged Mask R-CNN as our detection framework and proposed an iterative refinement method to bootstrap our predicted detections from loose ground-truth annotations. We also discuss future work to address the taxonomic classification phase of the envisioned workflow.

Emotion Modeling in Speech Signals: Discrete Wavelet Transform and Machine Learning Tools for Emotion Recognition System

Speech emotion recognition (SER) is a challenging task due to the complex and subtle nature of emotions. This study proposes a novel approach for emotion modeling using speech signals by combining discrete wavelet transform (DWT) with linear prediction coding (LPC). The performance of various classifiers, including support vector machine (SVM), K-Nearest Neighbors (KNN), Efficient Logistic Regression, Naive Bayes, Ensemble, and Neural Network, was evaluated for emotion classification using the EMO-DB dataset. Evaluation metrics such as area under the curve (AUC), average prediction accuracy, and cross-validation techniques were employed. The results indicate that KNN and SVM classifiers exhibited high accuracy in distinguishing sadness from other emotions. Ensemble methods and Neural Networks also demonstrated strong performance in sadness classification. While Efficient Logistic Regression and Naive Bayes classifiers showed competitive performance, they were slightly less accurate compared to other classifiers. Furthermore, the proposed feature extraction method yielded the highest average accuracy, and its combination with formants or wavelet entropy further improved classification accuracy. On the other hand, Efficient Logistic Regression exhibited the lowest accuracies among the classifiers. The uniqueness of this study was that it investigated a combined feature extraction method and integrated them to compare with various forms of combinations. However, the purposes of the investigation include improved performance of the classifiers, high effectiveness of the system, and the potential for emotion classification tasks. These findings can guide the selection of appropriate classifiers and feature extraction methods in future research and real-world applications. Further investigations can focus on refining classifiers and exploring additional feature extraction techniques to enhance emotion classification accuracy.