Traditional Machine Learning Classifiers Research Articles

Enhancing Classification Accuracy with Integrated Contextual Gate Network: Deep Learning Approach for Functional Near-Infrared Spectroscopy Brain-Computer Interface Application.

Brain-computer interface (BCI) systems include signal acquisition, preprocessing, feature extraction, classification, and an application phase. In fNIRS-BCI systems, deep learning (DL) algorithms play a crucial role in enhancing accuracy. Unlike traditional machine learning (ML) classifiers, DL algorithms eliminate the need for manual feature extraction. DL neural networks automatically extract hidden patterns/features within a dataset to classify the data. In this study, a hand-gripping (closing and opening) two-class motor activity dataset from twenty healthy participants is acquired, and an integrated contextual gate network (ICGN) algorithm (proposed) is applied to that dataset to enhance the classification accuracy. The proposed algorithm extracts the features from the filtered data and generates the patterns based on the information from the previous cells within the network. Accordingly, classification is performed based on the similar generated patterns within the dataset. The accuracy of the proposed algorithm is compared with the long short-term memory (LSTM) and bidirectional long short-term memory (Bi-LSTM). The proposed ICGN algorithm yielded a classification accuracy of 91.23 ± 1.60%, which is significantly (p < 0.025) higher than the 84.89 ± 3.91 and 88.82 ± 1.96 achieved by LSTM and Bi-LSTM, respectively. An open access, three-class (right- and left-hand finger tapping and dominant foot tapping) dataset of 30 subjects is used to validate the proposed algorithm. The results show that ICGN can be efficiently used for the classification of two- and three-class problems in fNIRS-based BCI applications.

Detecting Anomalies in Blockchain Transactions using Machine Learning Classifiers and Explainability Analysis

As the use of Blockchain for digital payments continues to rise in popularity, it also becomes susceptible to various malicious attacks. Successfully detecting anomalies within Blockchain transactions is essential for bolstering trust in digital payments. However, the task of anomaly detection in Blockchain transaction data is challenging due to the infrequent occurrence of illicit transactions. Although several studies have been conducted in the field, a limitation persists: the lack of explanations for the model's predictions. This study seeks to overcome this limitation by integrating eXplainable Artificial Intelligence (XAI) techniques and anomaly rules into tree-based ensemble classifiers for detecting anomalous Bitcoin transactions. The Shapley Additive exPlanation (SHAP) method is employed to measure the contribution of each feature, and it is compatible with ensemble models. Moreover, we present rules for interpreting whether a Bitcoin transaction is anomalous or not. Additionally, we have introduced an under-sampling algorithm named XGBCLUS, designed to balance anomalous and non-anomalous transaction data. This algorithm is compared against other commonly used under-sampling and over-sampling techniques. Finally, the outcomes of various tree-based single classifiers are compared with those of stacking and voting ensemble classifiers. Our experimental results demonstrate that: (i) XGBCLUS enhances TPR and ROC-AUC scores compared to state-of-the-art under-sampling and over-sampling techniques, and (ii) our proposed ensemble classifiers outperform traditional single tree-based machine learning classifiers in terms of accuracy, TPR, and FPR scores.

Improving brain tumor classification with combined convolutional neural networks and transfer learning

Brain tumors pose a serious threat, causing the deaths of thousands of people worldwide, and can lead to life-threatening consequences when not accurately diagnosed. The classification of brain tumors and the determination of correct treatment strategies are crucial, yet this process encounters various challenges. These tumors originate from different cell types and exhibit diversity in growth rates, histological features, and genetic structures. Some may show similarities at the microscopic level, complicating classification and making diagnosis and treatment challenging. The examination of brain MR images is a widely used method in diagnosing brain tumors. However, occasional misdiagnosis of tumors can lead to ineffective responses to treatments and reduced chances of survival for patients. Traditional machine learning classifiers require manually determined features, which is quite time-consuming. On the other hand, deep learning is highly effective in feature extraction and has recently been widely preferred in classification. In this context, the effectiveness of transfer learning architectures in brain tumor diagnosis was evaluated. Six different transfer learning architectures, including ResNet-50, MobileNet, VGG16, Inception-V3, DenseNet-121, and EfficientNetV2-M, were used in this study. A public MRI dataset was used for model validation and comparison with similar studies. To address the imbalance in the number of images among classes in the dataset, data augmentation techniques such as random rotation were applied during data preprocessing. Experiments revealed that the EfficientNetV2-M model outperformed other architectures with a 98.01% accuracy rate. Additionally, the study aimed to create a new model with more comprehensive feature extraction and generalization ability by combining the advantages of multiple models in different combinations. In this context, combinations of EfficientNetV2-M architecture with Inception-V3 and DenseNet-121 architectures were formed. Through these combinations, a concatenation-based EfficientNetV2-M + Inception-V3 model achieved a 98.41% accuracy value. It was observed that the proposed concatenation-based model outperformed advanced methods in improving medical imaging techniques and patient outcomes.

Deep Learning Models for Type 2 Diabetes Detection in Saudi Arabia

One of the predominant health issues affecting Saudi Arabia and leading to many complications is Type 2 diabetes (T2D). Early detection and significant preventative measures lead to curbing and controlling the health issue. There are fewer datasets in the literature for the detection of T2D in the Saudi population. Past studies using Saudi data have favoured machine learning algorithms to classify T2D. Although the application of this data in machine learning is evident, no studies exist in the literature that compare this data, especially those related to deep learning algorithms. This study's objective is to use specific Saudi data to develop multiple deep learning models that could be used to detect T2D. The research uses a Deep Neural Network (DNN), an Autoencoder (AE), and a Convolutional Neural Network (CNN) to create predictive models and compare their performance with a traditional machine learning classifier used on the same dataset that outperformed other machine learning algorithms such as a Decision Forest (DF). Various metrics were used to evaluate the effectiveness of the models, such as accuracy, precision, recall, F1 score and area under the ROC curve (AUC) where the ROC acts as a receiver operating characteristic curve. There are two cases in this paper: (i) uses all features of the dataset and (ii) uses six of the ten features, such as DF. In case (i), the results were shown that AE outperformed other models with the highest accuracy for imbalanced and balanced data 81.12\% and 79.16\%, respectively. The results for case (ii) showed that AE scored the highest 81.01\% accuracy with imbalanced data compared to DF and DF achieved the highest accuracy of 82.1\% with balanced data. As a result, both cases explored in this study revealed that AE has a constant superior performance if imbalanced data is used. In contrast, DF demonstrated the highest accuracy when a balanced dataset was used with a feature set reduction. They help to identify the undiagnosed T2D, and they are essential for professionals in Saudi Arabia in the health sector to promote health connections, identify risks and contain or improve their diabetes management.

Performance Evaluation of Deep, Shallow and Ensemble Machine Learning Methods for the Automated Classification of Alzheimer's Disease.

Artificial intelligence (AI)-based approaches are crucial in computer-aided diagnosis (CAD) for various medical applications. Their ability to quickly and accurately learn from complex data is remarkable. Deep learning (DL) models have shown promising results in accurately classifying Alzheimer's disease (AD) and its related cognitive states, Early Mild Cognitive Impairment (EMCI) and Late Mild Cognitive Impairment (LMCI), along with the healthy conditions known as Cognitively Normal (CN). This offers valuable insights into disease progression and diagnosis. However, certain traditional machine learning (ML) classifiers perform equally well or even better than DL models, requiring less training data. This is particularly valuable in CAD in situations with limited labeled datasets. In this paper, we propose an ensemble classifier based on ML models for magnetic resonance imaging (MRI) data, which achieved an impressive accuracy of 96.52%. This represents a 3-5% improvement over the best individual classifier. We evaluated popular ML classifiers for AD classification under both data-scarce and data-rich conditions using the Alzheimer's Disease Neuroimaging Initiative and Open Access Series of Imaging Studies datasets. By comparing the results to state-of-the-art CNN-centric DL algorithms, we gain insights into the strengths and weaknesses of each approach. This work will help users to select the most suitable algorithm for AD classification based on data availability.

COVID-19 Image Classification: A Comparative Performance Analysis of Hand-Crafted vs. Deep Features

This study investigates techniques for medical image classification, specifically focusing on COVID-19 scans obtained through computer tomography (CT). Firstly, handcrafted methods based on feature engineering are explored due to their suitability for training traditional machine learning (TML) classifiers (e.g., Support Vector Machine (SVM)) when faced with limited medical image datasets. In this context, I comprehensively evaluate and compare 27 descriptor sets. More recently, deep learning (DL) models have successfully analyzed and classified natural and medical images. However, the scarcity of well-annotated medical images, particularly those related to COVID-19, presents challenges for training DL models from scratch. Consequently, I leverage deep features extracted from 12 pre-trained DL models for classification tasks. This work presents a comprehensive comparative analysis between TML and DL approaches in COVID-19 image classification.

Early and Realistic Exploitability Prediction of Just-Disclosed Software Vulnerabilities: How Reliable Can It Be?

With the rate of discovered and disclosed vulnerabilities escalating, researchers have been experimenting with machine learning to predict whether a vulnerability will be exploited. Existing solutions leverage information unavailable when a CVE is created, making them unsuitable just after the disclosure. This paper experiments with early exploitability prediction models driven exclusively by the initial CVE record, i.e., the original description and the linked online discussions. Leveraging NVD and Exploit Database, we evaluate 72 prediction models trained using six traditional machine learning classifiers, four feature representation schemas, and three data balancing algorithms. We also experiment with five pre-trained large language models (LLMs). The models leverage seven different corpora made by combining three data sources, i.e., CVE description, Security Focus , and BugTraq . The models are evaluated in a realistic , time-aware fashion by removing the training and test instances that cannot be labeled “neutral” with sufficient confidence. The validation reveals that CVE descriptions and Security Focus discussions are the best data to train on. Pre-trained LLMs do not show the expected performance, requiring further pre-training in the security domain. We distill new research directions, identify possible room for improvement, and envision automated systems assisting security experts in assessing the exploitability.

Multi-scale representation of surface-enhanced Raman, spectroscopy data for deep learning-based liver, cancer detection

The early detection of liver cancer greatly improves survival rates and allows for less invasive treatment options. As a non-invasive optical detection technique, Surface-Enhanced Raman Spectroscopy (SERS) has shown significant potential in early cancer detection, providing multiple advantages over conventional methods. The majority of existing cancer detection methods utilize multivariate statistical analysis to categorize SERS data. However, these methods are plagued by issues such as information loss during dimensionality reduction and inadequate ability to handle nonlinear relationships within the data. To overcome these problems, we first use wavelet transform with its multi-scale analysis capability to extract multi-scale features from SERS data while minimizing information loss compared to traditional methods. Moreover, deep learning is employed for classification, leveraging its strong nonlinear processing capability to enhance accuracy. In addition, the chosen neural network incorporates a data augmentation method, thereby enriching our training dataset and mitigating the risk of overfitting. Moreover, we acknowledge the significance of selecting the appropriate wavelet basis functions in SERS data processing, prompting us to choose six specific ones for comparison. We employ SERS data from serum samples obtained from both liver cancer patients and healthy volunteers to train and test our classification model, enabling us to assess its performance. Our experimental results demonstrate that our method achieved outstanding and healthy volunteers to train and test our classification model, enabling us to assess its performance. Our experimental results demonstrate that our method achieved outstanding performance, surpassing the majority of multivariate statistical analysis and traditional machine learning classification methods, with an accuracy of 99.38 %, a sensitivity of 99.8 %, and a specificity of 97.0 %. These results indicate that the combination of SERS, wavelet transform, and deep learning has the potential to function as a non-invasive tool for the rapid detection of liver cancer.

Prediction and Diagnosis of Breast Cancer Using Machine and Modern Deep Learning Models.

This research compares traditional machine learning classification methods to innovative techniques that use deep learning models. Established usual classification models such as k-Nearest Neighbors (kNN), Gradient Boosting, Support Vector Machine (SVM), Neural Network, CN2 rule inducer, Naive Bayes, Stochastic Gradient Descent (SGD), and Tree, and deep learning models such as Neural Decision Forest and Multilayer Perceptron used. The investigation, which was carried out using the Orange and Python tools, evaluates their diagnostic effectiveness in breast cancer detection. The evaluation uses UCI's publicly accessible Wisconsin Diagnostic Data Set, enabling transparency and accessibility in the study approach. The mean radius ranges from 6.981 to 28.110, while the mean texture runs from 9.71 to 39.28 in malignant and benign cases. Gradient boosting and CN2 rule inducer classifiers outperform SVM in accuracy and sensitivity, whereas SVM has the lowest accuracy and sensitivity at 88%. The CN2 rule inducer classifier achieves the greatest ROC curve score for benign and malignant breast cancer datasets, with an AUC score of 0.98%. MLP displays distinguish positive and negative classes, with a higher AUC-ROC of 0.9959. with accuracy of 96.49%, precision of 96.57%, recall of 96.49%, and an F1-Score of 96.50%. Among the most commonly used classifier models, CN2 rule and GB performed better than other models. However, MLP from deep learning produced the greatest overall performance.

Design of an Integrated Arrhythmia Detection Model using Connectivity Features and Multivariate Time Series Classification

Cardiac arrhythmia, characterized by irregular heart rhythms, represents a widespread concern within the realm of cardiology. It encompasses a range of rhythm irregularities, with some being benign and others carrying substantial health risks. Therefore, the timely detection of arrhythmia holds considerable importance. Existing methods to detect arrhythmia mainly utilize either the traditional machine learning classifiers like SVM, and random forest or the recent deep learning-based models like CNN, LSTM, and RNN for the classification while few other methods use the classical signal processing-based transforms to extract the discriminating features. This paper proposes a novel integrated approach to classify the ECG signals for arrhythmia detection. Unlike existing methods, it considers the multivariate time series nature of the input along with the interrelationships among different ECG leads. The approach utilizes multivariate time series features extracted using ROCKET (RandOM Convolutional KErnal Transform) and introduces new connectivity-based features such as correlation and coherence for improved ECG signal classification. The state-of-the-art classification performance of the proposed integrated model on the PTB-XL PhysioNet dataset attested to the efficacy of the same.

A Machine Learning Ensemble Model for the Detection of Cyberbullying

The pervasive use of social media platforms, such as Facebook, Instagram, and X, has significantly amplified our electronic interconnectedness. Moreover, these platforms are now easily accessible from any location at any given time. However, the increased popularity of social media has also led to cyberbullying.It is imperative to address the need for finding, monitoring, and mitigating cyberbullying posts on social media platforms. Motivated by this necessity, we present this paper to contribute to developing an automated system for detecting binary labels of aggressive tweets.Our study has demonstrated remarkable performance compared to previous experiments on the same dataset. We employed the stacking ensemble machine learning method, utilizing four various feature extraction techniques to optimize performance within the stacking ensemble learning framework. Combining five machine learning algorithms,Decision Trees, Random Forest, Linear Support Vector Classification, Logistic Regression, and K-Nearest Neighbors into an ensemble method, we achieved superior results compared to traditional machine learning classifier models. The stacking classifier achieved a high accuracy rate of 94.00%, outperforming traditional machine learning models and surpassing the results of prior experiments that utilized the same dataset. The outcomes of our experiments showcased an accuracy rate of 0.94% in detection tweets as aggressive or non-aggressive.

One-dimensional convolutional neural networks with infrared spectroscopy for classifying the origin of printing paper

Herein, the challenge of accurately classifying the manufacturing origin of printing paper, including continent, country, and specific product, was addressed. One-dimensional convolutional neural network (1D CNN) models trained on infrared (IR) spectrum data acquired from printing paper samples were used for the task. The preprocessing of the IR spectra through a second-derivative transformation and the restriction of the spectral range to 1800 to 1200 cm-1 improved the classification performance of the model. The outcomes were highly promising. Models trained on second-derivative IR spectra in the 1800 to 1200-cm-1 range exhibited perfect classification for the manufacturing continent and country, with an impressive F1 score of 0.980 for product classification. Notably, the developed 1D CNN model outperformed traditional machine learning classifiers, such as support vector machines and feed-forward neural networks. In addition, the application of data point attribution enhanced the transparency of the decision-making process of the model, offering insights into the spectral patterns that affect classification. This study makes a considerable contribution to printing paper classification, with potential implications for accurate origin identification in various fields.

Non-destructive identification of Pseudostellaria heterophylla from different geographical origins by Vis/NIR and SWIR hyperspectral imaging techniques.

The composition of Pseudostellaria heterophylla (Tai-Zi-Shen, TZS) is greatly influenced by the growing area of the plants, making it significant to distinguish the origins of TZS. However, traditional methods for TZS origin identification are time-consuming, laborious, and destructive. To address this, two or three TZS accessions were selected from four different regions of China, with each of these resources including distinct quality grades of TZS samples. The visible near-infrared (Vis/NIR) and short-wave infrared (SWIR) hyperspectral information from these samples were then collected. Fast and high-precision methods to identify the origins of TZS were developed by combining various preprocessing algorithms, feature band extraction algorithms (CARS and SPA), traditional two-stage machine learning classifiers (PLS-DA, SVM, and RF), and an end-to-end deep learning classifier (DCNN). Specifically, SWIR hyperspectral information outperformed Vis/NIR hyperspectral information in detecting geographic origins of TZS. The SPA algorithm proved particularly effective in extracting SWIR information that was highly correlated with the origins of TZS. The corresponding FD-SPA-SVM model reduced the number of bands by 77.2% and improved the model accuracy from 97.6% to 98.1% compared to the full-band FD-SVM model. Overall, two sets of fast and high-precision models, SWIR-FD-SPA-SVM and SWIR-FD-DCNN, were established, achieving accuracies of 98.1% and 98.7% respectively. This work provides a potentially efficient alternative for rapidly detecting the origins of TZS during actual production.

An Ensemble-Based Multi-Classification Machine Learning Classifiers Approach to Detect Multiple Classes of Cyberbullying

The impact of communication through social media is currently considered a significant social issue. This issue can lead to inappropriate behavior using social media, which is referred to as cyberbullying. Automated systems are capable of efficiently identifying cyberbullying and performing sentiment analysis on social media platforms. This study focuses on enhancing a system to detect six types of cyberbullying tweets. Employing multi-classification algorithms on a cyberbullying dataset, our approach achieved high accuracy, particularly with the TF-IDF (bigram) feature extraction. Our experiment achieved high performance compared with that stated for previous experiments on the same dataset. Two ensemble machine learning methods, employing the N-gram with TF-IDF feature-extraction technique, demonstrated superior performance in classification. Three popular multi-classification algorithms: Decision Trees, Random Forest, and XGBoost, were combined into two varied ensemble methods separately. These ensemble classifiers demonstrated superior performance compared to traditional machine learning classifier models. The stacking classifier reached 90.71% accuracy and the voting classifier 90.44%. The results of the experiments showed that the framework can detect six different types of cyberbullying more efficiently, with an accuracy rate of 0.9071.

A new imbalanced data oversampling method based on Bootstrap method and Wasserstein Generative Adversarial Network.

Due to their high bias in favor of the majority class, traditional machine learning classifiers face a great challenge when there is a class imbalance in biological data. More recently, generative adversarial networks (GANs) have been applied to imbalanced data classification. For GANs, the distribution of the minority class data fed into discriminator is unknown. The input to the generator is random noise ($ z $) drawn from a standard normal distribution $ N(0, 1) $. This method inevitably increases the training difficulty of the network and reduces the quality of the data generated. In order to solve this problem, we proposed a new oversampling algorithm by combining the Bootstrap method and the Wasserstein GAN Network (BM-WGAN). In our approach, the input to the generator network is the data ($ z $) drawn from the distribution of minority class estimated by the BM. The generator was used to synthesize minority class data when the network training is completed. Through the above steps, the generator model can learn the useful features from the minority class and generate realistic-looking minority class samples. The experimental results indicate that BM-WGAN improves the classification performance greatly compared to other oversampling algorithms. The BM-WGAN implementation is available at: https://github.com/ithbjgit1/BMWGAN.git.

A Contextual Relationship Model for Deceptive Opinion Spam Detection.

The promotion of e-commerce platforms has changed the lifestyle of several people from traditional marketing to digital marketing where businesses are made online and the concurrence reached high levels. These platforms have helped the ease of purchases while providing more advantages to the customers such as benefiting from a wide range of high-quality products, low prices, buying at any time, and more importantly supplying information and reviews about the products, and so on. Unfortunately, a plethora of companies mislead the customers to buy their products or demote the competitors' by using deceptive opinion spams which has a negative impact on the decision and the behavior of the purchasers. Deceptive opinion spams are written deliberately to seem legitimate and authentic so that to misguide or delude the customer's purchases. Consequently, the detection of these opinions is a hard task due to their nature for both humans and machines. Most of the studies are based on traditional machine learning and sparse feature engineering. However, these models do not capture the semantic aspect of reviews. According to many researchers, it is the key to the detection of deceptive opinion spam. Besides, only a few studies consider using contextual information by adopting neural networks in comparison with plenty of traditional machine learning classifiers. These models face numerous shortcomings as long as their representations are obtained while mining each review considering only words, sentences, reviews, or a combination of them, thereby classifying them based on their representations. In fact, deceptive opinions are written by the same deceivers belonging to the same companies with similar aims to promote or demolish a product. In other words, Deceptive opinion spams tend to be semantically coherent with each other. To the best of our knowledge, no model tries to obtain a representation based on the contextual relationships between opinions. This article proposes to use a capsule neural network, bidirectional long short-term memory, attention mechanism, and paragraph vector distributed bag of words to detect deceptive opinion spam. Our model provides a powerful representation of the opinions since it centers on the preservation of their contexts and the relationships between them. The results show that our model significantly outperforms the existing state-of-the-art models.

The The Classification and Segmentation of Pneumonia using Deep Learning Algorithms: A Comparative Study

The paper uses convolutional neural networks (CNNs) to analyze radiography pictures and discriminate between areas afflicted by pneumonia and normal lung tissue. A sizable dataset of annotated chest X-rays is used to train the deep learning model, which enables it to pick up on complex patterns and characteristics linked to pneumonia. Pneumonia is a significant respiratory disease that affects a large number of individuals worldwide. Timely and accurate diagnosis of pneumonia plays a crucial role in effective treatment and management of the disease. We evaluate the performance of several up-to-date convolution neural network (CNN) architectures, namely ResNet-50, VGG-16, and DenseNet-121, then compare their results with traditional machine learning classifiers. Recent advancements in deep learning methods have shown accurate results in the investigation and diagnosis of medical image data, including the detection of pneumonia. This paper examines different deep-learning methods for categorizing pneumonia from lung X-ray imagery. Our results show that deep learning techniques performed better than conventional machine learning techniques in classifying pneumonia, with an estimated accuracy of 95% across all of the examined CNN models. These results demonstrate the potential of deep learning algorithms to significantly improve the accuracy and effectiveness of pneumonia diagnosis, supporting physicians in making knowledgeable decisions about patient care.

Is Someone There or Is That the TV? Detecting Social Presence Using Sound

Social robots in the home will need to solve audio identification problems to better interact with their users. This article focuses on the classification between (a) natural conversation that includes at least one co-located user and (b) media that is playing from electronic sources and does not require a social response, such as television shows. This classification can help social robots detect a user’s social presence using sound. Social robots that are able to solve this problem can apply this information to assist them in making decisions, such as determining when and how to appropriately engage human users. We compiled a dataset from a variety of acoustic environments that contained either natural or media audio, including audio that we recorded in our own homes. Using this dataset, we performed an experimental evaluation on a range of traditional machine learning classifiers and assessed the classifiers’ abilities to generalize to new recordings, acoustic conditions, and environments. We conclude that a C-Support Vector Classification (SVC) algorithm outperformed other classifiers. Finally, we present a classification pipeline that in-home robots can utilize, and we discuss the timing and size of the trained classifiers as well as privacy and ethics considerations.

Analysis of Colorectal and Gastric Cancer Classification: A Mathematical Insight Utilizing Traditional Machine Learning Classifiers

Cancer remains a formidable global health challenge, claiming millions of lives annually. Timely and accurate cancer diagnosis is imperative. While numerous reviews have explored cancer classification using machine learning and deep learning techniques, scant literature focuses on traditional ML methods. In this manuscript, we undertake a comprehensive review of colorectal and gastric cancer detection specifically employing traditional ML classifiers. This review emphasizes the mathematical underpinnings of cancer detection, encompassing preprocessing techniques, feature extraction, machine learning classifiers, and performance assessment metrics. We provide mathematical formulations for these key components. Our analysis is limited to peer-reviewed articles published between 2017 and 2023, exclusively considering medical imaging datasets. Benchmark and publicly available imaging datasets for colorectal and gastric cancers are presented. This review synthesizes findings from 20 articles on colorectal cancer and 16 on gastric cancer, culminating in a total of 36 research articles. A significant focus is placed on mathematical formulations for commonly used preprocessing techniques, features, ML classifiers, and assessment metrics. Crucially, we introduce our optimized methodology for the detection of both colorectal and gastric cancers. Our performance metrics analysis reveals remarkable results: 100% accuracy in both cancer types, but with the lowest sensitivity recorded at 43.1% for gastric cancer.

A Fusion Framework for Confusion Analysis in Learning Based on EEG Signals

Human–computer interaction (HCI) plays a significant role in modern education, and emotion recognition is essential in the field of HCI. The potential of emotion recognition in education remains to be explored. Confusion is the primary cognitive emotion during learning and significantly affects student engagement. Recent studies show that electroencephalogram (EEG) signals, obtained through electrodes placed on the scalp, are valuable for studying brain activity and identifying emotions. In this paper, we propose a fusion framework for confusion analysis in learning based on EEG signals, combining feature extraction and temporal self-attention. This framework capitalizes on the strengths of traditional feature extraction and deep-learning techniques, integrating local time-frequency features and global representation capabilities. We acquire localized time-frequency features by partitioning EEG samples into time slices and extracting Power Spectral Density (PSD) features. We introduce the Transformer architecture to capture the comprehensive EEG characteristics and utilize a multi-head self-attention mechanism to extract the global dependencies among the time slices. Subsequently, we employ a classification module based on a fully connected layer to classify confusion emotions accurately. To assess the effectiveness of our method in the educational cognitive domain, we conduct thorough experiments on a public dataset CAL, designed for confusion analysis during the learning process. In both subject-dependent and subject-independent experiments, our method attained an accuracy/F1 score of 90.94%/0.94 and 66.08%/0.65 for the binary classification task and an accuracy/F1 score of 87.59%/0.87 and 41.28%/0.41 for the four-class classification task. It demonstrated superior performance and stronger generalization capabilities than traditional machine learning classifiers and end-to-end methods. The evidence demonstrates that our proposed framework is effective and feasible in recognizing cognitive emotions.