Improve Classification Accuracy Research Articles

Optimizing cancer classification: a hybrid RDO-XGBoost approach for feature selection and predictive insights

The identification of relevant biomarkers from high-dimensional cancer data remains a significant challenge due to the complexity and heterogeneity inherent in various cancer types. Conventional feature selection methods often struggle to effectively navigate the vast solution space while maintaining high predictive accuracy. In response to these challenges, we introduce a novel feature selection approach that integrates Random Drift Optimization (RDO) with XGBoost, specifically designed to enhance the performance of cancer classification tasks. Our proposed framework not only improves classification accuracy but also offers valuable insights into the underlying biological mechanisms driving cancer progression. Through comprehensive experiments conducted on real-world cancer datasets, including Central Nervous System (CNS), Leukemia, Breast, and Ovarian cancers, we demonstrate the efficacy of our method in identifying a smaller subset of unique and relevant genes. This selection results in significantly improved classification efficiency and accuracy. When compared with popular classifiers such as Support Vector Machine, K-Nearest Neighbor, and Naive Bayes, our approach consistently outperforms these models in terms of both accuracy and F-measure metrics. For instance, our framework achieved an accuracy of 97.24% in the CNS dataset, 99.14% in Leukemia, 95.21% in Ovarian, and 87.62% in Breast cancer, showcasing its robustness and effectiveness across different types of cancer data. These results underline the potential of our RDO-XGBoost framework as a promising solution for feature selection in cancer data analysis, offering enhanced predictive performance and valuable biological insights.

Joint hybrid recursive feature elimination based channel selection and ResGCN for cross session MI recognition

In the field of brain-computer interface (BCI) based on motor imagery (MI), multi-channel electroencephalography (EEG) data is commonly utilized for MI task recognition to achieve sensory compensation or precise human-computer interaction. However, individual physiological differences, environmental variations, or redundant information and noise in certain channels can pose challenges and impact the performance of BCI systems. In this study, we introduce a channel selection method utilizing Hybrid-Recursive Feature Elimination (H-RFE) combined with residual graph neural networks for MI recognition. This channel selection method employs a recursive feature elimination strategy and integrates three classification methods, namely random forest, gradient boosting, and logistic regression, as evaluators for adaptive channel selection tailored to specific subjects. To fully exploit the spatiotemporal information of multi-channel EEG, this study employed a graph neural network embedded with residual blocks to achieve precise recognition of motor imagery. We conducted algorithm testing using the SHU dataset and the PhysioNet dataset. Experimental results show that on the SHU dataset, utilizing 73.44% of the total channels, the cross-session MI recognition accuracy is 90.03%. Similarly, in the PhysioNet dataset, using 72.5% of the channel data, the classification result also reaches 93.99%. Compared to traditional strategies such as selecting three specific channels, correlation-based channel selection, mutual information-based channel selection, and adaptive channel selection based on Pearson coefficients and spatial positions, the proposed method improved classification accuracy by 34.64%, 10.8%, 3.25% and 2.88% on the SHU dataset, and by 46.96%, 5.04%, 5.81% and 2.32% on the PhysioNet dataset, respectively.

ASCL: Accelerating semi‐supervised learning via contrastive learning

SummarySSL (semi‐supervised learning) is widely used in machine learning, which leverages labeled and unlabeled data to improve model performance. SSL aims to optimize class mutual information, but noisy pseudo‐labels introduce false class information due to the scarcity of labels. Therefore, these algorithms often need significant training time to refine pseudo‐labels for performance improvement iteratively. To tackle this challenge, we propose a novel plug‐and‐play method named Accelerating semi‐supervised learning via contrastive learning (ASCL). This method combines contrastive learning with uncertainty‐based selection for performance improvement and accelerates the convergence of SSL algorithms. Contrastive learning initially emphasizes the mutual information between samples as a means to decrease dependence on pseudo‐labels. Subsequently, it gradually turns to maximizing the mutual information between classes, aligning with the objective of semi‐supervised learning. Uncertainty‐based selection provides a robust mechanism for acquiring pseudo‐labels. The combination of the contrastive learning module and the uncertainty‐based selection module forms a virtuous cycle to improve the performance of the proposed model. Extensive experiments demonstrate that ASCL outperforms state‐of‐the‐art methods in terms of both convergence efficiency and performance. In the experimental scenario where only one label is assigned per class in the CIFAR‐10 dataset, the application of ASCL to Pseudo‐label, UDA (unsupervised data augmentation for consistency training), and Fixmatch benefits substantial improvements in classification accuracy. Specifically, the results demonstrate notable improvements in respect of 16.32%, 6.9%, and 24.43% when compared to the original outcomes. Moreover, the required training time is reduced by almost 50%.

Graph neural networks in multi-stained pathological imaging: extended comparative analysis of Radiomic features.

This study investigates the application of Radiomic features within graph neural networks (GNNs) for the classification of multiple-epitope-ligand cartography (MELC) pathology samples. It aims to enhance the diagnosis of often misdiagnosed skin diseases such as eczema, lymphoma, and melanoma. The novel contribution lies in integrating Radiomic features with GNNs and comparing their efficacy against traditional multi-stain profiles. We utilized GNNs to process multiple pathological slides as cell-level graphs, comparing their performance with XGBoost and Random Forest classifiers. The analysis included two feature types: multi-stain profiles and Radiomic features. Dimensionality reduction techniques such as UMAP and t-SNE were applied to optimize the feature space, and graph connectivity was based on spatial and feature closeness. Integrating Radiomic features into spatially connected graphs significantly improved classification accuracy over traditional models. The application of UMAP further enhanced the performance of GNNs, particularly in classifying diseases with similar pathological features. The GNN model outperformed baseline methods, demonstrating its robustness in handling complex histopathological data. Radiomic features processed through GNNs show significant promise for multi-disease classification, improving diagnostic accuracy. This study's findings suggest that integrating advanced imaging analysis with graph-based modeling can lead to better diagnostic tools. Future research should expand these methods to a wider range of diseases to validate their generalizability and effectiveness.

Analytical Neural Network System for the Helicopter Turboshaft Engines Operating Modes Classification

A novel neural network-based analytical system has been developed for classifying helicopter turboshaft engine operating modes during flight operations. This system utilizes a neural network architecture comprising an input layer with three neurons, two fully connected hidden layers, and an output layer with two neurons. The proposed approach demonstrates an exceptional recognition accuracy of 0.997 (99.7%) across steady-state, unsteady, and transient operating modes of helicopter turboshaft engines. A new method for training this neural network has been introduced, employing forward propagation, loss calculation, backpropagation, and weight updates, enhanced by an adaptive learning rate and the cross-entropy function as the loss criterion. The method also incorporates a novel modified Smooth ReLU activation function for hidden layer neurons. This innovation led to a near-perfect accuracy in network training and reduced the loss to 0.025 (2.5%), highlighting the high quality and reliability of the neural network in classifying engine operating modes during flight. Furthermore, it has been empirically shown that the application of this neural network significantly reduces type I errors by a factor of 2.09 to 2.14 and type II errors by 2.05 to 2.21 times compared to traditional classifiers based on ART-1 and BAM networks. This advancement marks a substantial improvement in classification accuracy and error minimization for helicopter turboshaft engine operating modes.

ISMOTE: A More Accurate Alternative for SMOTE

Classification models trained on imbalanced datasets tend to be biased towards the majority category, resulting in reduced accuracy for minority categories. A common approach to address this problem is to generate artificial data for underrepresented categories. The Synthetic Minority Over-sampling Technique (SMOTE) algorithm and its variants are widely used for this purpose. In this paper, we propose a modification to the data generation mechanism called Iteration-based SMOTE (ISMOTE). Unlike SMOTE, the ISMOTE algorithm trains the data for multiple iterations. In each iteration, the model generates new samples in the vicinity of appropriately misclassified data. These new samples are then fed into the classification model, thus improving classification accuracy over the course of multiple iterations. We compare the performance of ISMOTE with SMOTE and other commonly used oversampling algorithms. Our empirical results demonstrate that ISMOTE significantly improves the quality of the generated data compared to other oversampling methods. Additionally, we conduct experiments to verify the effect of parameters on the model and provide suggestions for choosing appropriate values to improve performance.

Fish feeding behavior quantification and automatic acoustic event detection: algorithmic optimization with deep learning

In recent years, the integration of sensor processing technologies with intelligent feeding control systems has become crucial for enhancing recirculating aquaculture systems (RAS). Intelligent feeding control significantly improves profitability and animal welfare in aquaculture by accurately monitoring feed intake and reducing waste. Acoustic methods have proven effective in automating feed monitoring, particularly in assessing feeding intensity. Automatic Audio Event Detection (AED) holds promise for identifying sound events associated with feeding activities, enabling precise monitoring of feeding behavior and estimation of feed consumption through frequency-based feeding signatures. Advancements in sensor technologies and computational capabilities enable real-time collection, processing, and analysis of acoustic data. However, handling high volumes of data with minimal latency and high accuracy poses challenges. To address these challenges, we propose a systematic approach: (1) Data preprocessing using wavelet transforms enhances efficiency and reduces computational overhead. (2) Data pruning focuses on informative features and reduces input data dimensionality, improving classification accuracy. (3) We adopt a weakly-labeled semi-supervised learning model with Convolutional Neural Networks (CNNs) to detect feeding events, improving classification performance. (4) Ensemble learning combines multiple classifiers to mitigate overfitting and enhance model generalization. Our methodology shows promise in accurately quantifying fish feeding behavior using acoustic signals.

Developing of a multi-angle and varied walking conditions dataset for human gait recognition

The field of Human Gait Recognition (HGR) leverages unique walking patterns for non-invasive, discreet biometric identification. This study highlights the importance of comprehensive datasets in the development, testing, and validation of HGR algorithms. While current datasets, such as those from Carnegie Mellon University Motion of Body (CMU MoBo), Southampton (SOTON), Chinese Academic of Science Institute of Automation (CASIA B), and Osaka University Institute of Scientific Industrial Research (OU-ISIR), have advanced in scale and complexity, they often lack diversity and comprehensive sample representation. To address this gap, we introduce the TecNM Gait-DS dataset (Tecnologico Nacional de Mexico), specifically designed for Latin American populations, featuring 13 viewing angles and five walking variations. Utilizing a Self-Supervised Vision Transformer DINO (Deeper Into Neural Networks) model for view angle classification, our evaluation demonstrates significant improvements in classification accuracy. This dataset not only enhances sample diversity but also supports the development of more robust HGR systems. Our results underscore the potential for improved accuracy and ethical considerations in HGR, advocating for ongoing refinement of datasets to achieve optimal performance and societal acceptance.

Remote sensing scene classification based on contextual attention mechanism of lie group space

ABSTRACT High-resolution remote sensing (HRRS) scene classification is based on the semantic information in the image and its contextual spatial correlation, labelling different semantic categories for different HRRS. Convolutional neural networks (CNN) have been widely studied and applied in remote sensing scene classification in recent years. However, most of the existing CNN models focus on the global and high-level semantic features, ignoring the shallower feature information. In addition, complex background information and variable scales lead to a series of problems with large intra-class differences and high inter-class similarities, which also brings challenges to scene classification. To address the above problems and challenges, a scenario classification model based on the contextual spatial attention and channel attention mechanism of Lie Group manifold space learning is proposed in this study. In this model, we fully explore the multi-scale features of the scene (shallower-level and high-level) and propose a novel contextual spatial attention mechanism and channel attention mechanism. Extensive experimentation was carried out on the Union Remote Sensing Image Data Set (URSIS), which improved by 7.13% compared with the classical model. The experimental results showed that compared with other state-of-the-art remote sensing scene classification models, our proposed method has achieved significant improvement in classification accuracy and performance.

IMOABC: An efficient multi-objective filter-wrapper hybrid approach for high-dimensional feature selection

With the development of data science, the challenge of high-dimensional data has become increasingly prevalent. High-dimensional data contains a significant amount of redundant information, which can adversely affect the performance and effectiveness of machine learning algorithms. Therefore, it is necessary to select the most relevant features from the raw data and perform feature selection on high-dimensional data. In this paper, a novel filter-wrapper feature selection method based on an improved multi-objective artificial bee colony algorithm (IMOABC) is proposed to address the feature selection problem in high-dimensional data. This method simultaneously considers three objectives: feature error rate, feature subset ratio, and distance, effectively improving the efficiency of obtaining the optimal feature subset on high-dimensional data. Additionally, a novel Fisher Score-based initialization strategy is introduced, significantly enhancing the quality of solutions. Furthermore, a new dynamic adaptive strategy is designed, effectively improving the algorithm’s convergence speed and enhancing its global search capability. Comparative experimental results on microarray cancer datasets demonstrate that the proposed method significantly improves classification accuracy and effectively reduces the size of the feature subset when compared to various traditional and state-of-the-art multi-objective feature selection algorithms. IMOABC improves the classification accuracy by 2.27% on average compared to various multi-objective feature selection methods, while reducing the number of selected features by 88.76% on average. Meanwhile, IMOABC shows an average improvement of 4.24% in classification accuracy across all datasets, with an average reduction of 76.73% in the number of selected features compared to various traditional methods.

Leveraging deep learning for coastal monitoring: A VGG16-based approach to spectral and textural classification of coastal areas with sentinel-2A data

Coastal ecosystems are vital for the planet's health, providing essential habitats for diverse species and supporting human communities. However, these complex environments face increasing threats from climate change and human activities. Effective monitoring of these areas requires large-scale, efficient, and accurate methods. This study explores the potential of deep learning for automated coastal land cover classification using Sentinel-2A satellite imagery on the Google Earth Engine (GEE) platform. We investigate the impact of transfer learning and spectral band combinations on classification accuracy for five coastal types: artificial, bedrock, sandy, muddy, and vegetation-covered. Our findings demonstrate that a pre-trained VGG16 Convolutional Neural Network (CNN) with transfer learning significantly improves classification accuracy (average 19.3% increase) compared to using default weights. Notably, including the near-infrared (NIR) band in training data leads to superior results, particularly for artificial and bedrock coastlines, where the NIR band's effectiveness in separating land-water boundaries enhances classification accuracy. These results highlight the potential of deep learning for large-scale, automated coastal monitoring, informing applications in sustainable fisheries management, coastal vulnerability assessment, and marine ecosystem conservation.

Assessing Land-Cover Changes in the Natural Park ‘Fragas do Eume’ over the Last 25 Years: Insights from Remote Sensing and Machine Learning

The ‘Fragas do Eume’ Natural Park includes one of the best-preserved Atlantic forests in Europe. These forests are part of the Natura 2000 Network. This scientific study focuses on analysing land-cover changes in the ‘Fragas do Eume’ Natural Park (NW Spain) over a 25-year period, from 1997 to 2022, using machine learning techniques for the classification of satellite images. Several image processing operations were carried out to correct radiometry, followed by supervised classification techniques with previously defined training areas. Five multispectral indices were used to improve classification accuracy, and their correlation was evaluated. Land-cover changes were analysed, with special attention to the transitions between eucalyptus plantations and native deciduous forests. A significant increase in eucalyptus plantations (48.2%) (Eucalyptus globulus Labill.) was observed, while native deciduous forests experienced a decrease in their extent (17.6%). This transformation of the landscape affected not only these two habitats, but also cropland and scrubland areas, both of which increased. Our results suggest that the lack of effective conservation policies and the economic interest of fast-growing tree plantations could explain the loss of native deciduous forests. The results highlight the need to implement pro-active and sustainable management measures to protect these natural forest ecosystems in the ‘Fragas do Eume’ Natural Park.

Hierarchical Semi-Supervised Approach for Classifying Activities of Workers Utilising Indoor Trajectory Data

Activity recognition refers to the process of automatically identifying or interpreting activities of objects based on the data captured from different sensing devices. While previous research on indoor activity recognition predominantly relies on visual data like images or video recordings, we present a novel approach based on spatiotemporal trajectory data recorded by IoT based sensors. The proposed approach is tailored for indoor manufacturing applications leveraging trajectory partitioning, hierarchical clustering, and convolutional neural networks. Moreover, a vast majority of activity recognition models that have been used in different industrial settings are supervised methods requiring large manually labelled datasets to be collected. This manual annotation process is unwieldly and labour-intensive, and hence, often infeasible to deploy for practical applications. In contrast, our proposed activity recognition approach is semi-supervised meaning it can be trained with far less labelled data; significantly reducing the effort and costs associated with the manual annotation process. The proposed approach is evaluated using two indoor trajectory datasets related to different manufacturing assembly processes. Experimental results demonstrate its effectiveness for activity recognition: the classification accuracy (measured using F-score) varies between 0.81 to 0.95 and 0.88 to 0.92 across indoor trajectory datasets. A comparison with a baseline model indicates that it achieves up to a 18% improvement in classification accuracy. Furthermore, the classification results enable insights into factory floor states, aiding in decision-making for operational efficiency and resource allocation.

A Novel Brain Network Analysis Method for Pediatric ADHD Using RFE-GA Feature Selection Strategy.

Attention Deficit Hyperactivity Disorder (ADHD) is a highly prevalent childhood disorder, and related research has been increasing in recent years. However, it remains a challenging issue to accurately identify individuals with ADHD. The research proposes a method for ADHD detection using Recursive Feature Elimination-Genetic Algorithm (RFE-GA) for the feature selection of EEG data. Firstly, this study employed Transfer Entropy (TE) to construct brain networks from the EEG data of the ADHD and Normal groups, conducting an analysis of effective connectivity to unveil causal relationships in the brain's information exchange activities. Subsequently, a dual-layer feature selection method combining Recursive Feature Elimination (RFE) and Genetic Algorithm (GA) was proposed. Using the global search capability of GA and the feature selection ability of RFE, the performance of each feature subset is evaluated to find the optimal feature subset. Finally, a Support Vector Machine (SVM) classifier was employed to classify the ultimate feature set. The results revealed the control group exhibited lower connectivity strength in the left temporal alpha and beta bands, but higher frontal connectivity strength compared to the ADHD group. Additionally, in the gamma frequency band, the control group had higher top lobe connectivity strength than the ADHD group. Through the RFE-GA feature selection method, the optimized feature set was more concise, achieving classification accuracies of 91.3%, 94.1%, and 90.7% for the alpha, beta, and gamma frequency bands, respectively. The proposed RFE-GA feature selection method significantly reduced the number of features, thereby improving classification accuracy.&#xD.

Classification of BPG-Based Lossy Compressed Noisy Images

Acquired remote sensing images can be noisy. This fact has to be taken into account in their lossy compression and classification. In particular, a specific noise filtering effect is usually observed due to lossy compression and this can be positive for classification. Classification can be also influenced by methodology of classifier learning. In this paper, we consider peculiarities of lossy compression of three-channel noisy images by better portable graphics (BPG) encoder and their further classification. It is demonstrated that improvement of data classification accuracy is not observed if a given image is compressed in the neighborhood of optimal operation point (OOP) and the classifier training is performed for the noisy image. Performance of neural network based classifier is studied. As demonstrated, its training for compressed remote sensing data is able to provide certain benefits compared to training for noisy (uncompressed) data. Examples for Sentinel data used in simulations are offered.

Dementia Classification Approach Based on Non-Singleton General Type-2 Fuzzy Reasoning

Dementia is the most critical neurodegenerative disease that gradually destroys memory and other cognitive functions. Therefore, early detection is essential, and to build an effective detection model, it is required to understand its type, symptoms, stages and causes, and diagnosis methodologies. This paper presents a novel approach to classify dementia based on a data set with some relevant patient features. The classification methodology employs non-singleton general type-2 fuzzy sets, non-singleton interval type-2 fuzzy sets, and non-singleton type 1 fuzzy sets. These advanced fuzzy sets are compared with traditional singleton fuzzy sets to evaluate their performance. The Takagi–Sugeno–Kang TSK inference method is used to handle fuzzy reasoning. In the process, the parameters of the membership functions (MFs) and rules are obtained using ANFIS, and non-singleton MFs are optimized with PSO. The results demonstrate that non-singleton general type-2 fuzzy sets improve classification accuracy compared to singleton fuzzy sets, demonstrating their ability to model the uncertainties inherent in the diagnosis of dementia. This improvement suggests that non-singleton fuzzy systems offer a more robust framework for developing effective diagnostic tools in the medical domain. Accurate classification of dementia is of utmost importance to improve patient care and advance medical research.

Adaptive boundary-aware artificial immune recognition system for data classification

In this paper, we introduce AIBARS (Adaptive Immune Boundary-Aware Recognition System), a novel learning algorithm designed to improve upon the traditional Artificial Immune Recognition System (AIRS). AIBARS addresses key limitations of AIRS by integrating a boundary-aware stimulation measure, an antigen-specific stopping criterion, and a more directed mutation approach. These innovations enable AIBARS to effectively navigate complex decision boundaries and reduce time complexity, particularly in high-dimensional datasets. Experimental results show that AIBARS achieves a 5-10% improvement in classification accuracy compared to AIRS. Additionally, AIBARS reduces memory cells by 20-30%, leading to more efficient data representation and a 15-25% reduction in computational costs. The algorithm also reduces processing time by 10-20%, making it a more efficient approach overall. Evaluations were conducted using a variety of datasets, including public domain datasets from the UCI Machine Learning Repository and synthetic datasets. The results indicate that AIBARS offers significant performance and efficiency gains over AIRS, while substantially reducing computational expenses.

Extraction of Maize Distribution Information Based on Critical Fertility Periods and Active–Passive Remote Sensing

This study proposes a new method for integrating active and passive remote sensing data during critical reproductive periods in order to extract maize areas early and to address the problem of low accuracy in the classification of maize-growing areas affected by climate change. Focusing on Jiaozuo City, this study utilized active–passive remote sensing images to determine the optimal time for maize identification. The relative importance of features was assessed using a feature selection method combined with a machine learning algorithm, the impact of both single-source and multi-source features on accuracy was analyzed to generate the optimal feature subset, and the classification accuracies of different machine learning classification methods for maize at the tasseling stage were compared. Ultimately, this study identified the most effective remote sensing features and methods for maize detection during the optimal fertility period. The experimental results show that the feature set optimized for the tasseling stage significantly enhanced maize recognition accuracy. Specifically, the random forest (RF) method, when applied to the multi-source data fusion feature set, yielded the highest accuracy, improving classification accuracy by 24.6% and 4.86% over single-source features, and achieving an overall accuracy of 93.38% with a Kappa coefficient of 0.91. Data on the study area’s maize area were also extracted for the years 2018–2022, with accuracy values of 93.83%, 98.77%, 97%, and 98.05%, respectively.

Geometry of Textual Data Augmentation: Insights from Large Language Models

Data augmentation is crucial for enhancing the performance of text classification models when labelled training data are scarce. For natural language processing (NLP) tasks, large language models (LLMs) are able to generate high-quality augmented data. But a fundamental understanding of the reasons for their effectiveness remains limited. This paper presents a geometric and topological perspective on textual data augmentation using LLMs. We compare the augmentation data generated by GPT-J with those generated through cosine similarity from Word2Vec and GloVe embeddings. Topological data analysis reveals that GPT-J generated data maintains label coherence. Convex hull analysis of such data represented by their two principal components shows that they lie within the spatial boundaries of the original training data. Delaunay triangulation reveals that increasing the number of augmented data points that are connected within these boundaries correlates with improved classification accuracy. These findings provide insights into the superior performance of LLMs in data augmentation. A framework for predicting the usefulness of augmentation data based on geometric properties could be formed based on these techniques.

Enhancing EEG-Based MI-BCIs with Class-Specific and Subject-Specific Features Detected by Neural Manifold Analysis.

This paper presents an innovative approach leveraging Neuronal Manifold Analysis of EEG data to identify specific time intervals for feature extraction, effectively capturing both class-specific and subject-specific characteristics. Different pipelines were constructed and employed to extract distinctive features within these intervals, specifically for motor imagery (MI) tasks. The methodology was validated using the Graz Competition IV datasets 2A (four-class) and 2B (two-class) motor imagery classification, demonstrating an improvement in classification accuracy that surpasses state-of-the-art algorithms designed for MI tasks. A multi-dimensional feature space, constructed using NMA, was built to detect intervals that capture these critical characteristics, which led to significantly enhanced classification accuracy, especially for individuals with initially poor classification performance. These findings highlight the robustness of this method and its potential to improve classification performance in EEG-based MI-BCI systems.