Classifier Fusion Research Articles

Intrusion Detection System with Ensemble Machine Learning Approaches using VotingClassifier

Internets have become a part of our everyday life due to the advancement in the electronics and signal processing technologies during past decades. The tremendous growth of internet leads towards the network threats. Many times firewalls and anti-viruses fails to manage the network because of this Intrusion Detection System (IDS) comes to assists us. In this paper we use IDS with Ensemble methodologies utilized in machine learning involve the fusion of multiple classifiers to improve predictive performance, while voting classifiers combine predictions from individual models to reach conclusive decisions. The paper employs a voting ensemble method combing decision tree, logistic regression and support vector machine classifier models. We test our proposedmodel to classify the NSL-KDD dataset. Our ensemble methodologies of proposed algorithmproduce a good result.

Topology-Aware Multimodal Fusion for Neural Dynamics Representation Learning and Classification

Topology-Aware Multimodal Fusion for Neural Dynamics Representation Learning and Classification

Coupled Multimodal Emotional Feature Analysis Based on Broad-Deep Fusion Networks in Human-Robot Interaction.

A coupled multimodal emotional feature analysis (CMEFA) method based on broad-deep fusion networks, which divide multimodal emotion recognition into two layers, is proposed. First, facial emotional features and gesture emotional features are extracted using the broad and deep learning fusion network (BDFN). Considering that the bi-modal emotion is not completely independent of each other, canonical correlation analysis (CCA) is used to analyze and extract the correlation between the emotion features, and a coupling network is established for emotion recognition of the extracted bi-modal features. Both simulation and application experiments are completed. According to the simulation experiments completed on the bimodal face and body gesture database (FABO), the recognition rate of the proposed method has increased by 1.15% compared to that of the support vector machine recursive feature elimination (SVMRFE) (without considering the unbalanced contribution of features). Moreover, by using the proposed method, the multimodal recognition rate is 21.22%, 2.65%, 1.61%, 1.54%, and 0.20% higher than those of the fuzzy deep neural network with sparse autoencoder (FDNNSA), ResNet-101 + GFK, C3D + MCB + DBN, the hierarchical classification fusion strategy (HCFS), and cross-channel convolutional neural network (CCCNN), respectively. In addition, preliminary application experiments are carried out on our developed emotional social robot system, where emotional robot recognizes the emotions of eight volunteers based on their facial expressions and body gestures.

Morphological and Textural Data Fusion for Breast Cancer Classification Based on Inter and Intra group Variances

Morphological and Textural Data Fusion for Breast Cancer Classification Based on Inter and Intra group Variances

MOX-NET: Multi-stage deep hybrid feature fusion and selection framework for monkeypox classification

Background:Monkeypox virus has quickly expanded throughout several nations, raising serious public health concerns. Lack of precautionary measures raises concerns about the possibility of global pandemic. As a result, early detection of monkeypox is essential for efficient diagnosis and treatment before broad community transmission. Artificial intelligence (AI) and machine learning (ML) have recently shown tremendous promise in early monkeypox diagnosis using image-based diagnoses methods. But, challenges such as low contrast lesions, overloaded datasets, high memory complexity, and redundant feature extraction still need to be addressed. Methods:This work proposes a coalesced CAD system for monkeypox classification using a deep learning framework. The proposed approach includes multiple stages: First, the given dataset images are pre-processed by a proposed fusion-based contrast enhancement method. Second, six pre-trained deep learning models i.e., Vision Transformers (ViT), Shifted Windows (Swin) Transformers, ResNet-50, ResNet-101, EfficientNetV2, and ConvNeXt-V2 are modified and transfer learning is used for training. Third, from all the deep learning networks, the deep feature vectors are acquired and integrated through the convolutional sparse image decomposition fusion strategy. Subsequently, an entropy-controlled firefly feature selection approach is applied to identify the most suitable features for classification. Lastly, the multi-class support vector machine is utilized to classify the input data based on the selected features. Results:The proposed algorithm utilized the MSLID dataset and obtained an accuracy of 98.64% which is better than other state-of-the-art works. Conclusions:Experimental outcomes reveals that the proposed monkeypox classification algorithm outperforms well-established existing algorithms in both visual and quantitative evaluations, resulting in improved accuracy.

Hybrid deep spatial and statistical feature fusion for accurate MRI brain tumor classification.

The classification of medical images is crucial in the biomedical field, and despite attempts to address the issue, significant challenges persist. To effectively categorize medical images, collecting and integrating statistical information that accurately describes the image is essential. This study proposes a unique method for feature extraction that combines deep spatial characteristics with handmade statistical features. The approach involves extracting statistical radiomics features using advanced techniques, followed by a novel handcrafted feature fusion method inspired by the ResNet deep learning model. A new feature fusion framework (FusionNet) is then used to reduce image dimensionality and simplify computation. The proposed approach is tested on MRI images of brain tumors from the BraTS dataset, and the results show that it outperforms existing methods regarding classification accuracy. The study presents three models, including a handcrafted-based model and two CNN models, which completed the binary classification task. The recommended hybrid approach achieved a high F1 score of 96.12 ± 0.41, precision of 97.77 ± 0.32, and accuracy of 97.53 ± 0.24, indicating that it has the potential to serve as a valuable tool for pathologists.

A multi-scale semantic feature fusion method for remote sensing crop classification

The efficient and accurate acquisition of crop spatial planting structure information is of great significance to ensure national food security. Current crop classification studies have still not achieved optimal results in accurate crop classification identification due to the complex heterogeneous details of clear images and insufficient analysis and utilization of information. This study takes the Yuncheng-Linfen Basin in Shanxi, China as the study area and uses the ReliefF-RFE feature selection algorithm to achieve data dimensionality reduction. Contextual semantic feature aggregation, spatial channel attention mechanism, and hierarchical refinement strategy are used to fuse the multi-scale feature information in the extracted remote sensing images from the top down and bottom up. This study shows that 1) the ReliefF-RFE algorithm can effectively reduce the dimensionality of 224-dimensional multisource features and generate a 31-dimensional optimal feature space subset with strong interpretation to improve the computational efficiency of the model; 2) the multi-scale feature fusion model constructed in this study is better than UNet, ResNet, DeepLabv3+, HRNet and Swin Transformer in classification recognition of winter wheat and corn, with an overall accuracy of 95.76% and 93.44%; 3) A multiple feature fusion strategy designed through ablation experiments was evaluated to evaluate the reasonableness of each module and validate the irreplaceability and superiority of the model for improving crop accuracy in complex and heterogeneous terrain; 4) the multi-scale feature fusion model converts deep abstract features into local detail information by cross-scale contextual aggregation of deep and shallow multi-scale features, it obtains good extraction effect on fragmented small plots, and the reduction of local fine details of features is significantly better than other models. The multi-scale feature fusion classification model constructed in this study fully considers the interpretability of the input features and fuses the semantic features at different scales to eliminate the “semantic gap”, which shows that the model has strong stability and robustness and provides a reference for fast and accurate mapping of Sentinel-2 images of crops in large areas.

Research on image recognition of tomato leaf diseases based on improved AlexNet model

Aiming at the problems that the traditional image recognition technology is challenging to extract useful features and the recognition time is extended; the AlexNet model is improved to improve the effect of image classification and recognition. This study focuses on 8 types of tomato leaf diseases and healthy leaves. By using HOG and LBP weighted fusion to extract image features, a tomato leaf disease recognition model based on the AlexNet model is proposed, and transfer learning is used to train the AlexNet model. Transfer the knowledge learned by the AlexNet model on the PlantVillage image dataset to this model while reducing the number of fully connected layers. Keras deep learning framework and programming language Python were used. The model was implemented, and the classification and identification of tomato leaf diseases were carried out. The recognition rate of feature-weighted fusion classification is higher than that of serial and parallel methods, and the recognition time is the shortest. When the weight coefficient ratio of HOG and LBP is 3:7, the image recognition rate is the highest, and its value is 97.2 %. From the model performance curve See, when the number of iterations is more than 150 times, the training set and test accuracy rate both exceed 97 %, the loss rate shows a gradient decline, and the change is relatively stable; compared with the traditional AlexNet model, HOG + LBP + SVM model, and VGG model, improved AlexNet model has the highest recognition rate, and it has high recall value, accuracy, and F1 value; Compared with the latest convolutional neural network disease recognition models, improved AlexNet model recognition accuracy was 98.83 %, and the F1 value was 0.994. It shows that the model has good convergence performance, fast prediction speed, and low loss rate and can effectively identify 8 types of tomato leaf images, which provides a reference for the research on crop disease identification.

Multi-fidelity fusion for soil classification via LSTM and multi-head self-attention CNN model

An effective soil classification method is essential for soil stratigraphy interpretation. Traditional methods rely on classification systems in design codes or empirical formulae based on single source data, which may not be accurate or suitable for every site. Recent advancements in data fusion techniques and deep learning have shown promising results in a wide range of practical domains, which provides motivation to explore its potential application in soil classification. To that end, this paper introduces a novel machine learning architecture using boosting long-short term memory (LSTM) machine to map low fidelity cone penetration test (CPT) data to high fidelity laboratory test (LT) data which are then fused and fed into a multi-head self-attention convolutional neural network (MSCNN) for soil classification. A rigorous loss function is developed to train a LSTM-MSCNN model in an end-to-end workflow. The MSCNN classifier is benchmarked against traditional machine learning methods to demonstrate its superior outperformance, with ablation analyses exploring the related merits of the attention mechanism and the influence of attention heads on classification results. The results reveal a significant improvement in the prediction of true ground profiles using the proposed LSTM-MSCNN model over conventional methods.

Dual Stream Long Short-Term Memory Feature Fusion Classifier for Surface Electromyography Gesture Recognition.

Gesture recognition using electromyography (EMG) signals has prevailed recently in the field of human-computer interactions for controlling intelligent prosthetics. Currently, machine learning and deep learning are the two most commonly employed methods for classifying hand gestures. Despite traditional machine learning methods already achieving impressive performance, it is still a huge amount of work to carry out feature extraction manually. The existing deep learning methods utilize complex neural network architectures to achieve higher accuracy, which will suffer from overfitting, insufficient adaptability, and low recognition accuracy. To improve the existing phenomenon, a novel lightweight model named dual stream LSTM feature fusion classifier is proposed based on the concatenation of five time-domain features of EMG signals and raw data, which are both processed with one-dimensional convolutional neural networks and LSTM layers to carry out the classification. The proposed method can effectively capture global features of EMG signals using a simple architecture, which means less computational cost. An experiment is conducted on a public DB1 dataset with 52 gestures, and each of the 27 subjects repeats every gesture 10 times. The accuracy rate achieved by the model is 89.66%, which is comparable to that achieved by more complex deep learning neural networks, and the inference time for each gesture is 87.6 ms, which can also be implied in a real-time control system. The proposed model is validated using a subject-wise experiment on 10 out of the 40 subjects in the DB2 dataset, achieving a mean accuracy of 91.74%. This is illustrated by its ability to fuse time-domain features and raw data to extract more effective information from the sEMG signal and select an appropriate, efficient, lightweight network to enhance the recognition results.

Fusion of Google Street View, LiDAR, and Orthophoto Classifications Using Ranking Classes Based on F1 Score for Building Land-Use Type Detection

Building land-use type classification using earth observation data is essential for urban planning and emergency management. Municipalities usually do not hold a detailed record of building land-use types in their jurisdictions, and there is a significant need for a detailed classification of this data. Earth observation data can be beneficial in this regard, because of their availability and requiring a reduced amount of fieldwork. In this work, we imported Google Street View (GSV), light detection and ranging-derived (LiDAR-derived) features, and orthophoto images to deep learning (DL) models. The DL models were trained on building land-use type data for the Greater Toronto Area (GTA). The data was created using building land-use type labels from OpenStreetMap (OSM) and web scraping. Then, we classified buildings into apartment, house, industrial, institutional, mixed residential/commercial, office building, retail, and other. Three DL-derived classification maps from GSV, LiDAR, and orthophoto images were combined at the decision level using the proposed ranking classes based on the F1 score method. For comparison, the classifiers were combined using fuzzy fusion as well. The results of two independent case studies, Vancouver and Fort Worth, showed that the proposed fusion method could achieve an overall accuracy of 75%, up to 8% higher than the previous study using CNNs and the same ground truth data. Also, the results showed that while mixed residential/commercial buildings were correctly detected using GSV images, the DL models confused many houses in the GTA with mixed residential/commercial because of their similar appearance in GSV images.

The clinical and imaging data fusion model for single-period cerebral CTA collateral circulation assessment.

The Chinese population ranks among the highest globally in terms of stroke prevalence. In the clinical diagnostic process, radiologists utilize computed tomography angiography (CTA) images for diagnosis, enabling a precise assessment of collateral circulation in the brains of stroke patients. Recent studies frequently combine imaging and machine learning methods to develop computer-aided diagnostic algorithms. However, in studies concerning collateral circulation assessment, the extracted imaging features are primarily composed of manually designed statistical features, which exhibit significant limitations in their representational capacity. Accurately assessing collateral circulation using image features in brain CTA images still presents challenges. To tackle this issue, considering the scarcity of publicly accessible medical datasets, we combined clinical data with imaging data to establish a dataset named RadiomicsClinicCTA. Moreover, we devised two collateral circulation assessment models to exploit the synergistic potential of patients' clinical information and imaging data for a more accurate assessment of collateral circulation: data-level fusion and feature-level fusion. To remove redundant features from the dataset, we employed Levene's test and T-test methods for feature pre-screening. Subsequently, we performed feature dimensionality reduction using the LASSO and random forest algorithms and trained classification models with various machine learning algorithms on the data-level fusion dataset after feature engineering. Experimental results on the RadiomicsClinicCTA dataset demonstrate that the optimized data-level fusion model achieves an accuracy and AUC value exceeding 86% . Subsequently, we trained and assessed the performance of the feature-level fusion classification model. The results indicate the feature-level fusion classification model outperforms the optimized data-level fusion model. Comparative experiments show that the fused dataset better differentiates between good and bad side branch features relative to the pure radiomics dataset. Our study underscores the efficacy of integrating clinical and imaging data through fusion models, significantly enhancing the accuracy of collateral circulation assessment in stroke patients.

PARKINSON'S DISEASE CLASSIFICATION USING CONTRASTIVE GRAPH CROSS-VIEW LEARNING WITH MULTIMODAL FUSION OF SPECT IMAGES AND CLINICAL FEATURES.

Parkinson's Disease (PD) affects millions globally, impacting movement. Prior research utilized deep learning for PD prediction, primarily focusing on medical images, neglecting the data's underlying manifold structure. This work proposes a multimodal approach encompassing both image and non-image features, leveraging contrastive cross-view graph fusion for PD classification. We introduce a novel multimodal co-attention module, integrating embeddings from separate graph views derived from low-dimensional representations of images and clinical features. This enables more robust and structured feature extraction for improved multi-view data analysis. Additionally, a simplified contrastive loss-based fusion method is devised to enhance cross-view fusion learning. Our graph-view multimodal approach achieves an accuracy of 91% and an area under the receiver operating characteristic curve (AUC) of 92.8% in five-fold cross-validation. It also demonstrates superior predictive capabilities on non-image data compared to solely machine learning-based methods.

Infrasound Event Classification Fusion Model Based on Multiscale SE-CNN and BiLSTM

Infrasound Event Classification Fusion Model Based on Multiscale SE-CNN and BiLSTM

Isolated sign language recognition through integrating pose data and motion history images

This article presents an innovative approach for the task of isolated sign language recognition (SLR); this approach centers on the integration of pose data with motion history images (MHIs) derived from these data. Our research combines spatial information obtained from body, hand, and face poses with the comprehensive details provided by three-channel MHI data concerning the temporal dynamics of the sign. Particularly, our developed finger pose-based MHI (FP-MHI) feature significantly enhances the recognition success, capturing the nuances of finger movements and gestures, unlike existing approaches in SLR. This feature improves the accuracy and reliability of SLR systems by more accurately capturing the fine details and richness of sign language. Additionally, we enhance the overall model accuracy by predicting missing pose data through linear interpolation. Our study, based on the randomized leaky rectified linear unit (RReLU) enhanced ResNet-18 model, successfully handles the interaction between manual and non-manual features through the fusion of extracted features and classification with a support vector machine (SVM). This innovative integration demonstrates competitive and superior results compared to current methodologies in the field of SLR across various datasets, including BosphorusSign22k-general, BosphorusSign22k, LSA64, and GSL, in our experiments.

Acute Promyelocytic Leukemia With Torque Teno Mini Virus::RARA Fusion: An Approach to Screening and Diagnosis

Acute promyelocytic leukemia (APL) with variant RARA translocation is linked to over 15 partner genes. Recent publications encompassing 6 cases have expanded the spectrum of RARA partners to torque teno mini virus (TTMV). This entity is likely underrecognized due to the lack of clinician and pathologist familiarity, inability to detect the fusion using routine testing modalities, and informatic challenges in its recognition within next-generation sequencing (NGS) data. We describe a clinicopathologic approach and provide the necessary tools to screen and diagnose APL with TTMV::RARA using existing clinical DNA- or RNA-based NGS assays, which led to the identification of 4 cases, all without other known cytogenetic/molecular drivers. One was identified prospectively and 3 retrospectively, including 2 from custom automated screening of multiple data sets (50,257 cases of hematopoietic malignancy, including 4809 acute myeloid leukemia/myeloid sarcoma/APL cases). Two cases presented as myeloid sarcoma, including 1 with multiple relapses after acute myeloid leukemia-type chemotherapy and hematopoietic stem cell transplant. Two cases presented as leukemia, had a poor response to induction chemotherapy, but achieved remission upon reinduction (including all-trans retinoic acid in 1 case) and subsequent hematopoietic stem cell transplant. Neoplastic cells demonstrated features of APL including frequent azurophilic granules and dim/absent CD34 and HLA-DR expression. RARA rearrangement was not detected by karyotype or fluorescent in situ hybridization. Custom analysis of NGS fusion panel data identified TTMV::RARA rearrangements and, in the prospectively identified case, facilitated monitoring in sequential bone marrow samples. APL with TTMV::RARA is a rare leukemia with a high rate of treatment failure in described cases. The diagnosis should be considered in leukemias with features of APL that lack detectable RARA fusions and other drivers, and may be confirmed by appropriate NGS tests with custom informatics. Incorporation of all-trans retinoic acid may have a role in treatment but requires accurate recognition of the fusion for appropriate classification as APL.

Strengthening attention: knowledge distillation via cross-layer feature fusion for image classification

Strengthening attention: knowledge distillation via cross-layer feature fusion for image classification

SAR Image Fusion Classification Based on Improved D-S Evidence Theory

Applications for classifying Synthetic Aperture Radar (SAR) images are critical to environmental monitoring, urban planning, and land resource surveying. Fusion approaches work well for increasing SAR image categorization accuracy. However, effective processing of uncertainty information is frequently overlooked by conventional fusion classification systems. This paper presented a fusion classification approach for SAR images based on improved Dempster-Shafer (D-S) evidence theory, taking into account the uncertainty and possible conflicts in the classifiers’ output. First, after adaptively identifying the optimal hyperparameters of models, the SAR data is identified using Gradient Boosting Machine (GBM), Multilayer Perceptron (MLP), and Random Forest (RF). Different weights are then allocated in accordance with the variations in classifier performance. Ultimately, enhanced D-S evidence theory is used to integrate the output of these classifiers. In addition, uncertainty in classification results is also modeled and visualized. Experiments with Flevoland and Oberpfaffenhofen datasets show that the accuracy of this method is 85.21% and 91.88% respectively, outperforming both the soft voting ensemble classifier (SVE) and D-S evidence theory fusion method. This approach enhances the comprehension and capacity to manage uncertainty in the model output in addition to increasing the accuracy and reliability of the classification of SAR data.

Deep Learning Models and Fusion Classification Technique for Accurate Diagnosis of Retinopathy of Prematurity in Preterm Newborn

اعتلال الشبكية الخداجي (ROP) هو السبب الأكثر شيوعًا لعمى الأطفال الذي لا رجعة فيه، ويعتمد تشخيصه وعلاجه على الدرجات الذاتية بناءً على سمات الأوعية الدموية في شبكية العين. ومع ذلك، فإن هذه الطريقة شاقة وعرضة للخطأ، لذا فإن الأساليب الآلية مرغوبة لمزيد من الدقة والإنتاجية. تهدف هذه الدراسة إلى تطوير نهج قائم على التعلم العميق للتشخيص الدقيق لمرض اعتلال الشبكية الخداجي الزائد عند الأطفال الخدج باستخدام نماذج التعلم التحويلية وتقنية تصنيف الاندماج. زودنا مركز الأمل للعيون في العيادة الخاصة في بغداد، العراق، بـ 2776 صورة لقاعدة فحص مرضى اعتلال الشبكية الخداجي بين عامي 2015 و2020، واستخدمنا هذه الصور لتدريب ثلاثة نماذج للشبكات العصبية التلافيفية العميقة (ResNet50 وDensenet161 وEfficientNetB5). تم استخدام نهج مصنف الاندماج لدمج النماذج الثلاثة من أجل تشخيص شامل ودقيق. تتميز النماذج الثلاثة بمعدلات دقة نسبية تبلغ 69.78٪ و80.57٪ و81.29٪ في تصنيفاتها الخاصة. ومع ذلك، زادت الدقة الإجمالية إلى 90.28 في المائة عند استخدام مصنف الاندماج. هذا يدل على أن الطريقة المقترحة مفيدة لتحديد اعتلال الشبكية الخداجي عند الخدج. تشير نتائج الدراسة إلى أن الطريقة المقترحة لديها القدرة على تعزيز الدقة والسرعة التي يتم بها تشخيص اعتلال الشبكية الخداجي بشكل كبير، مما قد يؤدي بدوره إلى الكشف المبكر عن المرض وعلاجه وتقليل احتمالية الإصابة بعمى الأطفال.

Automotive Clutch Fault Diagnosis Through Feature Fusion and Lazy Family of Classifiers

Automotive Clutch Fault Diagnosis Through Feature Fusion and Lazy Family of Classifiers