Ensemble Of Classifiers Research Articles

Reducing non-technical losses in electricity distribution networks: Leveraging explainable AI and three lines of defence model to manage operational staff-related factors

This study presents a multidisciplinary approach involving Explainable Artificial Intelligence (ExAI) and operational risk management to reduce Non-Technical Losses (NTL) in electricity distribution. It empirically explores how the activities of employees of utility companies contribute to NTL, a phenomenon often overlooked in existing empirical research. An ensemble classification algorithm is used to analyse utility operations data, and the SHAP explainability technique establishes the predictive significance of staff activities for NTL. Subsequently, these staff activities are mapped into risk cells using the BASEL II and III operational risk definitions, and the Three Lines of Defence (3LoD) model is developed for optimizing electricity distribution. The paper makes three original contributions to the literature: first, it empirically links staff operations to NTL; second, it maps NTL causes to Basel II/III operational risk categories; and finally, to the best of the authors’ knowledge, it is the first study to use the 3LoD model for electricity distribution optimization.

Ensemble of classifiers based on score function defined by clusters and decision boundary of linear base learners

One possible type of base classifier output is a scoring function, which can be regarded as the probability that the class label is the true one. The measurement expressed by the score function can be of very different natures: distances, probabilities, or confidence. In this paper, we propose determining score function value based on two factors: the distance of the object from the decision boundary and the clustering of the object in the feature space. In the proposed framework, the above-mentioned scores are combined by a weighted average, and the classifier ensemble is created using the bagging or boosting technique. The proposed method was compared with five reference methods for determining the score function based on the distance between the object and the classifier decision boundary. The experimental results on 63 publicly available datasets clearly show that the proposed method outperforms the reference methods in the context of four classification performance metrics.

Machine learning based classifiers for dynamic and transient disturbance classification in smart microgrid system

The smart microgrid system should have the ability to rapidly detect and classify every type of disturbance that happens in the network to operate the protection scheme and maintain the power quality. Both dynamic and transient types of disturbances are considered in this study, and the classification of each type of disturbance has been done using different machine learning-based techniques. A novel ensemble classifier has been proposed after comparing the performance of the decision tree (DT), k nearest neighbor (KNN), support vector machine (SVM), and ensemble classifier. The performances of all the classifiers have been evaluated in terms of accuracy, sensitivity, confusion matrices, and receiver operating characteristics (ROC). A very satisfactory result has been obtained in the ensemble tree classification technique with 99.3% accuracy in 2.1 s of training time. Therefore, it can be suggested to identify and classify every transient as well as steady-state events of the microgrid network.

Predicting the Performance of Ensemble Classification Using Conditional Joint Probability

In many machine learning applications, there are many scenarios when performance is not satisfactory by single classifiers. In this case, an ensemble classification is constructed using several weak base learners to achieve satisfactory performance. Unluckily, the construction of the ensemble classification is empirical, i.e., to try an ensemble classification and if performance is not satisfactory then discard it. In this paper, a challenging analytical problem of the estimation of ensemble classification using the prediction performance of the base learners is considered. The proposed formulation is aimed at estimating the performance of ensemble classification without physically developing it, and it is derived from the perspective of probability theory by manipulating the decision probabilities of the base learners. For this purpose, the output of a base learner (which is either true positive, true negative, false positive, or false negative) is considered as a random variable. Then, the effects of logical disjunction-based and majority voting-based decision combination strategies are analyzed from the perspective of conditional joint probability. To evaluate the forecasted performance of ensemble classifier by the proposed methodology, publicly available standard datasets have been employed. The results show the effectiveness of the derived formulations to estimate the performance of ensemble classification. In addition to this, the theoretical and experimental results show that the logical disjunction-based decision outperforms majority voting in imbalanced datasets and cost-sensitive scenarios.

Retraction Note: effective heart disease prediction using improved particle swarm optimization algorithm and ensemble classification technique

Retraction Note: effective heart disease prediction using improved particle swarm optimization algorithm and ensemble classification technique

Effective Twitter Sentiment Analysis System with Ensemble Classifiers and Feature Selection

One of the most intriguing areas of research these days is sentiment analysis from Twitter. In order to create such systems, it blends data mining methodologies with natural language processing techniques. We presented an effective Twitter sentiment analysis method in this study. A machine learning model was developed using the suggested approach to identify both good and negative tweets. During the training phase, our model employed various methods to represent the input labelled tweets using various feature sets. For more accurate results, the classifier ensemble is shown various basis classifiers throughout the classification phase. The suggested technique may be used to gauge users' opinions based on their tweets, which is highly beneficial for a variety of uses, including product reviews, political polarity identification, and marketing.

A Multibranch LSTM-Attention Ensemble Classification Network for Sensor Drift Compensation

A Multibranch LSTM-Attention Ensemble Classification Network for Sensor Drift Compensation

Machine learning-based noninvasive diagnostic classifiers for the prediction of cancer tissue of origin using serum microRNAs.

101 Background: Noninvasive multi-cancer early detection (MCED) with or without tissue of origin (TOO) has the potential to reduce cancer-related mortality by analyzing circulating cell-free nucleic acids and/or proteins in blood. Accurate prediction of TOO following a positive MCED test would guide selection of confirmatory tests, thereby expediting the definitive diagnosis and prompt initiation of the most appropriate treatment, tailored to the specific cancer type. Here, we report the development of machine learning-based diagnostic classifiers that predict TOO for 13 cancer types with high accuracy using serum microRNAs. Methods: Eight serum miRNA microarray datasets from GEO totaling 6,283 patients across 13 cancer types were used in this study. The patients were split, with an approximate 3:2 ratio, into a training (n=3,844) and a validation set (n=2,439). An ensemble of classifiers was constructed in the training set via the “one vs. rest” approach, thus one classifier for each cancer type. Random forest models with recursive feature elimination (RFE) selected the optimal set of miRNAs that was fed into support vector machine models to generate a prediction probability for each cancer type. The type with the highest probability was considered the predicted cancer type. The performance of these classifiers was evaluated in the validation set in two steps with the 1st using all cancer types and the 2nd using the top 2 or 3 cancer types from the 1st step to achieve a refined prediction. Results: RFE selected 426 miRNAs for building the 13 classification models. In the validation set comprising 2,439 patients across 12 cancer types, the classifiers correctly predicted cancer types for 1,922 (79%) samples based on the highest prediction probability. The accuracy increased to 92% and 95% based on top 2 and 3 predictions. In particular, based on top 3 predictions, the accuracy was >95% for bladder, breast, prostate, gastric, glioma and lung cancers, >85% for ovarian, liver and esophageal cancers, 78% for pancreatic cancer and sarcoma, and 67% for colorectal cancer. Conclusions: With 95% accuracy in narrowing TOO down to 3 organ sites, the miRNA-based TOO classifiers could be used clinically as a reflex test for the simple and highly accurate MCED screening models previously developed ( Cancers 2022,14:1450; ESMO 2024). Together, they support the development of an inexpensive, accurate and noninvasive blood test for MCED with TOO.

Enhanced Malicious Traffic Detection in Encrypted Communication Using TLS Features and a Multi-class Classifier Ensemble

Enhanced Malicious Traffic Detection in Encrypted Communication Using TLS Features and a Multi-class Classifier Ensemble

Sentiment classification of movie reviews: a powerful method based on ensemble of classifiers and features

Sentiment classification of movie reviews: a powerful method based on ensemble of classifiers and features

Galaxy mergers in UNIONS – I. A simulation-driven hybrid deep learning ensemble for pure galaxy merger classification

Abstract Merging and interactions can radically transform galaxies. However, identifying these events based solely on structure is challenging as the status of observed mergers is not easily accessible. Fortunately, cosmological simulations are now able to produce more realistic galaxy morphologies, allowing us to directly trace galaxy transformation throughout the merger sequence. To advance the potential of observational analysis closer to what is possible in simulations, we introduce a supervised deep learning Convolutional Neural Network (CNN) and Vision Transformer (ViT) hybrid framework, Mummi (MUlti Model Merger Identifier). Mummi is trained on realism-added synthetic data from IllustrisTNG100-1, and is comprised of a multi-step ensemble of models to identify mergers and non-mergers, and to subsequently classify the mergers as interacting pairs or post-mergers. To train this ensemble of models, we generate a large imaging dataset of 6.4 million images targeting UNIONS with RealSimCFIS. We show that Mummi offers a significant improvement over many previous machine learning classifiers, achieving 95% pure classifications even at Gyr long timescales when using a jury-based decision making process, mitigating class imbalance issues that arise when identifying real galaxy mergers from z = 0 to 0.3. Additionally, we can divide the identified mergers into pairs and post-mergers at 96% success rate. We drastically decrease the false positive rate in galaxy merger samples by 75%. By applying Mummi to the UNIONS DR5-SDSS DR7 overlap, we report a catalog of 13,448 high confidence galaxy merger candidates. Finally, we demonstrate that Mummi produces powerful representations solely using supervised learning, which can be used to bridge galaxy morphologies in simulations and observations.

Hamiltonian Identification via Quantum Ensemble Classification.

Identifying the Hamiltonian of an unknown quantum system is a critical task in the area of quantum information. In this article, we propose a systematic Hamiltonian identification approach via quantum ensemble multiclass classification (HI-QEMC). This approach is implemented by a three-step iterative refining process, i.e., parameter interval guess, verification, and judgment. In the parameter interval guess step, the parameter interval is divided into several sub-intervals and the true Hamiltonian parameter is guessed in one of them. In the parameter interval verification step, cross verification is applied to verify the accuracy of the guess. In the parameter interval judgment step, an adaptive interval judgment (AIJ) algorithm is designed to determine the sub-interval containing the true Hamiltonian parameter. Numerical results on two typical quantum systems, i.e., two-level quantum systems and three-level quantum systems, demonstrate the effectiveness and superior performance of the proposed approach for quantum Hamiltonian identification.

Optimization of Classifier Ensemble Diversity

Optimization of Classifier Ensemble Diversity

A data-centric machine learning approach to improve prediction of glioma grades using low-imbalance TCGA data

Accurate prediction and grading of gliomas play a crucial role in evaluating brain tumor progression, assessing overall prognosis, and treatment planning. In addition to neuroimaging techniques, identifying molecular biomarkers that can guide the diagnosis, prognosis and prediction of the response to therapy has aroused the interest of researchers in their use together with machine learning and deep learning models. Most of the research in this field has been model-centric, meaning it has been based on finding better performing algorithms. However, in practice, improving data quality can result in a better model. This study investigates a data-centric machine learning approach to determine their potential benefits in predicting glioma grades. We report six performance metrics to provide a complete picture of model performance. Experimental results indicate that standardization and oversizing the minority class increase the prediction performance of four popular machine learning models and two classifier ensembles applied on a low-imbalanced data set consisting of clinical factors and molecular biomarkers. The experiments also show that the two classifier ensembles significantly outperform three of the four standard prediction models. Furthermore, we conduct a comprehensive descriptive analysis of the glioma data set to identify relevant statistical characteristics and discover the most informative attributes using four feature ranking algorithms.

Fish Acoustic Detection Algorithm Research: a deep learning app for Caribbean grouper calls detection and call types classification

In this paper, we present the first machine learning package developed specifically for fish calls identification within a specific range (0–500Hz) that encompasses four Caribbean grouper species: red hind (E. guttatus), Nassau (E. striatus), yellowfin (M. venenosa), and black (M. bonaci). Because of their ubiquity in the soundscape of the grouper’s habitat, squirrelfish (Holocentrus spp.) sounds along with vessel noise are also detected. In addition the model is also able to separate grouper species call types. This package called FADAR, the Fish Acoustic Detection Algorithm Research is a standalone user-friendly application developed in Matlab™. The concept of FADAR is the product of the evaluation of various deep learning architectures that have been presented in a series of published articles. FADAR is composed of a main algorithm that can detect all species calls including their call types. The architecture of this model is based on an ensemble approach where a bank of five CNNs with randomly assigned hyperparameters are used to form an ensemble of classifiers. The outputs of all five CNNs are combined by a fusion process for decision making. At the species level, the output of the multimodel is thus used to classify the calls in terms of their types. This is done by species specific deep learning models that have been thoroughly evaluated in the literature on the species concerned here, including transfer learning for red hind and yellowfin groupers and custom designed CNN for Nassau grouper, which has a greater number of known call types than the other species. FADAR was manually trained on a diversity of data that span various regions of the Caribbean Sea and also two recorder brands, hydrophone sensitivities, calibrations and sampling rates, including a mobile platform. This strategy has conferred FADAR substantive robustness to a diversity of noise level and sources that can be found in the grouper calls frequency band such as vessels and marine mammals. Performance metrics based on sensitivity (recall) and specificity showed the same performance level for both balanced and unbalanced datasets and at locations not used in the training set.

Securing IoT network with hybrid evolutionary lion intrusion detection system: a composite motion optimisation algorithm for feature selection and ensemble classification

ABSTRACT Networks connected to the Internet of Things (IoT) are often vulnerable to attacks. Several existing methods in the intrusion detection system for securing IoT have been presented with ensemble classifier, but it does not accurately classify attack, and also it takes high computation time. With intention of solving the security issues, Intrusion Detection System using Hybrid Evolutionary Lion and Balancing Composite Motion Optimisation Algorithm espoused feature selection with Ensemble Classifier (IDS-IoT-Hybrid ELOA-BCMOA-Ensemble-DT-LSVM-RF-XGBoost) is proposed for Securing IoT Network. At first, data were accumulated from the NSL-KDD data set. Afterward, data is fed to pre-processing, where it restored missing value using mean curvature flow method. At feature selection, optimum features are compiled under Hybrid Evolutionary Lion and Balancing Composite Motion Optimisation Algorithm. Based upon the optimum features, intruders of IoT data are categorised as denial-of-service (DoS), probe, remote to local attack (R2L), user to root attack (U2R), normal (no attack) with the help of Ensemble classifier. Proposed IDS-IoT-Hybrid ELOA-BCMOA-Ensemble-DT-LSVM-RF-XGBoost approach is constructed utilising Python. Then, proposed IDS-IoT-Hybrid ELOA-BCMOA-Ensemble-DT-LSVM-RF-XGBoost approach attains 21.11%, 19.58%, 24.61% and 9.52% higher accuracy; 94.47%, 93.95%, 93.08% and 90.59% lower error rate, and 62.94%, 36.69%, 64.17% and 50.97% less computation time analysed with existing models.

Design of a brain-machine interface for reducing false activations of a lower-limb exoskeleton based on error related potential

Background and objectiveBrain-Machine Interfaces (BMIs) based on a motor imagination paradigm provide an intuitive approach for the exoskeleton control during gait. However, their clinical applicability remains difficulted by accuracy limitations and sensitivity to false activations. A proposed improvement involves integrating the BMI with methods based on detecting Error Related Potentials (ErrP) to self-tune erroneous commands and enhance not only the system accuracy, but also its usability. The aim of the current research is to characterize the ErrP at the beginning of the gait with a lower limb exoskeleton to reduce the false starts in the BMI system. Furthermore, this study is valuable for determining which type of feedback, Tactile, Visual, or Visuo-Tactile, achieves the best performance in evoking and detecting the ErrP. MethodsThe initial phase of the research concentrates on detecting ErrP at the beginning of gait to improve the efficiency of an asynchronous BMI based on motor imagery (BMI-MI) to control a lower limb exoskeleton. Initially, an experimental protocol is designed to evoke ErrP at the start of gait, employing three different stimuli: Tactile, Visual, and Visuo-Tactile. An iterative selection process is then utilized to characterize ErrP in both time and frequency domains and fine-tune various parameters, including electrode distribution, feature combinations, and classifiers. A generic classifier with 6 subjects is employed to configure an ensemble classification system for detecting ErrP and reducing the false starts. ResultsThe ensembled system configured with the selected parameters yields an average correction of false starts of 72.60 % ± 10.23, highlighting its corrective efficacy. Tactile feedback emerges as the most effective stimulus, outperforming Visual and Visuo-Tactile feedback in both training types. ConclusionsThe results suggest promising prospects for reducing the false starts when integrating ErrP with BMI-MI, employing Tactile feedback. Consequently, the security of the system is enhanced. Subsequent, further research efforts will focus on detecting error potential during movement for gait stop, in order to limit undesired stops.

An online ensemble classification algorithm for multi-class imbalanced data stream

An online ensemble classification algorithm for multi-class imbalanced data stream

Optimization assisted ensemble classification for prediction of chronic kidney disease

Optimization assisted ensemble classification for prediction of chronic kidney disease

An Improved Archimedes Optimization-aided Multi-scale Deep Learning Segmentation with dilated ensemble CNN classification for detecting lung cancer using CT images

ABSTRACT Early detection of lung cancer is necessary to prevent deaths caused by lung cancer. But, the identification of cancer in lungs using Computed Tomography (CT) scan based on some deep learning algorithms does not provide accurate results. A novel adaptive deep learning is developed with heuristic improvement. The proposed framework constitutes three sections as (a) Image acquisition, (b) Segmentation of Lung nodule, and (c) Classifying lung cancer. The raw CT images are congregated through standard data sources. It is then followed by nodule segmentation process, which is conducted by Adaptive Multi-Scale Dilated Trans-Unet3+. For increasing the segmentation accuracy, the parameters in this model is optimized by proposing Modified Transfer Operator-based Archimedes Optimization (MTO-AO). At the end, the segmented images are subjected to classification procedure, namely, Advanced Dilated Ensemble Convolutional Neural Networks (ADECNN), in which it is constructed with Inception, ResNet and MobileNet, where the hyper parameters is tuned by MTO-AO. From the three networks, the final result is estimated by high ranking-based classification. Hence, the performance is investigated using multiple measures and compared among different approaches. Thus, the findings of model demonstrate to prove the system’s efficiency of detecting cancer and help the patient to get the appropriate treatment.