Multi-classifier Approach Research Articles

Epilepsy Unveiled using a Multi-Classifier Approach integrated in EAS system for Enhanced Detection Using EEG Signal Analysis.

The study focuses on the advantages of using non-invasive approaches to detect epileptic seizures, aiming to prevent injuries from sudden falls and improve medical diagnosis and management. It presents an EEG Acquisition System (EAS) that integrates a multi-level amplifier with four machine learning algorithms—K-Nearest Neighbors (KNN), Support Vector Machine (SVM), Multilayer Perceptron Neural Networks (MLPNN), and Convolutional Neural Network (CNN)—for signal classification. These methods are chosen for their accuracy and rapid processing, making them ideal for real-time use. The research analyzed data from 310 participants to detect epileptic patterns under various conditions. The results show that the SVM model achieved the highest accuracy at 96.37%±2.68 in the small data, followed by the CNN with 95.25%±2.25 in real-time detection, MLPNN at 89.87%, and KNN with 86.37% . This demonstrates CNN's strong performance in seizure detection, complemented by a detailed comparison of sensitivity and specificity across all models to assess their predictive efficiency. The system tells the scientist if there is an epilepsy , dementia ,or a normal brain activity, if the system detects the abnormal activities, it could map it on the brain map with a precision of 98%.

Comparative analysis of in-silico tools in identifying pathogenic variants in dominant inherited retinal diseases.

Inherited retinal diseases (IRDs) are a group of rare genetic eye conditions that cause blindness. Despite progress in identifying genes associated with IRDs, improvements are necessary for classifying rare autosomal dominant (AD) disorders. AD diseases are highly heterogenous, with causal variants being restricted to specific amino acid changes within certain protein domains, making AD conditions difficult to classify. Here, we aim to determine the top-performing in-silico tools for predicting the pathogenicity of AD IRD variants. We annotated variants from ClinVar and benchmarked 39 variant classifier tools on IRD genes, split by inheritance pattern. Using area-under-the-curve (AUC) analysis, we determined the top-performing tools and defined thresholds for variant pathogenicity. Top-performing tools were assessed using genome sequencing on a cohort of participants with IRDs of unknown etiology. MutScore achieved the highest accuracy within AD genes, yielding an AUC of 0.969. When filtering for AD gain-of-function and dominant negative variants, BayesDel had the highest accuracy with an AUC of 0.997. Five participants with variants in NR2E3, RHO, GUCA1A, and GUCY2D were confirmed to have dominantly inherited disease based on pedigree, phenotype, and segregation analysis. We identified two uncharacterized variants in GUCA1A (c.428T>A, p.Ile143Thr) and RHO (c.631C>G, p.His211Asp) in three participants. Our findings support using a multi-classifier approach comprised of new missense classifier tools to identify pathogenic variants in participants with AD IRDs. Our results provide a foundation for improved genetic diagnosis for people with IRDs.

Name Disambiguation Scheme Based on Heterogeneous Academic Sites

Academic researchers publish their work in various formats, such as papers, patents, and research reports, on different academic sites. When searching for a particular researcher’s work, it can be challenging to pinpoint the right individual, especially when there are multiple researchers with the same name. In order to handle this issue, we propose a name disambiguation scheme for researchers with the same name based on heterogeneous academic sites. The proposed scheme collects and integrates research results from these varied academic sites, focusing on attributes crucial for disambiguation. It then employs clustering techniques to identify individuals who share the same name. Additionally, we implement the proposed rule-based algorithm name disambiguation method and the existing deep learning-based identification method. This approach allows for the selection of the most accurate disambiguation scheme, taking into account the metadata available in the academic sites, using a multi-classifier approach. We consider various researchers’ achievements and metadata of articles registered in various academic search sites. The proposed scheme showed an exceptionally high F1-measure value of 0.99. In this paper, we propose a multi-classifier that executes the most appropriate disambiguation scheme depending on the inputted metadata. The proposed multi-classifier shows the high F1-measure value of 0.67.

A Novel Developed Supervised Machine Learning System For Classification And Prediction of Software Faults Using NASA Dataset

The software systems of modern computers are extremely complex and versatile. Therefore, it is essential to regularly detect and correct software design faults. In order to devote resources effectively towards the creation of trustworthy software, software companies are increasingly engaging in the practise of predicting fault-prone modules in advance of testing. These software fault prediction methods rely on the thoroughness with which prior software versions' fault as well as related code has been retrievedTime, energy, and money are all saved as a result. Increases the company's initial success and bottom line greatly by satisfying its clientele. Numerous academics have poured into this area throughout the years in an effort to raise the bar for all software. Nowadays, The most often used approaches in this field are those based on machine learning (ML). The field of ML seeks to perfect software capable of evolving as well as adapting in response to fresh data. This paper introduces a fresh approach for doing ML by bringing together a number of different expert systems. In order to reach agreement on which aspects of a software system need to be tested, the proposed multi-classifier model pools the strengths of the most effective classifiers. Several top-performing classifiers for defect prediction are put through their paces in an experiential evaluation. We test our method on 16 publicly available datasets from the NASA Metric Data Programme (MDP) repository at the promise repository. Parameters of confusion, recall, precision, recognition accuracy, etc., are evaluated and contrasted with existing schemes in a software analysis performed with the help of the python simulation tool with findings. The experimental outcomes demonstrate that by combining LGBM, XGBoost, and Voting classifiers, using a multi classifier approach, we are capable to significantly improve software fault prediction performance. The results of the investigation show that the suggested method will lead to better practical outcomes in the prediction of device failures.

Semi-supervised learning for sentiment classification with ensemble multi-classifier approach

Supervised sentiment analysis ideally uses a fully labeled data set for modeling. However, this ideal condition requires a struggle in the label annotation process. Semi-supervised learning (SSL) has emerged as a promising method to avoid time-consuming and expensive data labeling without reducing model performance. However, the research on SSL is still limited and its performance needs to be improved. Thus, this study aims to create a new SSL-Model for sentiment analysis. The Ensemble Classifier SSL model for sentiment classification is introduced. The research went through pre-processing, vectorization, and feature extraction using TF-IDF and n-grams. Support Vector Machine (SVM) or Random Forest for tokenization was used to separate unigram, bigram, and trigram in model generation. Then, the outputs of these models were combined using stacking ensemble approach. Accuracy and F1-score were used for the evaluation. IMDB datasets and US Airlines were used to test the new SSL models. The conclusion is that the sentiment annotation accuracy is highly dependent on the suitability of the dataset with the machine learning algorithm. In IMDB dataset, which consists of two classes, it is better to use SVM. In the US Airlines consisting of three classes, SVM is better at improving the model performance against the baseline, but RF is better at achieving the baseline performance even though it fails to maintain the model performance.

Blade icing detection of wind turbine based on multi-feature and multi-classifier fusion

Wind farms are usually located in high altitude areas with a high probability of ice occurrence. Blade icing has the potential to result in unexpected mechanical failures and downtimes. In order to avoid these problems, the priority we need to do is to detect blade icing accurately. For this purpose, a novel icing detection method based on multi-feature and multi-classifier fusion is proposed in this paper. Firstly, multi-feature composed of basic features and statistical features are extracted from the operational data. Significant features are then extracted by utilizing Light Gradient Boosting Machine. Secondly, a multi-classifier fusion approach is employed to build an fusion model, which aims to obtain a much more accurate estimation for the icing state. Overall, the proposed method in this paper can achieve more accurate detection on blade icing, compared with other models. This will minimize false alarms, helping wind farms manage the operations more efficiently.

Multi-classifier prediction of knee osteoarthritis progression from incomplete imbalanced longitudinal data

Conventional inclusion criteria used in osteoarthritis clinical trials are not very effective in selecting patients who would benefit from a therapy being tested. Typically majority of selected patients show no or limited disease progression during a trial period. As a consequence, the effect of the tested treatment cannot be observed, and the efforts and resources invested in running the trial are not rewarded. This could be avoided, if selection criteria were more predictive of the future disease progression. In this article, we formulated the patient selection problem as a multi-class classification task, with classes based on clinically relevant measures of progression (over a time scale typical for clinical trials). Using data from two long-term knee osteoarthritis studies OAI and CHECK, we tested multiple algorithms and learning process configurations (including multi-classifier approaches, cost-sensitive learning, and feature selection), to identify the best performing machine learning models. We examined the behaviour of the best models, with respect to prediction errors and the impact of used features, to confirm their clinical relevance. We found that the model-based selection outperforms the conventional inclusion criteria, reducing by 20–25% the number of patients who show no progression. This result might lead to more efficient clinical trials.

Multi-Classifier Approaches for Supporting Clinical Decision Making

Diagnosis is one of the most important processes in the medical field. Since the knowledge domains of clinical specialties are expanding rapidly in terms of complexity and volume of data, clinicians have, in many cases, difficulties to make an accurate diagnosis. Therefore, intelligent and quantitative support for diagnostic tasks can be effectively exploited for improving the effectiveness of the process and reduce misdiagnosis. In this respect, Multi-Classifier Systems represent one of the most promising approaches within Machine Learning methodologies. This paper proposes a Multi-Classifier Systems framework for supporting diagnostic activities with the aim of improving diagnostic accuracy. The framework uses and combines several classification algorithms by dynamically selecting the most competent classifier according to the test sample and its location in the feature space. Here, we extend our previous research. The new experimental results, compared with several multi classifier techniques, based on dynamic classifier selection, on classification datasets, show that the performance of the proposed framework exceeds the state-of-the-art dynamic classifier selection techniques.

Deep multiple classifier fusion for traffic scene recognition

The recognition of the traffic scene in still images is an important yet difficult task in an intelligent transportation systems. The main difficulty lies in how to improve the image processing algorithms for different traffic participants and the various layouts of roads while discriminating the different traffic scenes. In this paper, we attempt to solve the traffic scene recognition problem with three distinct contributions. First, we propose a deep multi-classifier fusion method in the setting of granular computing. Specifically, the deep multi-classifier fusion method which involves local deep-learned feature extraction at one end that is connected to the other end for classification through a multi-classifier fusion approach. At the local deep-learned feature extraction end, the operation of convolution to extract feature maps from the local patches of an image is essentially a form of information granulation, whereas the fusion of classifiers at the classification end is essentially a form of organization. The second contribution is the creation of new traffic scene data set, named the “WZ-traffic”. The WZ-traffic data set consists of 6035 labeled images, which belong to 20 categories collected from both an image search engine as well as from personal photographs. Third, we make extensive comparisons with state-of-the-art methods on the WZ-traffic and FM2 data sets. The experiment results demonstrate that our method dramatically improves traffic scene recognition and brings potential benefits to many other real-world applications.

Learning From the Optical Spectrum: Failure Detection and Identification

The availability of coarse-resolution cost-effective optical spectrum analyzers (OSAs) allows their widespread deployment in operators’ networks. In this paper, we explore several machine learning approaches for soft-failure detection, identification, and localization that take advantage of OSAs. In particular, we present three different solutions for the two most common filter-related soft-failures: filter shift and tight filtering, which noticeably deform the expected shape of the optical spectrum. However, filter cascading is a key challenge as it affects the shape of the optical spectrum similarly to the tight filtering; the approaches are specifically designed to avoid the misclassification of properly operating signals when normal filter cascading effects are present. The proposed solutions are as follows: First, the multi-classifier approach, which uses features extracted directly from the optical spectrum; second, the single-classifier approach, which uses preprocessed features to compensate for filter cascading; and third, the residual-based approach, which uses a residual signal computed from subtracting the signal acquired by OSAs from an expected signal synthetically generated. Extensive numerical results are ultimately presented to compare the performance of the proposed approaches in terms of accuracy and robustness.

Automatic identification of cited text spans: a multi-classifier approach over imbalanced dataset

Recently, a new form of structured summary on scientific papers is explored by grouping cited text spans from the reference paper. Its primary goal is to generate summaries based on the cited paper itself. Previously, traditional scientific summarization focused on citation-based methods by aggregating all citances that cite one unique paper without doing content-based citation analysis, while sometimes citations might differ between researchers or time slots. By investigating original text spans where scholars cited, the new method can reflect exact contributions of reference papers more. Therefore, how to identify cited text spans accurately becomes the first important problem to solve. Generally, it can be converted into finding the sentences in reference paper that is more similar with citation sentences. Taking it as a classification task, we investigate the potential of four actions to improve identification performance. Firstly, feature selections are conducted carefully according to multi-classifiers. Secondly, we apply sampling-based algorithms to preprocess class-imbalanced datasets. Since we integrated results via a weighted voting system, the third action is tuning parameters like, voting weights for multi-classifiers integration or running settings to see if we can improve performance further. Evaluation results show effectiveness of each action and demonstrate that researchers can take these actions for more accurate cited text spans identification when doing scientific summarization.

Analyzing performance of classifiers for medical datasets

This paper analyses the performance of classification models using single classification and combination of ensemble method, which are Breast Cancer Wisconsin and Hepatitis data sets as training datasets. This paper presents a comparison of different classifiers based on a 10-fold cross validation using a data mining tool. In this experiment, various classifiers are implemented including three popular ensemble methods which are boosting, bagging and stacking for the combination. The result shows that for the classification of the Breast Cancer Wisconsin data set, the single classification of Naïve Bayes (NB) and a combination of bagging+NB algorithm displayed the highest accuracy at the same percentage (97.51%) compared to other combinations of ensemble classifiers. For the classification of the Hepatitisdata set, the result showed that the combination of stacking+Multi-Layer Perception (MLP) algorithm achieved a higher accuracy at 86.25%. By using the ensemble classifiers, the result may be improved. In future, a multi-classifier approach will be proposed by introducing a fusion at the classification level between these classifiers to obtain classification with higher accuracies.

Ensemble based on static classifier selection for automated diagnosis of Mild Cognitive Impairment

BackgroundAlzheimer's disease (AD) is the most common cause of neurodegenerative dementia in the elderly population. Scientific research is very active in the challenge of designing automated approaches to achieve an early and certain diagnosis. Recently an international competition among AD predictors has been organized: “A Machine learning neuroimaging challenge for automated diagnosis of Mild Cognitive Impairment” (MLNeCh). This competition is based on pre-processed sets of T1-weighted Magnetic Resonance Images (MRI) to be classified in four categories: stable AD, individuals with MCI who converted to AD, individuals with MCI who did not convert to AD and healthy controls. New methodIn this work, we propose a method to perform early diagnosis of AD, which is evaluated on MLNeCh dataset. Since the automatic classification of AD is based on the use of feature vectors of high dimensionality, different techniques of feature selection/reduction are compared in order to avoid the curse-of-dimensionality problem, then the classification method is obtained as the combination of Support Vector Machines trained using different clusters of data extracted from the whole training set. ResultsThe multi-classifier approach proposed in this work outperforms all the stand-alone method tested in our experiments. The final ensemble is based on a set of classifiers, each trained on a different cluster of the training data. The proposed ensemble has the great advantage of performing well using a very reduced version of the data (the reduction factor is more than 90%).The MATLAB code for the ensemble of classifiers will be publicly available11https://www.dropbox.com/s/bguw035yrqz0pwp/ElencoCode.docx?dl=0 to other researchers for future comparisons.

Multi-classifier approaches for improving Clinical Decision Support Systems

Multi-classifier approaches for improving Clinical Decision Support Systems

Intent recognition of torso motion using wavelet transform feature extraction and linear discriminant analysis ensemble classification

Abstract In this paper, a multi-sensor, multi-classifier approach for intent recognition of human torso motion is presented. A linear discriminant analysis based classifier is used, and the extraction of time-frequency domain features through the use of the wavelet transform is discussed. In addition, a weighted multi-classifier combination method for combining outputs of multiple classifiers into a single coherent output is implemented. The approach was evaluated on physiological data collected from three human participants. Results show up to 97% accuracy in classifying flexion and extension motions of the torso.

Supervised Learning For Orphan Adoption Problem In Software Architecture Recovery

Maintenance of architectural documentation is a prime requirement for evolving software systems. New versions of software systems are launched after making the changes that take place in a software system over time. The orphan adoption problem, which deals with the issue of accommodation of newly introduced resources (orphan resources) in appropriate subsystems in successive versions of a software system, is a significant problem. The orphan adoption algorithm has been developed to address this problem. For evolving software systems, it would be useful to recover the architecture of subsequent versions of a software system by using existing architectural information. In this paper, we explore supervised learning techniques (classifiers) for recovering the architecture of subsequent versions of a software system by taking benefit of existing architectural information. We use three classifiers, i.e., Bayesian classifier, k-Nearest Neighbor classifier and Neural Network for orphan adoption. We conduct experiments to compare the performance of the classifiers using various dependencies between entities in a software system. Our experiments highlight correspondence between the orphan adoption algorithm and the classifiers, and also reveal their strengths and weaknesses. To combine strengths of individual classifiers, we propose using a multiclassifier approach in which classifiers work cooperatively to improve classification accuracy. Experiments show that there is significant improvement in results when our proposed multiclassifier approach is used.

A Multi-Classifier Approach of EMG Signal Classification for Diagnosis of Neuromuscular Disorders

Electromyographic (EMG) signal provide a significant source of information for diagnosis, treatment and management of neuromuscular disorders. This paper is aim at introducing an effective multi-classifier approach to enhance classification accuracy .The proposed system employs both time domain and time-frequency domain features of motor unit action potentials (MUAPs) extracted from an EMG signal. Different classification strategies including single classifier and multiple classifiers with time domain and time frequency domain features were investigated. Support Vector Machine (SVM) and K-nearest neighborhood (KNN) classifier used predict class label (Myopathic, Neuropathic, or Normal) for a given MUAP. Extensive analysis is performed on clinical EMG database for the classification of neuromuscular diseases and it is found that the proposed methods provide a very satisfactory performance in terms overall classification accuracy.

A Multi-Classifier Approach of EMG Signal Classification for Diagnosis of Neuromuscular Disorders

Electromyographic (EMG) signal provide a significant source of information for diagnosis, treatment and management of neuromuscular disorders. This paper is aim at introducing an effective multi-classifier approach to enhance classification accuracy .The proposed system employs both time domain and time-frequency domain features of motor unit action potentials (MUAPs) extracted from an EMG signal. Different classification strategies including single classifier and multiple classifiers with time domain and time frequency domain features were investigated. Support Vector Machine (SVM) and K-nearest neighborhood (KNN) classifier used predict class label (Myopathic, Neuropathic, or Normal) for a given MUAP. Extensive analysis is performed on clinical EMG database for the classification of neuromuscular diseases and it is found that the proposed methods provide a very satisfactory performance in terms overall classification accuracy.

Offline Arabic Handwriting Recognition System Based on the Combination of Multiple Semi-Continuous HMMs

In this paper, we present a multi-classifier approach for off-line handwritten Arabic word recognition system. The main objective of this paper is to develop a handwriting recognition system that can be learned and applied to different Arabic writing styles. We propose an approach that combines multiple classifiers based on semi-continuous Hidden Markov Model using different feature extraction methods. The following process consists of several phases: pre-processing, extraction of pertinent characteristics and modeling. The role of the pre-processing phase is to prepare the input image text, i.e, binarization, normalization, segmentation and skeletonization. The obtained images are then used to extract features using a mixture of geometrical and statistical characteristics, namely, the intensities of gray level of the pixel, the densities and the concavities of the pixels, the VH2D projections and the invariants Hu moments. The modeling phase is based on the Hidden Markov Model using the HTK tools for the training and the recognition phase. Each character is modeled by a semi-continuous HMMs, and each set of feature has its own HMM. To improve the performance of our Arabic handwriting recognition system, we propose to combine parallel methods of HMMs having the same architecture, but training phase using four different types of primitive vectors. Our system was evaluated using the ENIT/IFN the base Arabic data. Results Obtained show that the combination of four semi-continuous HMM classifiers gives a significant improvement of our off-line handwriting recognition system compared to results obtained when using individual classifiers.

The Study on the Accuracy of Classifiers for Water Quality Application

Dirty water is the world's biggest health risk. When water from rain roads into rivers, it picks up toxic chemicals, dirt, trash and disease-carrying organisms along the way. Many of our water resources lack basic protections, making them vulnerable to pollution from factory farms and industrial plants. Due to that, a classification model is needed to present the quality of the water environment. In this paper, the data mining techniques are used in this research by applying the classification method for water quality application. Various classifiers were studied in order to find the most accurate classifier for the dataset. This paper presents the comparison of accuracies for the five classifiers (NB, MLP, J48, SMO, and IBk) based on a 10-fold cross validation as a test method with respect to water quality from the datasets of Kinta River, Perak Malaysia. This study also explores which classifier is suitable to classify the dataset. The selected attributes used in this study were: DO Sat, DO Mgl, BOD Mgl, COD Mgl, TS Mgl, DO Index, AN Index, SS Index, Class, and Degree of pollution. The data consisted of 166 instances and obtained from the East Coast Environmental Research Institute (ESERI) of Universiti Sultan Zainal Abidin (UniSZA). The result of MLP and IBk performed better than other classifiers for Kinta River dataset because these classifiers showed the highest accuracy with the same percentage of 91.57%. In the future, we will propose the multiclassifier approach by introducing a fusion at a classification level between these classifiers to get a higher accuracy of classification.