Voting Classifier Research Articles

XAI-Fall: Explainable AI for Fall Detection on Wearable Devices Using Sequence Models and XAI Techniques

A fall detection system is vital for the safety of older people, as it contacts emergency services when it detects a person has fallen. There have been various approaches to detect falls, such as using a single tri-axial accelerometer to detect falls or fixing sensors on the walls of a room to detect falls in a particular area. These approaches have two major drawbacks: either (i) they use a single sensor, which is insufficient to detect falls, or (ii) they are attached to a wall that does not detect a person falling outside its region. Hence, to provide a robust method for detecting falls, the proposed approach uses three different sensors for fall detection, which are placed at five different locations on the subject’s body to gather the data used for training purposes. The UMAFall dataset is used to attain sensor readings to train the models for fall detection. Five models are trained corresponding to the five sensors models, and a majority voting classifier is used to determine the output. Accuracy of 93.5%, 93.5%, 97.2%, 94.6%, and 93.1% is achieved on each of the five sensors models, and 92.54% is the overall accuracy achieved by the majority voting classifier. The XAI technique called LIME is incorporated into the system in order to explain the model’s outputs and improve the model’s interpretability.

DDoS Attacks Detection in the Application Layer Using Three Level Machine Learning Classification Architecture

Distributed Denial of Service (DDoS) is an ever-changing type of attack in cybersecurity, especially with the growing demand for cloud and web services raising a never-ending challenge in the lucrative business. DDoS attacks disrupt users' access to the targeted online services leading to significant business loss. This article presents a three-level architecture for detecting DDoS attacks at the application layer. The first level is responsible for selecting the best features of the samples and classifying the traffic into either benign or malicious, then the second level consists of a hard voting classifier to identify the type of the DDoS source: UDP, TCP, or Mixed-based. Finally, the last level aligns the attack to the appropriate DDoS type. This approach is validated using the CIC-DDoS2019 dataset, and the time, accuracy score, and precision are used as the model performance metrics. Compared to the existing machine learning (ML) approaches, the proposed architecture reveals substantial improvements in both binary and multiclass classification of application-layer DDoS attacks.

Breast Tumor Detection Using Robust and Efficient Machine Learning and Convolutional Neural Network Approaches.

Breast cancer develops when cells in the breast expand and divide uncontrollably, resulting in a lump of tissue known as a tumor. This lump of tissue is called a tumor. After skin cancer, breast cancer is the second most common cancer among women. It is more common in women over the age of 50. Men may also acquire breast cancer, albeit it is uncommon. Each year, approximately 2,600 men in the United States are diagnosed with breast cancer, accounting for less than 1% of all cases. Transgender women are more likely than cisgender men to acquire breast cancer. Additionally, transgender males are less likely than cisgender women to acquire breast cancer. Breast cancer is more common in women over the age of 50, although it can affect anyone at any age. Early detection of a breast tumor may significantly lower the risk of developing breast cancer. A public dataset of breast tumor features was used instead to build models for identifying breast tumors through machine learning and deep learning. Prediction models were built using logistic regression (LR), decision tree (DT), random forest (RF), voting classifier (VC), support vector machine (SVM), and a proprietary convolutional neural network (CNN). These models were used to find critical prognostic indicators linked to breast cancer. The proposed network performs far better, with an average accuracy of 99%. This study has six types of models: LR, RF, SVM, VC, DT, and a custom CNN model. They all had 96% to 99% accuracy in this study. CNN, LR, RF, SVM, VC, and DT achieved 99%, 96%, 98%, 97%, 97%, and 96% F1 score, respectively. There were many machine learning algorithms used in this study that were very accurate, which means that these techniques could be used as alternative prognostic tools in breast tumor detection studies in Asia.

Mortality prediction of COVID-19 patients using soft voting classifier

COVID-19 is a novel coronavirus that spread around the globe with the initial reports coming from Wuhan, China, turned into a pandemic and caused enormous casualties. Various countries have faced multiple COVID spikes which put the medical infrastructure of these countries under immense pressure with third-world countries being hit the hardest. It can be thus concluded that determining the likeliness of death of a patient helps in avoiding fatalities which inspired the authors to research the topic. There are various ways to approach the problem such as past medical records, chest X-rays, CT scans, and blood biomarkers. Since blood biomarkers are most easily available in emergency scenarios, blood biomarkers were used as the features for the model. The data was first imputed and the training data was oversampled to avoid class imbalance in the model training. The model is composed of a voting classifier that takes in outputs from multiple classifiers. The model was then compared to base models such as Random Forest, XGBoost, and Extra Trees Classifier on multiple evaluation criteria. The F1 score was the concerned evaluation criterion as it maximizes the use of the medical infrastructure with the minimum possible casualties by maximizing true positives and minimizing false negatives.

Implementation of Artificial Neural Network to Predict Diabetes with High-Quality Health System.

Patients with diabetes who are closely monitored have a higher overall quality of life than those who are not. Costs associated with healthcare can be decreased by utilising the Internet of Things (IoT), thanks to technological advancements. To satisfy the expectations of e-health applications, it is required for the development of the intelligent systems as well as increases the number of applications that are connected to the network. As a result, in order to achieve these goals, the cellular network should be capable of supporting intelligent healthcare applications that require high energy efficiency. In this paper, we model a neural network-based ensemble voting classifier to predict accurately the diabetes in the patients via online monitoring. The study consists of Internet of Things (IoT) devices to monitor the instances of the patients. While monitoring, the data are transferred from IoT devices to smartphones and then to the cloud, where the process of classification takes place. The simulation is conducted on the collected samples using the python tool. The results of the simulation show that the proposed method achieves a higher accuracy rate, higher precision, recall, and f-measure than existing state-of-art ensemble models.

Predict alone, decide together: cardiac abnormality detection based on single lead classifier voting

Objective. A classifier based on weighted voting of multiple single-lead based models combining deep learning (DL) representation and hand-crafted features was developed to classify 26 cardiac abnormalities from different lead subsets of short-term electrocardiograms (ECG). Approach. A two-stage method was proposed for the multilead prediction. First a lead-agnostic hybrid classifier was trained to predict the pathologies from single-lead ECG signals. The classifier combined fully automated DL features extracted through a convolutional neural network with hand-crafted features through a fully connected layer. Second, a voting of the single-lead based predictions was performed. For the 12-lead subset, voting consisted in an optimised weighting of the output probabilities of all available single lead predictions. For other lead subsets, voting simply consisted in the average of the lead predictions. Main results. This approach achieved a challenge test score of 0.48, 0.47, 0.46, 0.46, 0.45 on the 12, 6, 4, 3, 2-lead subsets respectively on the 2021 Physionet/Computing in Cardiology challenge hidden test set. The use of an hybrid approach and more advanced voting layer improved some individual class classification but did not offer better generalization than our baseline fully DL approach. Significance. The proposed approach showed potential at correctly classifying main cardiac abnormalities and dealt well with reduced lead subsets.

A Hybrid Analytic Model for the Effective Prediction of Different Stages in Chronic Kidney Ailments

Chronic kidney disease (CKD) is a gradual loss of kidney function over the period of time and it is irrevocable once functionality reaches the critical state. Detecting the various stages of CKD helps to reduce the progression of the disease. Accurate prediction of CKD stages is one of the urgent needs in the medical industry and it can be effectively done by adopting machine learning (ML) techniques. The primary objective of the present research is to develop an effective classification model for the accurate prediction of CKD stages based on the patient’s health profile as well as the clinical test reports. Here, a hybrid ML strategy is employed that integrates random forest (RF) and AdaBoost (AB) techniques through a voting classifier (VC). The standard CKD dataset with 400 tuples and 25 parameters is used for the proposed investigation. The modification of diet in renal disease (MDRD) equation is used to extract an additional feature known as “estimated Glomerular Filtration Rate (eGFR)” for the prediction of the CKD stage. Pre-processing is carried out on the CKD dataset to fill the missing values by considering the skewness of the parameters and the issue of data leakage is also well addressed. Medically important features are considered and Correlation analysis is carried out to select the appropriate features for the model building process. The proposed Hybrid Ensemble Model (HEM) aids in lowering the bias and variance. HEM model efficiency is assessed using the performance metrics such as cross validation score (CVS), accuracy, precision, recall, F1 measure, Mean Squared Error (MSE), bias and variance and it is compared with the state-of-the-art classification schemes. The outcomes of the analysis reveal that the proposed HEM ensures that the CKD stage prediction is more accurate with 99.16%, 100%, 100% in reduced feature set I, set II, set III and with cross validation score of 97.85%, 99.28%, and 99.64% with reduced features set I, set II and set III respectively.

Semantic Analysis and Topic Modelling of Web-Scrapped COVID-19 Tweet Corpora through Data Mining Methodologies.

The evolution of the coronavirus (COVID-19) disease took a toll on the social, healthcare, economic, and psychological prosperity of human beings. In the past couple of months, many organizations, individuals, and governments have adopted Twitter to convey their sentiments on COVID-19, the lockdown, the pandemic, and hashtags. This paper aims to analyze the psychological reactions and discourse of Twitter users related to COVID-19. In this experiment, Latent Dirichlet Allocation (LDA) has been used for topic modeling. In addition, a Bidirectional Long Short-Term Memory (BiLSTM) model and various classification techniques such as random forest, support vector machine, logistic regression, naive Bayes, decision tree, logistic regression with stochastic gradient descent optimizer, and majority voting classifier have been adapted for analyzing the polarity of sentiment. The effectiveness of the aforesaid approaches along with LDA modeling has been tested, validated, and compared with several benchmark datasets and on a newly generated dataset for analysis. To achieve better results, a dual dataset approach has been incorporated to determine the frequency of positive and negative tweets and word clouds, which helps to identify the most effective model for analyzing the corpora. The experimental result shows that the BiLSTM approach outperforms the other approaches with an accuracy of 96.7%.

Classification of ECG using ensemble of residual CNNs with or without attention mechanism

Objective. This paper introduces a winning solution (team ISIBrno-AIMT) to the official round of PhysioNet Challenge 2021. The main goal of the challenge was a classification of ECG recordings into 26 multi-label pathological classes with a variable number of leads (e.g. 12, 6, 4, 3, 2). The main objective of this study is to verify whether the multi-head-attention mechanism influences the model performance. Approach. We introduced an ECG classification method based on the ResNet architecture with a multi-head attention mechanism for the official round of the challenge. However, empirical findings collected during model development suggested that the multi-head attention layer might not significantly impact the final classification performance. For this reason, during the follow-up round, we removed a multi-head attention layer to test the influence on model performance. Like the official round, the model is optimized using a mixture of loss functions, i.e. binary cross-entropy, custom challenge score loss function, and custom sparsity loss function. Probability thresholds for each classification class are estimated using the evolutionary optimization method. The final architecture consists of three submodels forming a majority voting classification ensemble. Main results. The modified model without the multi-head attention layer increased the overall challenge score to 0.59 compared to the 0.58 from the official round. Significance. Our findings from the follow-up submission support the fact that the multi-head attention layer in the proposed architecture does not significantly affect the classification performance.

Major depressive disorder detection in polytechnic college students

Over 322 million people worldwide are affected by depression, the leading cause of disability. Major depressive disorder (MDD) is the most frequent mental disorder and contributes significantly to the global disease burden. Current depression diagnoses, on the other hand, are beset by issues such as patient denial, clinical experience, and self-report bias. Early detection of depression can assist in lessening or even eliminating its detrimental effects. To help the conventional diagnostic approaches in psychiatry, there has been much research into automated depression prediction in recent years. Automated depression identification based on machine learning techniques can help disorder analysts diagnose depression more effectively. The literature on depression has proven that the acoustic features of a depressed individual vary from a normal individual. This paper aims to identify the minimal acoustic features that can be used to detect depression accurately and propose a majority voting classifier for detecting depression (MVCDD). MVCDD is designed with the base classifiers, including Random Forest Classifier (RFC), Support Vector Classifier (SVC), and Logistic Regression (LR). The experiments are performed on the data collected from the students of Government Polytechnic, Masabtank, Hyderabad, India.

CHRONIC KIDNEY DISEASE ANALYSIS USING DATA MINING CLASSIFICATION TECHNIQUES AS A MACHINE LEARNING PERSPECTIVE

Chronic Kidney Disease (CKD) means the kidneys are damaged and are not filtering the blood the way they should. The primary role of kidneys is to filter extra water and waste from the blood to produce urine. If a person suffers from CKD, it means the wastes are collected inside the body which is chronic and can gradually cause damage to the kidneys in the long run. There are many causes for CKD like diabetes, high blood pressure, heart disease. If a particular kidney is not working, then one may notice one or more symptoms like abdominal pain, back pain, diarrhoea, fever, nosebleeds, rash, vomiting. Data Mining is one among the foremost encouraging areas of analysis with the aim of finding helpful information from voluminous knowledge of datasets. Data Mining is especially helpful in medical field when no handiness of proof favouring a treatment is found. Hence the Chronic Kidney Disease (CKD) dataset taken from UCI repository is analysed using different data mining classification. It is observed that LR, SVM techniques have given an accuracy of 93.8% and 94.0% respectively. The techniques RF, KNN, GNB and Voting Classifier have given an accuracy of 100% respectively. For this project, the CKD dataset has been taken from the UCI repository. Classification techniques like Logistic Regression, Support Vector Machine (SVM), K- nearest neighbours (KNN), Random Forest, GNB and Voting Classifier are used in the project.

Fake news spreaders profiling using N-grams of various types and SHAP-based feature selection

Complex learning approaches along with complicated and expensive features are not always the best or the only solution for Natural Language Processing (NLP) tasks. Despite huge progress and advancements in learning approaches such as Deep Learning (DL) and Transfer Learning (TL), there are many NLP tasks such as Text Classification (TC), for which basic Machine Learning (ML) classifiers perform superior to DL or TL approaches. Added to this, an efficient feature engineering step can significantly improve the performance of ML based systems. To check the efficacy of ML based systems and feature engineering on TC, this paper explores char, character sequences, syllables, word n-grams as well as syntactic n-grams as features and SHapley Additive exPlanations (SHAP) values to select the important features from the collection of extracted features. Voting Classifiers (VC) with soft and hard voting of four ML classifiers, namely: Support Vector Machine (SVM) with Linear and Radial Basis Function (RBF) kernel, Logistic Regression (LR), and Random Forest (RF) was trained and evaluated on Fake News Spreaders Profiling (FNSP) shared task dataset in PAN 2020. This shared task consists of profiling fake news spreaders in English and Spanish languages. The proposed models exhibited an average accuracy of 0.785 for both languages in this shared task and outperformed the best models submitted to this task.

IMPROVING CORONARY HEART DISEASE PREDICTION BY OUTLIER ELIMINATION

Nowadays, heart disease is the major cause of deaths globally. According to a survey conducted by the World Health Organization, almost 18 million people die of heart diseases (or cardiovascular diseases) every day. So, there should be a system for early detection and prevention of heart disease. Detection of heart disease mostly depends on the huge pathological and clinical data that is quite complex. So, researchers and other medical professionals are showing keen interest in accurate prediction of heart disease. Heart disease is a general term for a large number of medical conditions related to heart and one of them is the coronary heart disease (CHD). Coronary heart disease is caused by the amassing of plaque on the artery walls. In this paper, various machine learning base and ensemble classifiers have been applied on heart disease dataset for efficient prediction of coronary heart disease. Various machine learning classifiers that have been employed include k-nearest neighbor, multilayer perceptron, multinomial naïve bayes, logistic regression, decision tree, random forest and support vector machine classifiers. Ensemble classifiers that have been used include majority voting, weighted average, bagging and boosting classifiers. The dataset used in this study is obtained from the Framingham Heart Study which is a long-term, ongoing cardiovascular study of people from the Framingham city in Massachusetts, USA. To evaluate the performance of the classifiers, various evaluation metrics including accuracy, precision, recall and f1 score have been used. According to our results, the best accuracy was achieved by logistic regression, random forest, majority voting, weighted average and bagging classifiers but the highest accuracy among these was achieved using weighted average ensemble classifier.

Developing a Deep Learning-Based Detector of Magnetic, Ne, Te and TEC Anomalies from Swarm Satellites: The Case of Mw 7.1 2021 Japan Earthquake

Since the appearance and evolution of earthquake ionospheric precursors are expected to show a nonlinear and complex behaviour, the use of nonlinear predictor models seems more appropriate. This paper proposes a new approach based on deep learning as a powerful tool for extracting the nonlinear patterns from a time series of ionospheric precursors. A Long Short-Term Memory (LSTM) network as a type of Recurrent Neural Network (RNN) was used to investigate 52 six-month time series, deduced from the three Swarm satellite (Alpha (A), Bravo (B) and Charlie (C)) measurements, including electron density (Ne), electron temperature (Te), magnetic scalar and vector (X, Y, Z) components, Slant and Vertical Total Electron Content (STEC and VTEC), for day and night periods around the time and location of a seismic event. This new approach was tested on a strong Mw = 7.1 earthquake in Japan on 13 February 2021, at 14:07:50 UTC by comparing the results with two implemented methods, i.e., Median and LSTM methods. Furthermore, clear anomalies are seen by a voting classification method 1, 6, 8, 13, 31 and 32 days before the earthquake. A comparison with atmospheric data investigation is further provided, supporting the lithosphere–atmosphere–ionosphere coupling (LAIC) mechanism as a suitable theory to explain the alteration of upper geolayers in the earthquake preparation phase. In other words, using multi-method and multi-precursor analysis applied to 52 time series and also to the orbit-by-orbit investigation, the observed anomalies on the previous day and up to 32 days before the event in normal solar and quiet geomagnetic conditions could be considered as a striking hint of the forthcoming Japan earthquake.

SCLAVOEM: hyper parameter optimization approach to predictive modelling of COVID-19 infodemic tweets using smote and classifier vote ensemble.

Fake COVID-19 tweets are dangerous since they are misinformative, completely inaccurate, as threatening the efforts for flattening the pandemic curve. Thus, aside the COVID-19 pandemic, dealing with fake news and myths about the virus constitute an infodemic issue, which must be tackled by ensuring only valid information. In this context, this study proposed the Synthetic Minority Over-Sampling Technique (SMOTE) and the classifier vote ensemble (SCLAVOEM) method as a fake news classifier and a hyper parameter optimization approach for predictive modelling of COVID-19 infodemic tweets. Hyper parameter optimization variables were deployed across specific points of the proposed model and a minority oversampling of training sets was applied within imbalanced class representations. Experimental applications by the SCLAVOEM for COVID-19 infodemic prediction returned 0.999 and 1.000 weighted averages for F-measure and area under curve (AUC), respectively. Thanks to the SMOTE, the performance increases of 3.74 and 1.11%; 5.05 and 0.29%; 4.59 and 8.05% was seen in three different data sets. Eventually, the SCLAVOEM provided a framework for predictive detecting ‘fake tweets’ and three classifiers: ‘positive’, ‘negative’ and ‘click-trap’ (piège à clics). It is thought that the model will automatically flag fake information on Twitter, hence protecting the public from inaccurate and information overload.

An Ensemble Machine Learning Approach for Fake News Detection and Classification Using a Soft Voting Classifier

Fake news has grown in popularity and spread as a result of increased insecurity, political events, and pandemics, among other things. This study used an ensemble machine learning technique to better predict fake news on social media based on the content of news articles. The proposed model used a soft voting classifier to aggregate four machine learning algorithms, namely, Naïve Bayes, Support Vector Machine (SVM), and Logistic Regression, for the classification of news articles as fake or real. GridSearchCV was used to fine-tune the algorithms to get the optimal results during the training process. A Kaggle dataset was used for the experiment; it was comprised of both false and true news. Performance evaluation metrics were used to measure the performance of the base learners and our proposed ensemble technique on the dataset. The results of our experiment show that the proposed ensemble approach produced the highest accuracy, precision, recall, and F1_score values of 93%, 94%, 92%, and 93%, respectively, on the dataset as compared to the individual learners. This approach may also be used in other classification techniques for spam detection, sentiment analysis, and prediction of loan eligibility, among other things.

Classification of pulsar signals using ensemble gradient boosting algorithms based on asymmetric under-sampling method

The detection of pulsar signals is a highly intensive task. Numerous artificial intelligence (AI) and machine learning techniques (ML) have been proposed to classify pulsar and non-pulsar signals. While existing machine learning techniques improve classification efficiency, these methods are limited when it comes to dealing with large volumes of astronomical data, the extreme problem of class imbalance , and the polarization of high recall and precision. In this paper, to accurately classify pulsar and non-pulsar signals, extreme Gradient Boosting (XgBoost), and Light Gradient Boosting Machine (LightGBM) algorithms based on an asymmetric undersampling method are proposed. Firstly, the proposed model uses an asymmetric undersampling technique that divides the benchmark datasets into 75 subsets for the LOFAR Tied-Array All-Sky Survey (LOTAAS-1) and 9 subsets for the High Time Resolution Universe Pulsar Survey (HTRU2), eluding the class imbalance problem. Finally, XgBoost and LightGBM algorithms have been adopted for each new data subset, with a majority voting classifier being used to integrate the output of proposed models against each subset. Results of the proposed method were compared to state-of-the-art baseline models, which showed that our models significantly performed better than existing methods and gained almost 2% and 2.5% better F-score and precision results, respectively.

A Novel Ensemble Bagging Classification Method for Breast Cancer Classification Using Machine Learning Techniques

Breast cancer is observed as a dangerous disease type for women in the world. The clinical experts stated that early detection of cancer helps in saving lives. To detect cancer in the early stage, medical image processing is observed as an effective field. Medical Image processing with an appropriate classification mechanism improves accuracy and image resource with minimal processing time. To detect breast cancer several machine learning techniques are evolved for cancer classification. However, those machine learning techniques are subjected to increased time consumption and limitation in the accuracy of classification. This paper proposed an Ensemble Bagging Weighted Voting Classification (EBWvc) for the classification of breast cancer. Initially, to resolve to overfit in machine learning bagging is applied for collected data. The ensemble bagging classification provides effective training to machine learning for reduced computational time and improved performance characteristics. The weighted voting is adopted for the classification of cancer in the breast. The performance of proposed EBWvc is analyzed comparatively with consideration accuracy, precision, recall, and F1 -Score. The comparative analysis of results exhibited that proposed EBWvc exhibits improved performance than existing classification techniques.

Integrating LASSO Feature Selection and Soft Voting Classifier to Identify Origins of Replication Sites.

Background: DNA replication plays an indispensable role in the transmission of genetic information. It is considered to be the basis of biological inheritance and the most fundamental process in all biological life. Considering that DNA replication initiates with a special location, namely the origin of replication, a better and accurate prediction of the origins of replication sites (ORIs) is essential to gain insight into the relationship with gene expression. Objective: In this study, we have developed an efficient predictor called iORI-LAVT for ORIs identification. Methods: This work focuses on extracting feature information from three aspects, including mono-nucleotide encoding, k-mer and ring-function-hydrogen-chemical properties. Subsequently, least absolute shrinkage and selection operator (LASSO) as a feature selection is applied to select the optimal features. Comparing the different combined soft voting classifiers results, the soft voting classifier based on GaussianNB and Logistic Regression is employed as the final classifier. Results: Based on 10-fold cross-validation test, the prediction accuracies of two benchmark datasets are 90.39% and 95.96%, respectively. As for the independent dataset, our method achieves high accuracy of 91.3%. Conclusion: Compared with previous predictors, iORI-LAVT outperforms the existing methods. It is believed that iORI-LAVT predictor is a promising alternative for further research on identifying ORIs.

Novel Network for Medicinal Leaves Identification

From the ancient days, plant leaves are used to cure various infectious diseases. Even today, herbal leaves are preferred by medicinal experts for treating cancer, asthma, heart problems, etc. The recognition of these herbal plants is based on the visual perception of villagers. There are many kinds of species that seem to be very similar in color and shape. There is a high probability of human error in the identification of such plants. It is inevitable to correctly identify the species of plants to treat the patients. Therefore, a smart plant classification system is essentially required to eliminate human error. This research work develops a hybrid system that is based on deep convolutional neural networks. The system is named as AousethNet which is a modification of AlexNet by replacing its classifier namely, SoftMax with the Majority vote classifier. It is trained to predict the plant species from a huge number of leaf samples from four datasets namely Mendeley, D-Leaf, Flavia, and Folio. Typically, the performance of AousethNet with Mendeley dataset attained an accuracy of 99.89%, precision 98.61%, and very less recognition time of 0.087 s/image. This system is found to have good feature extraction and strong discrimination ability compared with the original version of AlexNet.