Conventional Classification Algorithms Research Articles

Assessment of few-hits machine learning classification algorithms for low-energy physics in liquid argon detectors

The physics potential of massive liquid argon TPCs in the low-energy regime is still to be fully reaped because few-hits events encode information that can hardly be exploited by conventional classification algorithms. Machine learning (ML) techniques give their best in these types of classification problems. In this paper, we evaluate their performance against conventional (deterministic) algorithms. We demonstrate that both Convolutional Neural Networks (CNN) and Transformer-Encoder methods outperform deterministic algorithms in one of the most challenging classification problems of low-energy physics (single- versus double-beta events). We discuss the advantages and pitfalls of Transformer-Encoder methods versus CNN and employ these methods to optimize the detector parameters, with an emphasis on the DUNE Phase II detectors (“Module of Opportunity”).

PFSC: Parameter-free sphere classifier for imbalanced data classification

Imbalanced data classification is a prevalent challenge in real-world applications. While a conventional sphere-based classification algorithm, random sphere cover (RSC), evenly constructs a set of spheres for two classes in balanced data using a parameter for the minimum sphere size, it struggles with constructing minority spheres in class-imbalanced data. Although RSC can be combined with existing oversampling methods, this approach requires additional hyperparameters, and its effectiveness decreases as the minority size decreases. To overcome these issues, we propose a novel approach that employs the area under the receiver operating characteristic curve (AUC) to construct and expand spheres for minority class. This parameter-free sphere classifier considers both the majority and minority classes simultaneously. We conducted a thorough experiment on both synthetic and 50 real datasets, which revealed that our proposed method outperformed existing various oversampling techniques with the lowest training time.

A comprehensive exploration of machine learning techniques for EEG-based anxiety detection.

The performance of electroencephalogram (EEG)-based systems depends on the proper choice of feature extraction and machine learning algorithms. This study highlights the significance of selecting appropriate feature extraction and machine learning algorithms for EEG-based anxiety detection. We explored different annotation/labeling, feature extraction, and classification algorithms. Two measurements, the Hamilton anxiety rating scale (HAM-A) and self-assessment Manikin (SAM), were used to label anxiety states. For EEG feature extraction, we employed the discrete wavelet transform (DWT) and power spectral density (PSD). To improve the accuracy of anxiety detection, we compared ensemble learning methods such as random forest (RF), AdaBoost bagging, and gradient bagging with conventional classification algorithms including linear discriminant analysis (LDA), support vector machine (SVM), and k-nearest neighbor (KNN) classifiers. We also evaluated the performance of the classifiers using different labeling (SAM and HAM-A) and feature extraction algorithms (PSD and DWT). Our findings demonstrated that HAM-A labeling and DWT-based features consistently yielded superior results across all classifiers. Specifically, the RF classifier achieved the highest accuracy of 87.5%, followed by the Ada boost bagging classifier with an accuracy of 79%. The RF classifier outperformed other classifiers in terms of accuracy, precision, and recall.

Real-time counting of wheezing events from lung sounds using deep learning algorithms: Implications for disease prediction and early intervention.

This pioneering study aims to revolutionize self-symptom management and telemedicine-based remote monitoring through the development of a real-time wheeze counting algorithm. Leveraging a novel approach that includes the detailed labeling of one breathing cycle into three types: break, normal, and wheeze, this study not only identifies abnormal sounds within each breath but also captures comprehensive data on their location, duration, and relationships within entire respiratory cycles, including atypical patterns. This innovative strategy is based on a combination of a one-dimensional convolutional neural network (1D-CNN) and a long short-term memory (LSTM) network model, enabling real-time analysis of respiratory sounds. Notably, it stands out for its capacity to handle continuous data, distinguishing it from conventional lung sound classification algorithms. The study utilizes a substantial dataset consisting of 535 respiration cycles from diverse sources, including the Child Sim Lung Sound Simulator, the EMTprep Open-Source Database, Clinical Patient Records, and the ICBHI 2017 Challenge Database. Achieving a classification accuracy of 90%, the exceptional result metrics encompass the identification of each breath cycle and simultaneous detection of the abnormal sound, enabling the real-time wheeze counting of all respirations. This innovative wheeze counter holds the promise of revolutionizing research on predicting lung diseases based on long-term breathing patterns and offers applicability in clinical and non-clinical settings for on-the-go detection and remote intervention of exacerbated respiratory symptoms.

A sparrow search algorithm-optimized convolutional neural network for imbalanced data classification using synthetic minority over-sampling technique

Due to the large span of flight delay, numerous influencing factors and large number of flights, the collected flight delay data is characterized by large-scale and imbalance, which is considered as one of the largest challenges in balanced flight delay data classification by using conventional classification algorithms. To solve this problem, an adaptive multi-class classification approach of imbalanced flight delay data using synthetic minority over-sampling technique (SMOTE)-based convolutional neural network with sparrow search algorithm, namely SSA-LTCNN is proposed in this paper. Firstly, the SMOTE is used to reduce the imbalance between the classes of the flight delay data. Then, the qualitative analysis method is employed to determine the key parameters of the CNN, which are optimized by using SSA to establish an optimized CNN model. Finally, the optimized CNN model with more effective feature representation ability is employed to extract discriminative features from the balanced flight delay data automatically. The obtained features in the last fully connected layer of the optimized CNN model are used for flight delay classification. The MIT-BIH Arrhythmia Data is selected to verify the effectiveness of the proposed SSA-LTCNN method and the confusion matrix, classification accuracy, precision, recall and F1 score are also used to evaluate the performance of the proposed SSA-LTCNN method, which can get better performance than RF, DT, LR, CNN and QRSCNN. The actual flight delay data is processed to verify the effectiveness of the proposed classification approach, which can achieve higher accuracy than KNN, NB, UCNN, CNN, SSA-LCNN and SSA-TCNN in different time periods. The experimental results show that the SSA-LTCNN can fast and effectively realize the classification of MIT-BIH Arrhythmia Data and flight delay data.

Frequency estimation of multiple complex sinusoids using noise suppressing predictive FIR filter

The paper presents a predictive filter based frequency estimation algorithm (PF-FE) for multiple complex sinusoids corrupted by additive white Gaussian noise. The proposed frequency estimator combines the noise suppression capability of an FIR filter with a least squares approach minimizing the sum of the squared errors of a prediction filter. The FIR filter coefficients are chosen such that the sinusoidal components are predicted with minimum distortion. Computer simulation results are given to contrast the performance of the proposed PF-FE method with six other state-of-the-art frequency-estimators and the Cramer-Rao lower bound. Furthermore, the paper provides a complexity analysis of the PF-FE method and compares it with those of the conventional MUltiple SIgnal Classification algorithm and some selected state-of-the-art methods from the literature. Performance of the proposed PF-FE method is validated with effective mean square error (EMSE) plots for model orders of three and five and under different observation lengths and signal-to-noise ratio values. Finally, the paper demonstrates how EMSE varies for the proposed method when the prediction filter length is increased from 20 to 75. After extensive simulations, it is observed that when filter length is larger than half the observation length the EMSE will start to degrade.

Secure Face and Liveness Detection with Criminal Identification for Security Systems

The advancement of computer vision, machine learning, and image processing techniques has opened new avenues for enhancing security systems. In this research work focuses on developing a robust and secure framework for face and liveness detection with criminal identification, specifically designed for security systems. Machine learning algorithms and image processing techniques are employed for accurate face detection and liveness verification. Advanced facial recognition methods are utilized for criminal identification. The framework incorporates ML technology to ensure data integrity and identification techniques for security system. Experimental evaluations demonstrate the system's effectiveness in detecting faces, verifying liveness, and identifying potential criminals. The proposed framework has the potential to enhance security systems, providing reliable and secure face and liveness detection for improved safety and security.
 The accuracy of the algorithm is 94.30 percent. The accuracy of the model is satisfactory even after the results are acquired by combining our rules inwritten by humans with conventional machine learning classification algorithms. Still, there is scope for improving and accurately classifying the attack precisely.

RETRACTED: Cost-sensitive classification algorithm combining the Bayesian algorithm and quantum decision tree

This study highlights the drawbacks of current quantum classifiers that limit their efficiency and data processing capabilities in big data environments. The paper proposes a global decision tree paradigm to address these issues, focusing on designing a complete quantum decision tree classification algorithm that is accurate and efficient while also considering classification costs. The proposed method integrates the Bayesian algorithm and the quantum decision tree classification algorithm to handle incremental data. The proposed approach generates a suitable decision tree dynamically based on data objects and cost constraints. To handle incremental data, the Bayesian algorithm and quantum decision tree classification algorithm are integrated, and kernel functions obtained from quantum kernel estimation are added to a linear quantum support vector machine to construct a decision tree classifier using decision directed acyclic networks of quantum support vector machine nodes (QKE). The experimental findings demonstrate the effectiveness and adaptability of the suggested quantum classification technique. In terms of classification accuracy, speed, and practical application impact, the proposed classification approach outperforms the competition, with an accuracy difference from conventional classification algorithms being less than 1%. With improved accuracy and reduced expense as the incremental data increases, the efficiency of the suggested algorithm for incremental data classification is comparable to previous quantum classification algorithms. The proposed global decision tree paradigm addresses the critical issues that need to be resolved by quantum classification methods, such as the inability to process incremental data and the failure to take the cost of categorization into account. By integrating the Bayesian algorithm and the quantum decision tree classification algorithm and using QKE, the proposed method achieves high accuracy and efficiency while maintaining high performance when processing incremental sequences and considering classification costs. Overall, the theoretical and experimental findings demonstrate the effectiveness of the suggested quantum classification technique, which offers a promising solution for handling big data classification tasks that require high accuracy and efficiency.

Intrusion Detection System using the Hybrid Model of Classification Algorithm and Rule-Based Algorithm

Intrusion detection system ID is necessary to secure the system from various intrusions. Analysis of the communication to categorize the data as useful or malicious data is crucial. The cyber security employed using intrusion detection systems should not also cause the extra time to perform the categorization. Nowadays machine learning techniques are used to make the identification of malicious data or an intrusion with the help of classification algorithms. The data set used for experimenting is KDD cup 99. The effect of individual classification algorithms can be improvised with the help of hybrid classification models. This model combines classification algorithms with rule-based algorithms. The blend of classification using machine and human intelligence adds an extra layer of security. An algorithm is validated using precision, recall, F-Measure, and Mean age Precision. The accuracy of the algorithm is 92.35 percent. The accuracy of the model is satisfactory even after the results are acquired by combining our rules inwritten by humans with conventional machine learning classification algorithms. Still, there is scope for improving and accurately classifying the attack precisely.

Design of a Sleep Modulation System with FPGA-Accelerated Deep Learning for Closed-loop Stage-Specific In-Phase Auditory Stimulation.

Closed-loop sleep modulation is an emerging research paradigm to treat sleep disorders and enhance sleep benefits. However, two major barriers hinder the widespread application of this research paradigm. First, subjects often need to be wire-connected to rack-mount instrumentation for data acquisition, which negatively affects sleep quality. Second, conventional real-time sleep stage classification algorithms give limited performance. In this work, we conquer these two limitations by developing a sleep modulation system that supports closed-loop operations on the device. Sleep stage classification is performed using a lightweight deep learning (DL) model accelerated by a low-power field-programmable gate array (FPGA) device. The DL model uses a single channel electroencephalogram (EEG) as input. Two convolutional neural networks (CNNs) are used to capture general and detailed features, and a bidirectional long-short-term memory (LSTM) network is used to capture time-variant sequence features. An 8-bit quantization is used to reduce the computational cost without compromising performance. The DL model has been validated using a public sleep database containing 81 subjects, achieving a state-of-the-art classification accuracy of 85.8% and a F1-score of 79%. The developed model has also shown the potential to be generalized to different channels and input data lengths. Closed-loop in-phase auditory stimulation has been demonstrated on the test bench.

Enriched Model of Case Based Reasoning and Neutrosophic Intelligent System for DDoS Attack Defence in Software Defined Network based Cloud

Software Defined Networking in Cloud paradigm is most suitable for dynamic functionality and reduces the computation complexity. The routers and switches located at the network's boundaries are managed by software-defined netwrking (SDN) using open protocols and specialised open programmable interfaces. But the security threats often degrade the performance of SDN due to its constraints of resource usage. The most sensitive components which are vulnerable to DDoS attacks are controller and control plane bandwidth. The existing conventional classification algorithms lacks in detection of new or unknown traffic packets which are malicious and results in degradation of SDN performance in cloud resources. Hence, in this paper double filtering methodology is devised to detect both known and unknown pattern of malicious packets which affects the bandwidth of the control panel and the controller. The case-based reasoning is adapted for determining the known incoming traffic patterns before entering the SDN system. It classifies the packets are normal or abnormal based on the previous information gathered. The traffic patterns which is not matched from the previous patterns is treated as indeterministic packet and it is defined more precisely using the triplet representation of Neutrosophic intelligent system. The grade of belongingness, non-belongingness and indeterminacyis used as the main factors to detect the new pattern of attacking packets more effectively. From the experimental outcomes it is proved that DDoS attack detection in SDN based cloud environment is improved by adopting CBR-NIS compared to the existing classification model.

A new phishing-website detection framework using ensemble classification and clustering

Phishing websites are characterized by distinguished visual, address, domain, and embedded features, which identify and defend such threats. Yet, phishing website detection is challenged by overlapping these features with legitimate websites’ features. As the inter-class variance between legitimate and phishing websites becomes low, commonly utilized machine learning algorithms suffer from low performance in overlapping feature cases. Alternatively, ensemble learning that combines multiple predictions intending to address low inter-class variations in the classified data improves the performance in such cases. Ensemble learning utilizes multiple classifiers of similar or different types with multiple deviations of the training data. This paper develops a framework based on random forest ensemble techniques. The limitations of the random forest are the inability to capture the high correlation between features and their join dependency on the label. The random forest is combined with k-means clustering to capture the feature correlation. The framework is evaluated for phishing detection with a dataset of 5000 samples. The results showed the proposed framework over-performed the random forest classifier, all other ensemble classifiers, and the conventional classification algorithms. The proposed framework achieved an accuracy of 98.64%, precision of 0.986, recall of 0.987, and F-measure of 0.986.

Classification of a quickbird satellite image by Machine learning techniques: Mapping an urban Environement by decision tree method

Classification is a crucial stage in the processing of satellite images that influence considerably the quality of the result. A variety of methods is proposed in the literature for the purposes of image classification. They present many differences in their basic principles, thus in the quality of the results obtained. Therefore, a study of different classification methods seems to be essential. The classification of satellite images with conventional methods can be done in several ways using different algorithms. These algorithms can be divided into two main categories: supervised and non-supervised. Decision tree on the contrary is a machine learning tool. It is a plain model characterized by the simplicity of understanding and interpretation. This work aims firstly, to classify a high resolution Quickbird satellite image of an urban area by the decision tree method and compare it with the conventional classification algorithms in order to evaluate its efficiency. The methodology consists of two main stages: classification and evaluation of results. The second is based on the calculation of a number of statistical indices derived from the confusion matrix: the statistical parameter “kappa’ and the overall coefficient of precision.

Deep Multiple Instance Learning Approach for Classification in Clinical Decision Support Systems

To get around the drawbacks of conventional classification algorithms that required manual feature extraction and the high computational cost of neural networks, this paper introduces a deep convolutional neural network with multiple instance learning approaches, namely dynamic max pooling and sparse representation. For the categorization of tuberculosis lung illness, this model combines deep convolutional neural networks and multiple instance learning. The design was composed of four phases: pre-processing, instance production, feature extraction, and classification. To perform feature extraction, a model based on a customized version of the VGG16 architecture was trained from scratch. Multiple instance learning techniques such as Diverse Density (DD) and the Maximum pattern bag formulation of the Support Vector Machine were used to evaluate how well the proposed classification algorithm performed in comparison (SVM).The numerical findings demonstrated that the new method offered a higher level of accuracy than the methods that had been used in the past. When evaluating the efficacy of the current method, accuracy, specificity, sensitivity, and error rate were all taken into consideration. The accuracy of the max-pooling based framework and the sparse representation framework was found to be greater than that of the other multiple instance strategies, coming in at 91.51% and 89.84%, respectively, when compared to that of the other methods. The improved accuracy of the present system that makes use of deep neural networks is mostly attributable to the contributions made by features such as transfer learning and automatic feature extraction.

A SURVEY ON BIOMEDICAL TEXT DOCUMENT CLASSIFICATION

Information extraction, information retrieval, and text classification are only a few of the important study areas that fall under the heading of "bio medical text classification." In order to increase understanding of various information extraction opportunities in the field of data mining, this study analyses several text categorization approaches used in practise, their strengths and shortcomings. We have gathered a dataset with a strong emphasis on three categories, including "Thyroid Cancer," "Lung Cancer," and "Colon Cancer." This essay offers an empirical investigation of a classifier. Benchmarks for biomedical text were used to conduct the experiment. We study many metaheuristic algorithms, including genetic algorithms, particle swarm optimization, firefly, cuckoo, and bat algorithms. The suggested multiple classifier system also outperforms ensemble learning, ensemble pruning, and conventional classification algorithms. In the data we use predict the Biomedical text document classification is whether it's Thyroid Cancer, Lung Cancer, Colon Cancer based on the performed basic EDA, text pre-processing, build different models, such as LogisticRegression, DecisiontreeClassification, RandomForest Classification

COVIDDCGAN: Oversampling Model Using DCGAN Network to Balance a COVID-19 Dataset

The COVID-19 infection was announced as a pandemic in late 2019. Due to the high speed of the spread, rapid diagnosis can prevent the virus outbreak. Detection of the virus using prominent information from CT scan images is a fast, cheap, and accessible method. However, these image datasets are imbalanced due to the nature of medical data and the lack of coronavirus images. Consequently, the conventional classification algorithms classify this data unsuitably. Oversampling technique is one of the most well-known methods that try to balance the dataset by increasing the minority class of the data. This paper presents a new oversampling model using an improved deep convolutional generative adversarial network (DCGAN) to produce samples that improve classifier performance. In previous DCGAN structures, the feature extraction took place only in the convolution layer, while in the proposed structure, it is done in both the convolution layer and the pooling layer. A Haar transform layer as the pooling layer tries to extract better features. Evaluation results on two hospital datasets express an accuracy of 95.8 and a loss criterion of 0.5354 for the suggested architecture. Moreover, compared to the standard DCGAN structure, the proposed model has superiority in all classification criteria. Therefore, the new model can assist radiologists in validating the initial screening.

A novel hybrid resampling for semiconductor wafer defect bin classification

AbstractGenerally, defective dies on semiconductor wafer maps tend to form spatial clusters in distinguishable patterns which contain crucial information on specific problems of equipment or process, thus it is highly important to identify and classify diverse defect patterns accurately. However, in practice, there exists a serious class imbalance problem, that is, the number of the defective dies on semiconductor wafer maps is usually much smaller than that of the non‐defective dies. In various machine learning applications, a typical classification algorithm is, however, developed under the assumption that the number of instances for each class is nearly balanced. If the conventional classification algorithm is applied to a class imbalanced dataset, it may lead to incorrect classification results and degrade the reliability of the classification algorithm. In this research, we consider the semiconductor wafer defect bin data combined with wafer warpage information and propose a new hybrid resampling algorithm to improve performance of classifiers. From the experimental analysis, we show that the proposed algorithm provides better classification performance compared to other data preprocessing methods regardless of classification models.

DEEP LEARNING ALGORITHM FOR CERVICAL CANCER DETECTION BASED ON IMAGES OF OPTOMAGNETIC SPECTRA

In order to further investigate performance of Optomagnetic Imaging Spectroscopy in cervical cancer detection, deep learning algorithm has been used for classification of optomagnetic spectra of the samples. Optomagnetic spectra reflect cell properties and based on those properties it is possible to differentiate normal cells from cells showing different levels of dysplasia and cancer cells. In one of the previous research, Optomagnetic imaging spectroscopy has demonstrated high percentages of accuracy, sensitivity and specificity in cervical cancer detection, particularly in the case of binary classification. Somewhat lower accuracy percentages were obtained in the case of four class classification. Compared to the results obtained by conventional machine learning classification algorithms, proposed deep learning algorithm achieves similar accuracy results (80%), greater sensitivity (83.3%), and comparable specificity percentages (78%).

Multitemporal impervious surface estimation via an optimized stable/change pixel detection approach

ABSTRACT Remote sensing techniques have proved its efficacy for the impervious surface mapping, which is a significant indicator of urbanization process and environmental status. However, systematic and random errors in the existing methods still impact the reliability of subpixel impervious surface estimation, generating compounded errors when conducting multitemporal monitoring. The compounded errors of the conventional methods often significantly impact the temporal consistency of the results. In this study, a novel method based on a straightforward pixel change detection approach was put forward to improve the estimation of multitemporal impervious surface area. Two experimental areas located in Rome in Italy and Shenzhen in China were chosen to testify the generality of the proposed method to estimate different types of impervious surfaces worldwide. By reducing the compounded errors, the proposed method demonstrated its efficiency in achieving higher accuracy in both study areas without involving extensive data sources and intensive manual tasks. Compared with the conventional classification and regression tree algorithm, the overall mean average error and root mean square error of this study declined by more than 15.55% and 8.63%, respectively, and R2 increased from approximately 0.93 to 0.96. The proposed method also drastically reduced the standard deviation of the multitemporal percent ISA of the stable pixels. The accurate change estimation of percent ISA has been a fundamental but challenging issue associated with monitoring and understanding the urban environment. Therefore, our proposed method, with its improved ability to estimate impervious surface change both spatially and temporally, can provide accurate information required for urban environment research.

Azimuth Estimation for the Backscatter Device in Ambient Backscatter Communication System

In this letter, we study the azimuth estimation for the backscatter device (BD) in ambient backscatter communication system, where the receiver is equipped with the uniform linear array (ULA). By utilizing the covariance matrices in two symbol periods with different BD symbols, we apply the conventional multiple signal classification (MUSIC) algorithm to estimate the azimuths of both the BD and the ambient radio frequency (RF) source. Then, we propose a novel eigenvector-based algorithm to identify the azimuth of the BD from the two estimated azimuths. Moreover, we qualitatively analyze the impacts of the reflection coefficients on the performance of the proposed azimuth estimation approach. Finally, the simulation results are provided to validate the effectiveness of the proposed method and to justify the qualitative analytical conclusions.