Machine Learning Classification Methods Research Articles

Comparison of three machine learning algorithms for classification of B-cell neoplasms using clinical flow cytometry data.

Multiparameter flow cytometry data is visually inspected by expert personnel as part of standard clinical disease diagnosis practice. This is a demanding and costly process, and recent research has demonstrated that it is possible to utilize artificial intelligence (AI) algorithms to assist in the interpretive process. Here we report our examination of three previously published machine learning methods for classification of flow cytometry data and apply these to a B-cell neoplasm dataset to obtain predicted disease subtypes. Each of the examined methods classifies samples according to specific disease categories using ungated flow cytometry data. We compare and contrast the three algorithms with respect to their architectures, and we report the multiclass classification accuracies and relative required computation times. Despite different architectures, two of the methods, flowCat and EnsembleCNN, had similarly good accuracies with relatively fast computational times. We note a speed advantage for EnsembleCNN, particularly in the case of addition of training data and retraining of the classifier.

Indonesian GDP movement detection using online news classification

Gross Domestic Product (GDP) stands as a pivotal indicator, offering strategic insights into economic dynamics. Recent technological advancements, particularly in real-time information dissemination through online economic news platforms, provide an accessible and alternative data source for analyzing GDP movements. This study employs online news classification to identify patterns in the movement and growth rate of Indonesia’s GDP. Utilizing a web scraping technique, we collected data for analysis. The classification models employed include transfer learning from pre-trained language model transformers, with classical machine learning methods serving as baseline models. The results indicate superior performance by the pre-trained language model transformers, achieving the highest accuracy of 0.8880 and 0.7899. In comparison, hyperparameter-tuned classical machine learning models also demonstrated commendable results, with the best accuracy reaching 0.845 and 0.7811. This research underscores the efficacy of leveraging online news classification, particularly through advanced language models. The findings contribute to a nuanced understanding of economic dynamics, aligning with the contemporary landscape of information accessibility and technological progress.

Integrated neural network and evolutionary algorithm approach for liver fibrosis staging: Can artificial intelligence reduce patient costs?

Staging liver fibrosis is important, and liver biopsy is the gold standard diagnostic tool. We aim to design and evaluate an artificial neural network (ANN) method by taking advantage of the Teaching Learning-Based Optimization (TLBO) algorithm for the prediction of liver fibrosis stage in blood donors and hepatitis C patients. We propose a method based on a selection of machine learning classification methods including multilayer perceptron (MLP) neural network, Naive Bayesian (NB), decision tree, and deep learning. Initially, the synthetic minority oversampling technique (SMOTE) is performed to address the imbalance in the dataset. Afterward, the integration of MLP and TLBO is implemented. We propose a novel algorithm that reduces the number of required patient features to seven inputs. The accuracy of MLP using 12 features is 0.903, while that of the proposed MLP with TLBO is 0.891. Besides, the diagnostic accuracy of all methods, except the model designed with the Bayesian network, increases when the SMOTE balancer is applied. The decision tree-based deep learning methods show the highest levels of accuracy with 12 features. Interestingly, with the use of TLBO and seven features, MLP reached an accuracy rate of 0.891, which is quite satisfactory when compared with those of similar studies. The proposed model provides high diagnostic accuracy, while reducing the required number of properties from the samples. The results of our study show that the recruited algorithm of our study is more straightforward, with a smaller number of required properties and similar accuracy.

EEG-based brain-computer interface methods with the aim of rehabilitating advanced stage ALS patients

Amyotrophic Lateral Sclerosis (ALS) is a neurodegenerative disease that leads to progressive muscle weakness and paralysis, ultimately resulting in the loss of ability to communicate and control the environment. EEG-based Brain-Computer Interface (BCI) methods have shown promise in providing communication and control with the aim of rehabilitating ALS patients. In particular, P300-based BCI has been widely studied and used for ALS rehabilitation. Other EEG-based BCI methods, such as Motor Imagery (MI) based BCI and Hybrid BCI, have also shown promise in ALS rehabilitation. Nonetheless, EEG-based BCI methods hold great potential for improvement. This review article introduces and reviews FFT, WPD, CSP, CSSP, CSP, and GC feature extraction methods. The Common Spatial Pattern (CSP) is an efficient and common technique for extracting data properties used in BCI systems. In addition, Linear Discriminant Analysis (LDA), Support Vector Machine (SVM), Neural Networks (NN), and Deep Learning (DL) classification methods were introduced and reviewed. SVM is the most appropriate classifier due to its insensitivity to the curse of dimensionality. Also, DL is used in the design of BCI systems and is a good choice for BCI systems based on motor imagery with big datasets. Despite the progress made in the field, there are still challenges to overcome, such as improving the accuracy and reliability of EEG signal detection and developing more intuitive and user-friendly interfaces By using BCI, disabled patients can communicate with their caregivers and control their environment using various devices, including wheelchairs, and robotic arms.

Machine and Deep Learning Implementations for Heritage Building Information Modelling: A Critical Review of Theoretical and Applied Research

Research domain and Problem: HBIM modelling from point cloud data has become a crucial research topic in the last decade since it is potentially considered as the central data model paving the way for the digital heritage practice beyond digitization. Reality Capture technologies such as terrestrial laser scanning, drone-mounted LiDAR sensors and photogrammetry enable the reality capture with a sub-millimetre accurate point cloud file that can be used as a reference file for Heritage Building Information Modelling (HBIM). However, HBIM modelling from the point cloud data of heritage buildings is mainly manual, error-prone, and time-consuming. Furthermore, image processing techniques are insufficient for classification and segmentation of point cloud data to speed up and enhance the current workflow for HBIM modelling. Due to the challenges and bottlenecks in the scan-to-HBIM process, which is commonly criticized as complex with its bespoke requirements, semantic segmentation of point clouds is gaining popularity in the literature. Research Aim and Methodology: Therefore, this paper aims to provide a thorough critical review of Machine Learning and Deep Learning methods for point cloud segmentation, classification, and BIM geometry automation for cultural heritage case study applications. Research findings: This paper files the challenges of HBIM practice and the opportunities for semantic point cloud segmentation found across academic literature in the last decade. Beyond definitions and basic occurrence statistics, this paper discusses the success rates and implementation challenges of machine and deep learning classification methods. Research value and contribution: This paper provides a holistic review of point cloud segmentation and its potential for further development and application in the Cultural Heritage sector. The critical analysis provides insight into the current state-of-the-art methods and advises on their suitability for HBIM projects. The review has identified highly original threads of research, which hold the potential to significantly influence practice and further applied research.

Fake Job Detection Using Machine Learning

The research suggests using machine learning classification methods to identify and prevent fake job postings online. Nowadays, many companies prefer to advertise their job vacancies on the internet for easy access by job seekers. However, there are scammers who trick people into paying for non-existent jobs. Through data analysis and machine learning, we can distinguish between legitimate and fake job postings. Various algorithms are utilized to detect fraudulent posts and protect job seekers from falling victim to scams. The system is designed to teach the model how to distinguish between real and fake job listings using past data on fraudulent and legitimate job postings. Initially, supervised learning algorithms like classification techniques can be used to tackle the problem of identifying scammers in job ads. It will utilize multiple machine learning algorithms and choose the one with the best accuracy in predicting if a job posting is legitimate or not. Key Words: Fraud Job, Job Seeker, Machine Learning, Internet Recruitment, Classification

Utilizing various statistical methods to model the impact of the COVID-19 pandemic on Gross domestic product

Gross Domestic Product (GDP) is one of the key macroeconomic aggregates that measures the added value produced in a country during a period. In the contemporary world, macroeconomic uncertainty, among others due to the COVID-19 pandemic and the conflict in Ukraine, and GDP prediction remain important goals in public policy making. This study aims to predict Benin's GDP through a unidimensional statistical approach and machine learning techniques. For this purpose, GDP data were collected from the Central Bank of the West African States (BCEAO) website from 1960 to 2021. The predictions are based on comparing classical statistical and machine learning methods. For the classical statistical methods, we investigated the Autoregressive Integrated Moving Average (ARIMA) and Error Trend Seasonality (ETS) forecasting models. As for the machine learning methods, the K-Nearest Neighbors (KNN) and Long Short-Term Memory (LSTM) forecasting models proved to be sound. The findings revealed that the statistical models (ARIMA and ETS) better predict Benin's GDP. However, machine learning models (KNN and LSTM) also provide a wide range of results that can be used to analyze Benin's economic growth.

Unveiling Social Anxiety: Analyzing Acoustic and Linguistic Traits in Impromptu Speech within a Controlled Study

Early detection and treatment of Social Anxiety Disorder (SAD) is crucial. However, current diagnostic methods have several drawbacks, including being time-consuming for clinical interviews, susceptible to emotional bias for self-reports, and inconclusive for physiological measures. Our research focuses on a digital approach using acoustic and linguistic features extracted from participants’ “speech” for diagnosing SAD. Our methodology involves identifying correlations between extracted features and SAD severity, selecting the effective features, and comparing classical machine learning and deep learning methods for predicting SAD. Our results demonstrate that both acoustic and linguistic features outperform deep learning approaches when considered individually. Logistic Regression proves effective for acoustic features, while Random Forest excels with linguistic features, achieving the highest accuracy of 85.71%. Our findings pave the way for non-intrusive SAD diagnosing that can be used conveniently anywhere, facilitating early detection.

Recurrent Neural Networks and classical machine learning methods for concentrations prediction of aluminum alloy in laser Induced breakdown spectroscopy

Recurrent Neural Networks are classes of Artificial Neural Networks that establish connections between various nodes in a directed or undirected graph for investigation of the temporal dynamical. In this study, different Recurrent Neural Network (RNN) architectures are utilized for quantitative analysis of aluminum alloys by the laser induced breakdown spectroscopy (LIBS) technique. The fundamental harmonic (1064 nm) of a nanosecond Nd:YAG laser pulse is employed to generate the LIBS plasma for the prediction of constituent concentrations of the aluminum standard samples. For the purpose of predicting concentration, Recurrent Neural Networks based on different networks, such as Long Short Term Memory (LSTM), Gated Recurrent Unit (GRU), Simple Recurrent Neural Network (Simple RNN), and as well as Recurrent Convolutional Networks comprising of Conv-SimpleRNN, Conv-LSTM and Conv-GRU are employed. Then, a comparison is made among prediction by classical machine learning methods of support vector regressor (SVR), the Multilayer Perceptron (MLP), Decision Tree algorithm, Gradient Boosting Regression (GBR), Random Forest Regression (RFR), Linear Regression, and k-Nearest Neighbor (KNN) algorithm. Results demonstrated that the machine learning tools based on Convolutional Recurrent Networks had the best efficiencies in prediction of the most of the elements among other multivariate methods.

Comparative Assessment of Several Effective Machine Learning Classification Methods for Maternal Health Risk

Comparative Assessment of Several Effective Machine Learning Classification Methods for Maternal Health Risk

A Comparison Study of Deep Learning Methodologies for Music Emotion Recognition.

Classical machine learning techniques have dominated Music Emotion Recognition. However, improvements have slowed down due to the complex and time-consuming task of handcrafting new emotionally relevant audio features. Deep learning methods have recently gained popularity in the field because of their ability to automatically learn relevant features from spectral representations of songs, eliminating such necessity. Nonetheless, there are limitations, such as the need for large amounts of quality labeled data, a common problem in MER research. To understand the effectiveness of these techniques, a comparison study using various classical machine learning and deep learning methods was conducted. The results showed that using an ensemble of a Dense Neural Network and a Convolutional Neural Network architecture resulted in a state-of-the-art 80.20% F1 score, an improvement of around 5% considering the best baseline results, concluding that future research should take advantage of both paradigms, that is, combining handcrafted features with feature learning.

Autoencoder-enabled eye-tracking data analytics for objective assessment of user preference in humanoid robot appearance design

Humanoid robots have been extensively utilized in service industries to provide information and product delivery through direct interactions with users. As the design of humanoid robot appearance significantly impacts human-robot interactions, it is crucial to assess user preference towards it. Traditional evaluation tools, such as surveys, field observations, and interviews, are often time-consuming and subjective. Therefore, this study aims to develop a novel eye-tracking-based assessment tool to investigate user preference towards humanoid robot appearance design. We analyze the critical factors influencing user preference from two perspectives: the attributes of robot appearance and users' selective attention distribution. Accordingly, we propose an integrated machine learning method, combining an autoencoder neural network with a support vector machine to handle the collected visual data. This method, named ASVM, extracts several novel indicators from the eye-tracking data via an unsupervised autoencoder neural network and manual entropy analysis. The proposed ASVM achieves an accuracy of 91%, outperforming other classical machine learning methods, including decision tree, naive Bayes, and support vector machine. ASVM can objectively assess user preference towards humanoid robot appearance design with high time resolution. Furthermore, it can enhance humanoid robot design by revealing the visual attention distribution in assessing robot appearance.

MA-PEP: A novel anticancer peptide prediction framework with multimodal feature fusion based on attention mechanism.

AntiCancer Peptides (ACPs) have emerged as promising therapeutic agents for cancer treatment. The time-consuming and costly nature of wet-lab discriminatory methods has spurred the development of various machine learning and deep learning-based ACP classification methods. Nonetheless, current methods encountered challenges in efficiently integrating features from various peptide modalities, thereby limiting a more comprehensive understanding of ACPs and further restricting the improvement of prediction model performance. In this study, we introduce a novel ACP prediction method, MA-PEP, which leverages multiple attention mechanisms for feature enhancement and fusion to improve ACP prediction. By integrating the enhanced molecular-level chemical features and sequence information of peptides, MA-PEP demonstrates superior prediction performance across several benchmark datasets, highlighting its efficacy in ACP prediction. Moreover, the visual analysis and case studies further demonstrate MA-PEP's reliable feature extraction capability and its promise in the realm of ACP exploration. The code and datasets for MA-PEP are available at https://github.com/liangxiaodata/MA-PEP.

Machine learning classification methods for battery cathode material crystal system

The optimization of lithium-ion battery material design is becoming increasingly pivotal in the context of the transition to new energy sources. This research delves into the classification of the crystal structures of 339 sets of lithium silicate cathode materials, depending on the chemical and physical parameters of the materials to classify the crystal system type. Five classification algorithms were employed in this study, and the classification accuracy was enhanced through algorithm optimization. Notably, the accuracy of the random forest model with PCA (Principal component analysis) =5 reached 74% accuracy with 80% of the data used for training. Simultaneously, this study optimized the model accuracy by fine-tuning parameters such as depth, k-fold, and learning rate. Through this research, the classification accuracy of cathode materials in batteries was further elevated, bearing significant implications for the development of new, suitable battery materials. This research aids in expediting the screening process for researchers and facilitating industrial-scale experimentation, thereby accelerating the application of next-generation batteries.

Misbehavior detection with spatio-temporal graph neural networks

Graph Neural Networks (GNNs) gained the attention of researchers following advancements in Representational Learning. Unlike classical machine learning (ML) methods, its ability to represent more concepts on its data structure gives GNN a clear head start. On the other hand, Misbehavior Detection (MBD) has become a security solution for authorized vehicles to protect against malicious activities on Vehicles to Everything (V2X) Networks. Although authorities standardize MBD, there are not enough MBD datasets for ML, and existing ones are unsuitable for GNNs. In this study, we address this issue by providing an algorithm to convert classical MBD datasets for GNN. Then, a novel GNN model is proposed to detect misbehaving activity on V2X networks. Obtained results show that the proposed GNN model outperforms existing methods with 99.92% accuracy, 99.9196% recall, 31% better runtime efficiency, and 97.35% Matthews correlation coefficient.

PHE-SICH-CT-IDS: A benchmark CT image dataset for evaluation semantic segmentation, object detection and radiomic feature extraction of perihematomal edema in spontaneous intracerebral hemorrhage

Background and objective:Intracerebral hemorrhage is one of the diseases with the highest mortality and poorest prognosis worldwide. Spontaneous intracerebral hemorrhage (SICH) typically presents acutely, prompt and expedited radiological examination is crucial for diagnosis, localization, and quantification of the hemorrhage. Early detection and accurate segmentation of perihematomal edema (PHE) play a critical role in guiding appropriate clinical intervention and enhancing patient prognosis. However, the progress and assessment of computer-aided diagnostic methods for PHE segmentation and detection face challenges due to the scarcity of publicly accessible brain CT image datasets. Methods:This study establishes a publicly available CT dataset named PHE-SICH-CT-IDS for perihematomal edema in spontaneous intracerebral hemorrhage. The dataset comprises 120 brain CT scans and 7,022 CT images, along with corresponding medical information of the patients. To demonstrate its effectiveness, classical algorithms for semantic segmentation, object detection, and radiomic feature extraction are evaluated. The experimental results confirm the suitability of PHE-SICH-CT-IDS for assessing the performance of segmentation, detection and radiomic feature extraction methods. Results:This study conducts numerous experiments using classical machine learning and deep learning methods, demonstrating the differences in various segmentation and detection methods on the PHE-SICH-CT-IDS. The highest precision achieved in semantic segmentation is 76.31%, while object detection attains a maximum precision of 97.62%. The experimental results on radiomic feature extraction and analysis prove the suitability of PHE-SICH-CT-IDS for evaluating image features and highlight the predictive value of these features for the prognosis of SICH patients. Conclusion:To the best of our knowledge, this is the first publicly available dataset for PHE in SICH, comprising various data formats suitable for applications across diverse medical scenarios. We believe that PHE-SICH-CT-IDS will allure researchers to explore novel algorithms, providing valuable support for clinicians and patients in the clinical setting. PHE-SICH-CT-IDS is freely published for non-commercial purpose at https://figshare.com/articles/dataset/PHE-SICH-CT-IDS/23957937.

FORECASTING THE EURO EXCHANGE RATE USING DEEP LEARNING ALGORITHMS AND MACHINE LEARNING ALGORITHMS

Given that time series forecasts are of great importance in the financial world, the main objective of this study is to forecast Euro prices and examine the contribution of these forecasts to financial decision-making processes. Since the Euro is an important component of international trade and investment, accurate price forecasts are of strategic importance for many financial institutions and investors. In this study, we compare the performance of deep learning algorithms and classical machine learning methods for forecasting Euro prices: support vector machines (SVM), Extreme Gradient Boosting (XGBoost), long short-term memory (LSTM), and gated recurrent units (GRU). These methods represent different algorithms that are widely used in financial forecasting and give successful results. The dataset used in the study was divided into two parts: 80% training and 20% testing, and it is also indicated how each algorithm behaved during the training process and which parameters were chosen. The results are presented by comparing the performance of these algorithms, and it is found that the GRU algorithm provides better accuracy than the others. Therefore, the GRU algorithm was chosen to forecast Euro prices for the next 12 months, and the forecasting process was carried out. The results of this study are expected to provide an important perspective to financial decision-makers by comprehensively comparing the performance of deep learning and traditional approaches in Euro price forecasting. It also includes potential research avenues for future work and suggestions for the development of new methods in this area.

Machine-Learning-Based Traffic Classification in Software-Defined Networks

Many research efforts have gone into upgrading antiquated communication network infrastructures with better ones to support contemporary services and applications. Smart networks can adapt to new technologies and traffic trends on their own. Software-defined networking (SDN) separates the control plane from the data plane and runs programs in one place, changing network management. New technologies like SDN and machine learning (ML) could improve network performance and QoS. This paper presents a comprehensive research study on integrating SDN with ML to improve network performance and quality-of-service (QoS). The study primarily investigates ML classification methods, highlighting their significance in the context of traffic classification (TC). Additionally, traditional methods are discussed to clarify the ML outperformance observed throughout our investigation, underscoring the superiority of ML algorithms in SDN TC. The study describes how labeled traffic data can be used to train ML models for appropriately classifying SDN TC flows. It examines the pros and downsides of dynamic and adaptive TC using ML algorithms. The research also examines how ML may improve SDN security. It explores using ML for anomaly detection, intrusion detection, and attack mitigation in SDN networks, stressing the proactive threat-detection and response benefits. Finally, we discuss the SDN-ML QoS integration problems and research gaps. Furthermore, scalability and performance issues in large-scale SDN implementations are identified as potential issues and areas for additional research.

Inversion of winter wheat leaf area index from UAV multispectral images: classical vs. deep learning approaches.

Precise and timely leaf area index (LAI) estimation for winter wheat is crucial for precision agriculture. The emergence of high-resolution unmanned aerial vehicle (UAV) data and machine learning techniques offers a revolutionary approach for fine-scale estimation of wheat LAI at the low cost. While machine learning has proven valuable for LAI estimation, there are still model limitations and variations that impede accurate and efficient LAI inversion. This study explores the potential of classical machine learning models and deep learning model for estimating winter wheat LAI using multispectral images acquired by drones. Initially, the texture features and vegetation indices served as inputs for the partial least squares regression (PLSR) model and random forest (RF) model. Then, the ground-measured LAI data were combined to invert winter wheat LAI. In contrast, this study also employed a convolutional neural network (CNN) model that solely utilizes the cropped original image for LAI estimation. The results show that vegetation indices outperform the texture features in terms of correlation analysis with LAI and estimation accuracy. However, the highest accuracy is achieved by combining both vegetation indices and texture features to invert LAI in both conventional machine learning methods. Among the three models, the CNN approach yielded the highest LAI estimation accuracy (R 2 = 0.83), followed by the RF model (R 2 = 0.82), with the PLSR model exhibited the lowest accuracy (R 2 = 0.78). The spatial distribution and values of the estimated results for the RF and CNN models are similar, whereas the PLSR model differs significantly from the first two models. This study achieves rapid and accurate winter wheat LAI estimation using classical machine learning and deep learning methods. The findings can serve as a reference for real-time wheat growth monitoring and field management practices.

Machine learning model based on non-convex penalized huberized-SVM

The support vector machine (SVM) is a classical machine learning method. Both the hinge loss and least absolute shrinkage and selection operator (LASSO) penalty are usually used in traditional SVMs. However, the hinge loss is not differentiable, and the LASSO penalty does not have the Oracle property. In this paper, the huberized loss is combined with non-convex penalties to obtain a model that has the advantages of both the computational simplicity and the Oracle property, contributing to higher accuracy than traditional SVMs. It is experimentally demonstrated that the two non-convex huberized-SVM methods, smoothly clipped absolute deviation huberized-SVM (SCAD-HSVM) and minimax concave penalty huberized-SVM (MCP-HSVM), outperform the traditional SVM method in terms of the prediction accuracy and classifier performance. They are also superior in terms of variable selection, especially when there is a high linear correlation between the variables. When they are applied to the prediction of listed companies, the variables that can affect and predict financial distress are accurately filtered out. Among all the indicators, the indicators per share have the greatest influence while those of solvency have the weakest influence. Listed companies can assess the financial situation with the indicators screened by our algorithm and make an early warning of their possible financial distress in advance with higher precision.