Machine Learning Classification Algorithms Research Articles

Genome-wide association studies of ischemic stroke based on interpretable machine learning

Despite the identification of several dozen genetic loci associated with ischemic stroke (IS), the genetic bases of this disease remain largely unexplored. In this research we present the results of genome-wide association studies (GWAS) based on classical statistical testing and machine learning algorithms (logistic regression, gradient boosting on decision trees, and tabular deep learning model TabNet). To build a consensus on the results obtained by different techniques, the Pareto-Optimal solution was proposed and applied. These methods were applied to real genotypic data of sick and healthy individuals of European ancestry obtained from the Database of Genotypes and Phenotypes (5,581 individuals, 883,749 single nucleotide polymorphisms). Finally, 131 genes were identified as candidates for association with the onset of IS. UBQLN1, TRPS1, and MUSK were previously described as associated with the course of IS in model animals. ACOT11 taking part in metabolism of fatty acids was shown for the first time to be associated with IS. The identified genes were compared with genes from the Illuminating Druggable Genome project. The product of GPR26 representing the G-coupled protein receptor can be considered as a therapeutic target for stroke prevention. The approaches presented in this research can be used to reprocess GWAS datasets from other diseases.

New Directions and Development Models for College Student Education based on Machine Learning Classification Algorithms

For the contemporary student teaching system, the information-based education management system has played a positive role in the rapid promotion of teaching. In order to get the teaching exploration data of modern information management from the data increment on the Internet, this paper updates the technology of data mining. This paper constructs a quantitative table for teacher positions and conducts ideological and political job evaluations in the database. This paper mainly focuses on the management and construction of ideological informatization based on the [Formula: see text]-means algorithm. By using the [Formula: see text]-means algorithm to analyze the daily behavior data of students, we can discover their behavior patterns and trends, providing decision support for student management. For example, by analyzing data such as students’ internet time, social activities, and library borrowing records, we can understand their interests, hobbies, and learning habits, providing a foundation for personalized education. Cluster analysis of students’ ideological and political performance using the [Formula: see text]-means algorithm can identify student groups with different ideological tendencies. This helps schools to carry out targeted ideological and political education work, and improve the pertinence and effectiveness of ideological and political education. Through quality tracking analysis of educational evaluation, it has carried out educational informatization tracking management using an information model. In the process of judging and analyzing different subjects, it utilized the hot topics of universities for a more comprehensive information intelligent tracking management.

Fuzzy Logic and Machine Learning Algorithms for Detection and Classification of Falls and Activities of Daily Living

This article analyses the movements of young and elderly people using data collected from an accelerometer and a gyroscope. This study proposes Type I fuzzy logic (FL) and several machine learning (ML) algorithms for the detection and classification of daily life movements and falls. The results obtained demonstrate that a fuzzy logic system can efficiently integrate data from an accelerometer and a gyroscope to classify falls and movements in daily life with 97.4% accuracy. When ML classifiers are used, the performance across several algorithms is also very high.

Cumulative learning based segmentation aided cell mixtures classification in digital holographic microscopy

The tumor microenvironment consists of several components like tumor cells, normal healthy cells, extracellular matrix, secreted factors, and other non-cellular components. The interaction among these components is crucial for tumor progression and metastasis. Identifying the presence of tumor cells among the normal healthy cells during the initial stages of cancer will aid in its early detection and treatment. One of the main features that differentiates a cancer cell from a normal healthy cell distinctively is its morphology. In this study, the effectiveness of machine learning algorithms is evaluated in classifying cells co-cultured in a Petri dish. To achieve this, digital holographic microscopy is used to capture the quantitative phase images of human dermal fibroblast and A375 human melanoma cancer cells co-cultured at 1:1, 1:2, and 2:1 ratios. Cell segmentation was performed using a cumulative learning approach. Subsequently, morphological and phase-based features were extracted to train the machine learning algorithms for binary classification of cells. Phase-based features in addition to the morphological features were found to provide improved performance of the classifier. The classifier demonstrated an average F1-score of 0.9 during testing.

Mapping schistosomiasis risk landscapes and implications for disease control: A case study for low endemic areas in the Middle Paranapanema river basin, São Paulo, Brazil.

Schistosomiasis, a chronic parasitic disease, remains a public health issue in tropical and subtropical regions, especially in low and moderate-income countries lacking assured access to safe water and proper sanitation. A national prevalence survey carried out by the Brazilian Ministry of Health from 2011 to 2015 found a decrease in human infection rates to 1%, with 19 out of 26 states still classified as endemic areas. There is a risk of schistosomiasis reemerging as a public health concern in low-endemic regions. This study proposes an integrated landscape-based approach to aid surveillance and control strategies for schistosomiasis in low-endemic areas. In the Middle Paranapanema river basin, specific landscapes linked to schistosomiasis were identified using a comprehensive methodology. This approach merged remote sensing, environmental, socioeconomic, epidemiological, and malacological data. A team of experts identified ten distinct landscape categories associated with varying levels of schistosomiasis transmission potential. These categories were used to train a supervised classification machine learning algorithm, resulting in a 92.5% overall accuracy and a 6.5% classification error. Evaluation revealed that 74.6% of collected snails from water collections in five key municipalities within the basin belonged to landscape types with higher potential for S. mansoni infection. Landscape connectivity metrics were also analysed. This study highlights the role of integrated landscape-based analyses in informing strategies for eliminating schistosomiasis. The methodology has produced new schistosomiasis risk maps covering the entire basin. The region's low endemicity can be partly explained by the limited connectivity among grouped landscape-units more prone to triggering schistosomiasis transmission. Nevertheless, changes in social, economic, and environmental landscapes, especially those linked to the rising pace of incomplete urbanization processes in the region, have the potential to increase risk of schistosomiasis transmission. This study will help target interventions to bring the region closer to schistosomiasis elimination.

Machine learning-assisted screening of efficient ionic liquids for catalyzing CO2 cycloaddition reaction

The catalysis of CO2 cycloaddition reactions by ionic liquids holds significant promise in addressing environmental and chemical synthesis challenges. However, the design of effective ionic liquid catalysts is hindered by the sheer diversity of cation-anion combinations, leading to challenges in targeted catalyst development. This study addresses these issues by utilizing experimental data collected from literature on reactions involving epoxy compounds as substrates, conducted without solvents or co-catalysts, to establish a database for machine learning (ML). Simple descriptors derived from the ion pair structures of ionic liquids are employed as inputs for five ML classification algorithms to predict the yield of CO2 cycloaddition reactions. Subsequently, the highly accurate ML models are applied to forecast the catalytic performance of 1344 ionic liquids under ambient conditions. This approach identifies 13 cation structures and 8 anion structures that exhibit superior catalytic properties. Further refinement through density functional theory (DFT) calculations selects ion pair structures capable of catalyzing CO2 cycloaddition reactions at ambient temperature and pressure, demonstrating the efficacy of this method in guiding the design and development of ionic liquid catalysts for CO2 conversion reactions involving epoxy compounds.

Together we can do it! A roadmap to effectively tackle propaganda-related tasks

PurposeIn this paper, we address the need to study automatic propaganda detection to establish a course of action when faced with such a complex task. Although many isolated tasks have been proposed, a roadmap on how to best approach a new task from the perspective of text formality or the leverage of existing resources has not been explored yet.Design/methodology/approachWe present a comprehensive study using several datasets on textual propaganda and different techniques to tackle it. We explore diverse collections with varied characteristics and analyze methodologies, from classic machine learning algorithms, to multi-task learning to utilize the available data in such models.FindingsOur results show that transformer-based approaches are the best option with high-quality collections, and emotionally enriched inputs improve the results for Twitter content. Additionally, MTL achieves the best results in two of the five scenarios we analyzed. Notably, in one of the scenarios, the model achieves an F1 score of 0.78, significantly surpassing the transformer baseline model’s F1 score of 0.68.Research limitations/implicationsAfter finding a positive impact when leveraging propaganda’s emotional content, we propose further research into exploiting other complex dimensions, such as moral issues or logical reasoning.Originality/valueBased on our findings, we provide a roadmap for tackling propaganda-related tasks, depending on the types of training data available and the task to solve. This includes the application of MTL, which has yet to be fully exploited in propaganda detection.

Prediction of catchment efficiency in direct energy deposition using dimensional analysis and machine learning

Direct Energy Deposition (DED) is an additive manufacturing process used to fabricate thin/thick-walled structures and high-value component restorations. As blown powder-based DED gains prominence, catchment efficiency becomes imperative for enhancing material utilization and process effectiveness. This study focuses on predicting catchment efficiency within a DED process by investigating four significant process parameters: laser power, powder feed rate, carrier gas flow rate, and deposition speed. The primary objective is to devise a dimensionless number capable of predicting catchment efficiency based on a combination of these parameters, categorizing efficiency into low, medium, and high regions. This approach reduces the need for resource-intensive experimentation. The experimental validation of the proposed dimensionless number was conducted, showing an error rate of around 8%. Additionally, six machine learning classifier algorithms – Support Vector Machines, K-Nearest Neighbours, Decision Tree, Random Forest, Linear Regression, and Gaussian Naive Bayes – were employed to categorize catchment efficiency zones. Support Vector Machine demonstrated the best performance with a predictive accuracy of 0.98. This study provides a methodology for catchment efficiency prediction, enhancing decision-making and resource optimization, and can be used to optimize process parameters for thin-wall or relatively thin-wall fabrication.

CON-FOLD Explainable Machine Learning with Confidence

Abstract FOLD-RM is an explainable machine learning classification algorithm that uses training data to create a set of classification rules. In this paper, we introduce CON-FOLD which extends FOLD-RM in several ways. CON-FOLD assigns probability-based confidence scores to rules learned for a classification task. This allows users to know how confident they should be in a prediction made by the model. We present a confidence-based pruning algorithm that uses the unique structure of FOLD-RM rules to efficiently prune rules and prevent overfitting. Furthermore, CON-FOLD enables the user to provide preexisting knowledge in the form of logic program rules that are either (fixed) background knowledge or (modifiable) initial rule candidates. The paper describes our method in detail and reports on practical experiments. We demonstrate the performance of the algorithm on benchmark datasets from the UCI Machine Learning Repository. For that, we introduce a new metric, Inverse Brier Score, to evaluate the accuracy of the produced confidence scores. Finally, we apply this extension to a real-world example that requires explainability: marking of student responses to a short answer question from the Australian Physics Olympiad.

A multivariate analysis of the early dropout using classical machine learning and local interpretable model-agnostic explanations

Student dropout rates can have a significant negative impact on both the development of educational institutions and the personal growth of students. Consequently, many institutions are focused on identifying key factors that contribute to dropout and implementing strategies to mitigate them. This study aims to predict student dropout rates using classical machine learning algorithms while analyzing the key factors influencing these outcomes in higher education. The dataset includes demographic, socioeconomic, and academic information from various sources. Additionally, the study leverages the Local Interpretable Model-Agnostic Explanations (LIME) model to provide insights into the predictions, offering a clearer understanding of the factors driving dropout decisions. This knowledge is crucial for identifying influential factors and, more importantly, enhancing early intervention strategies and policies in educational settings, ultimately reducing dropout rates.

Machine Learning Algorithms for Image Classification: A Comparative Review

In the realm of computer vision, one of the most important challenges is image categorization. Its goal is to assign semantic labels to photographs based on a predetermined set of categories, and it does this via a process called semantic labeling. In attempt to find a solution to this issue, several distinct machine learning algorithms have been developed throughout the course of time; each strategy has its own unique mix of benefits and drawbacks. This article gives an in-depth review and comparison of a wide variety of well-known machine learning approaches for the classification of pictures. This review covers a wide range of algorithms, including more traditional approaches such as Support Vector Machines (SVMs), Convolutional Neural Networks (CNNs), and Transfer Learning using pretrained models such as VGG, Reset, and Inception.

Quantum data encoding: a comparative analysis of classical-to-quantum mapping techniques and their impact on machine learning accuracy

This study explores the integration of quantum data embedding techniques into classical machine learning (ML) algorithms; to assess performance enhancements and computational implications across a spectrum of models. We explored various classical-to-quantum mapping methods; ranging from basis encoding and angle encoding to amplitude encoding; for encoding classical data. We conducted an extensive empirical study encompassing popular ML algorithms, including Logistic Regression, K-Nearest Neighbors, Support Vector Machines, and ensemble methods like Random Forest, LightGBM, AdaBoost, and CatBoost. Our findings reveal that quantum data embedding contributes to improved classification accuracy and F1 scores, particularly notable in models that inherently benefit from enhanced feature representation. We observed nuanced effects on running time, with low-complexity models exhibiting moderate increases and more computationally intensive models experiencing discernible changes. Notably, ensemble methods demonstrated a favorable balance between performance gains and computational overhead.This study underscores the potential of quantum data embedding to enhance classical ML models and emphasizes the importance of weighing performance improvements against computational costs. Future research may involve refining quantum encoding processes to optimize computational efficiency and explore scalability for real-world applications. Our work contributes to the growing body of knowledge on the intersection of quantum computing and classical machine learning, offering insights for researchers and practitioners seeking to harness the advantages of quantum-inspired techniques in practical scenarios.

Design of ultra-broadband long-wave to ultra-long-wave infrared absorber based on machine learning

Abstract long-wave infrared (LWIR) and ultra-long-wave infrared (ULWIR) radiation find extensive utility in atmospheric monitoring, night reconnaissance, deep space exploration, and various other fields. However, achieving ultra-wideband absorption within these spectral ranges has persistently posed a significant challenge for researchers. Metasurfaces have attracted great interest due to their ability to manipulate electromagnetic (EM) waves with unprecedented precision and efficiency. In this paper, a metasurface absorber with a simple structure is proposed. Combined with machine learning (ML) of Random Forest algorithm for design optimization, the absorber achieves ultra-wideband perfect absorption of 42.54 μm within the LWIR-ULWIR band. Furthermore, the stability and accuracy of the Random Forest algorithm in absorber design are also evaluated and compared with other classical ML algorithms. The successful realization of this work can offer the advancement of thermal imaging, sensing, and communication systems operating within the LWIR and ULWIR spectra.

PV Module Soiling Detection Using Visible Spectrum Imaging and Machine Learning

During the last decades photovoltaic solar energy has continuously increased its share in the electricity mix and has already surpassed 5% globally. Even though photovoltaic (PV) installations are considered to require very little maintenance, their efficient exploitation relies on accounting for certain environmental factors that affect energy generation. One of these factors is the soiling of the PV surface, which could be observed in different forms, such as dust and bird droppings. In this study, visible spectrum data and machine learning algorithms were used for the identification of soiling. A methodology for preprocessing the images is proposed, which puts focus on any soiling of the PV surface. The performance of six classification machine learning algorithms is evaluated and compared—convolutional neural network (CNN), support vector machine (SVM), random forest (RF), k-nearest neighbor (kNN), naïve-Bayes, and decision tree. During the training and validation phase, RF proved to be the best-performing model with an F1 score of 0.935, closely followed by SVM, CNN, and kNN. However, during the testing phase, the trained CNN achieved the highest performance, reaching F1 = 0.913. SVM closely followed it with a score of 0.895, while the other two models returned worse results. Some results from the application of the optimal model after specific weather events are also presented in this study. They confirmed once again that the trained convolutional neural network can be successfully used to evaluate the soiling state of photovoltaic surfaces.

Machine Learning Techniques Towards Accurate Emotion Classification from EEG Signals

This article delves into using machine learning algorithms for emotion classification via EEG brain signals. The goal is to discover an accurate model beyond traditional methods, necessitating AI for classifying emotional EEG signals. This study, motivated by the complex link between emotions and neural activity, employs Random Forest, Support Vector Machines, and K-Nearest Neighbors. Notably, Random Forest achieves 99% accuracy, SVM 98%, and KNN 94%. These impressive results, backed by performance metrics like confusion matrices, reveal each model’s effectiveness in emotion classification. The dataset, rich in varied emotional stimuli and EEG placements, provides a robust foundation for detailed analysis. This research underscores significant applications in affective computing and mental health, offering a promising path to understanding the intricate relationship between EEG signals and human emotions.

Hybrid Deep Learning Model for Vegetable Price Forecasting Based on Principal Component Analysis and Attention Mechanism

Abstract With the aim of enhancing the accuracy of current models for forecasting vegetable prices and improving market structures, this study focuses on the prices of bell peppers at the Nanhuanqiao Market in Suzhou. In this paper, we propose a hybrid Convolutional Neural Network (CNN) and Gated Recurrent Unit (GRU) model for vegetable price forecasting based on Principal Component Analysis (PCA) and Attention Mechanism (ATT). Initially, we utilized the Pearson correlation coefficient to filter out the factors impacting prices. Then, we applied PCA to reduce dimensionality, extracting key price features. Next, we captured local sequence patterns with CNN, while handling time-series features with GRU. Finally, these outputs were integrated via ATT to generate the final prediction. Our results indicate that the hybrid CNN-GRU model, enhanced by PCA and ATT, achieved a Root Mean Square Error (RMSE) as low as 0.16. This performance is 11.11%, 11.11%, and 15.79% better than that of the PCA-CNN, PCA-GRU, and CNN-GRU-ATT models, respectively. Furthermore, in order to prove the effectiveness of our proposed model, the proposed model is compared with the state-of-the-art models and classical machine learning algorithms under the same dataset, the results indicate that our proposed hybrid deep learning model based on PCA and ATT shows the best performance. Consequently, our model offers a valuable reference for vegetable price prediction.

Tensile strength prediction in monel 400 weldments using classification and regression algorithms in machine learning

Abstract Selecting the most effective welding settings impacts mechanical strength and weld quality, with parameters like current, voltage, and speed playing pivotal roles. The mechanical part encompasses material properties, welding process variables, and structural integrity, all contributing to the overall weld quality and strength. By integrating these mechanical factors with predictive modelling, a comprehensive understanding of weld performance can be achieved, enabling optimized welding settings and enhanced weld quality assurance. This study assesses and compares machine learning algorithms such as a random tree, random forest, and C4.5 to determine their predictive capability regarding the tensile strength in Monel 400 Weldments. By utilizing a dataset comprising 32 instances with attributes like Current, Voltage, and Speed, models were developed and assessed using K-Fold cross-validation. Among these algorithms, the random tree models emerge as the most proficient in accurately predicting the tensile strength for Monel 400 Weldments through classification ML techniques. Similarly, regression algorithms have been deployed to assess the dataset by varying the train-test split ratio and gradient boosting, which exhibited superior performance with a higher R2 value of 0.99. Both random tree and Gradient boosting algorithms have commonly been recommended, with current being the most influential factor affecting tensile strength.

Classification of Garlic Varieties with Fluorescent Spectroscopy Using Machine Learning

Machine learning techniques can produce fast, accurate and objective results in the analysis of agricultural products. These artificial intelligence-based systems are frequently encountered in studies on agriculture in the literature. This study reveals the usability of machine learning algorithms in classification of garlic cultivars using fluorescent spectroscopic data. For this, six types of garlic were used: Razgradski-11, Razgradski-12, Razgradski-115, Plovdivski-120, Yambolski-99 and Topolovgradski. In the first stage, the parsing analysis made from the fluorescent spectroscopic data of the garlics was carried out with seven different machine learning. The classification results of these seven types of machine learning algorithms were obtained. In the second stage, the classification results were obtained by adjusting the hyperparameters of each Machine Learning (ML) algorithm in order to control the improvability of the classification accuracy rates. Finally, performance metrics such as Specificity, precision, MCC, F1-Score of the classification processes obtained in the two stages were compared. In general, it was observed that the classification performances increased with the hyperparameter adjustment performed in the second stage. In this study, classification results with ML showed that fluorescent spectroscopy data of garlic strongly represented garlic species and provided high performance classification accuracy of 99.93% with Neural Network (NN), one of the machine learning methods using these data.

Deep learning models for the prediction of acute postoperative pain in PACU for video‐assisted thoracoscopic surgery

BackgroundPostoperative pain is a prevalent symptom experienced by patients undergoing surgical procedures. This study aims to develop deep learning algorithms for predicting acute postoperative pain using both essential patient details and real-time vital sign data during surgery.MethodsThrough a retrospective observational approach, we utilized Graph Attention Networks (GAT) and graph Transformer Networks (GTN) deep learning algorithms to construct the DoseFormer model while incorporating an attention mechanism. This model employed patient information and intraoperative vital signs obtained during Video-assisted thoracoscopic surgery (VATS) surgery to anticipate postoperative pain. By categorizing the static and dynamic data, the DoseFormer model performed binary classification to predict the likelihood of postoperative acute pain.ResultsA total of 1758 patients were initially included, with 1552 patients after data cleaning. These patients were then divided into training set (n = 931) and testing set (n = 621). In the testing set, the DoseFormer model exhibited significantly higher AUROC (0.98) compared to classical machine learning algorithms. Furthermore, the DoseFormer model displayed a significantly higher F1 value (0.85) in comparison to other classical machine learning algorithms. Notably, the attending anesthesiologists' F1 values (attending: 0.49, fellow: 0.43, Resident: 0.16) were significantly lower than those of the DoseFormer model in predicting acute postoperative pain.ConclusionsDeep learning model can predict postoperative acute pain events based on patients' basic information and intraoperative vital signs.

Advancing source reactor-type discrimination using machine learning techniques and SFCOMPO-2.0 experimental database

In recent years, nuclear forensic analysis has become crucial due to the growing global threat of nuclear terrorism and smuggling. Since 2005, extensive research has been conducted on identifying the origin of spent nuclear fuel, focusing on the source reactor-type discrimination, 235U enrichment of the fresh fuel, and the fuel exposure in the reactor (known as burnup). However, the majority of research relies on computed databases, which may lead to tracing discrepancies compared with actual situations. The present study employs the isotopic measurements from the experimental SFCOMPO-2.0 database to predict nuclear reactor types using Factor Analysis (FA) and various machine learning classification algorithms. The results reveal that FA is an effective method for dimension reduction and visualization. The FA-KNN, Random Forest (RF), and Multilayer Perceptron (MLP) algorithms are applied using a consistent dataset partition to ensure unbiased comparisons. The prediction results based on 10-fold stratified cross-validation are quite promising and the Receiver Operating Characteristic (ROC) curves for multi-class classification confirm the excellent generalization ability of models. Therefore, the application of machine learning techniques is highly effective for reactor-type forensics analysis, especially for RF and MLP.