Efficient Machine Learning Research Articles

A Study on Estimating Theme Park Attendance Using the AdaBoost Algorithm Based on Weather Information from the Korea Meteorological Administration Web

The purpose of this study is to propose an efficient machine learning model based on five years of data for Seoul Grand Park in Republic of Korea, depending on the weather and day characteristics, and to increase its effectiveness as a strategic foundation for national theme park management and marketing. To this end, the AdaBoost model, which reflects the characteristics of the weather and the day of the week, was recently compared with the actual number of visitors and the predicted number of visitors to analyze the accuracy. The analysis showed 30 days of abnormal cases, and the overall annual distribution was found to show similar patterns. Abnormal cases required details of wind speed, average relative humidity, and fine dust concentration for weather information, and it was derived that more accurate predictions would be possible considering variables such as group visitors, new events, and unofficial holidays.

DaE2: Unmasking malicious URLs by leveraging diverse and efficient ensemble machine learning for online security

Over 5.44 billion people now use the Internet, making it a vital part of daily life, enabling communication, e-commerce, education, and more. However, this huge Internet connectivity also raises concerns about online privacy and security, particularly with the rise of malicious Uniform Resource Locators (URLs). Recently, conventional ensemble models have attracted attention due to their notable benefits of reducing the variance in models, enhancing predictive performance, improving prediction accuracy, and demonstrating high generalization potential. But, its application in addressing the challenge of malicious URLs is still an open problem. These URLs often hide behind static links in emails or web pages, posing a threat to individuals and organizations. Despite blacklisting services, many harmful sites evade detection due to inadequate scrutiny or recent creation. Hence, to improve URL detection, a Diverse and Efficient Ensemble (DaE2) machine learning algorithm was developed using four ensemble models, that is, AdaBoost, Bagging, Stacking, and Voting to classify URLs. After preprocessing, the experimental result shown that all models achieved over 80 % accuracy, with AdaBoost reaching 98.5 % and Stacking offering the fastest runtime. AdaBoost and Bagging also delivered strong performance, with F1 scores of 0.980 and 0.976, respectively.

Parkinson’s Disease Detection by Using Machine Learning Method based on Local Classification on Class Boundary

Parkinson’s disease (PD) detection has long been an important task in medical intelligence. Recognition methods based on speech signals show great potential in Parkinson’s disease diagnosis. In this paper, based on an efficient machine learning method for Parkinson’s disease detection, we take the use of test data incorporates an efficient Secure Two-Party Computing (S2PC) protocol to protect the privacy of patients. We present two key components, the secure use of data and a local classification methodology, including the description of class boundaries. We conducted experiments on two datasets to validate our proposed method, and the results show well data security protection ability compared to some more sophisticated methods. And the performance of Local Classification on Class Boundary(LCCB) and Hyperplane K-Nearest Neighbor(HKNN) is significantly better than that of both Support Vector Machines(SVM) and Random Forest(RF). When the number of selected features is from 400 to 500, HKNN and LCCB are roughly equal where the accuracy of HKNN is 95.2%, and LCCB has the rate of 94.7%. Then we use Multi-Cluster Feature Selection(MCFS) to analyze and select the important features from D2 dataset. It shows that even if only two features are selected, the boundaries of the two categories are also clear and easy to distinguish.

Review of Deep Learning in High-Energy Heavy-Ion Collisions

The hot deconfined matter called quark–gluon plasma (QGP) can be generated in relativistic heavy-ion collisions (HICs). Its properties under high temperatures have been widely studied. Since the short-lived QGP is not directly observable, data-driven methods, including deep learning, are often used to infer the initial-state properties from the final distributions of hadrons. This paper reviews various applications of machine learning in relativistic heavy-ion collisions, explains the fundamental concepts of deep learning, and discusses how the properties of HIC data can be interpreted using efficient machine learning models.

Predicting the Energetic Proton Flux with a Machine Learning Regression Algorithm

The need for real-time monitoring and alerting systems for space weather hazards has grown significantly in the last two decades. One of the most important challenges for space mission operations and planning is the prediction of solar proton events (SPEs). In this context, artificial intelligence and machine learning techniques have opened a new frontier, providing a new paradigm for statistical forecasting algorithms. The great majority of these models aim to predict the occurrence of an SPE, i.e., they are based on the classification approach. This work is oriented toward the successful implementation of onboard prediction systems, which is essential for the future of space exploration. We present a simple and efficient machine learning regression algorithm that is able to forecast the energetic proton flux up to 1 hr ahead by exploiting features derived from the electron flux only. This approach could be helpful in improving monitoring systems of the radiation risk in both deep space and near-Earth environments. The model is very relevant for mission operations and planning, especially when flare characteristics and source location are not available in real time, as at Mars distance.

A Novel Method for the Estimation of Sea Surface Wind Speed from SAR Imagery

Wind is one of the important environmental factors influencing marine target detection as it is the source of sea clutter and also affects target motion and drift. The accurate estimation of wind speed is crucial for developing an efficient machine learning (ML) model for target detection. For example, high wind speeds make it more likely to mistakenly detect clutter as a marine target. This paper presents a novel approach for the estimation of sea surface wind speed (SSWS) and direction utilizing satellite imagery through innovative ML algorithms. Unlike existing methods, our proposed technique does not require wind direction information and normalized radar cross-section (NRCS) values and therefore can be used for a wide range of satellite images when the initial calibrated data are not available. In the proposed method, we extract features from co-polarized (HH) and cross-polarized (HV) satellite images and then fuse advanced regression techniques with SSWS estimation. The comparison between the proposed model and three well-known C-band models (CMODs)—CMOD-IFR2, CMOD5N, and CMOD7—further indicates the superior performance of the proposed model. The proposed model achieved the lowest Root Mean Squared Error (RMSE) and Mean Absolute Error (MAE), with values of 0.97 m/s and 0.62 m/s for calibrated images, and 1.37 and 0.97 for uncalibrated images, respectively, on the RCM dataset.

Machine Learning‐Aided Discovery of Low‐Pt High Entropy Intermetallic Compounds for Electrochemical Oxygen Reduction Reaction

Advancing the design of cathode catalysts to significantly maximize platinum utilization and augment the longevity has emerged as a formidable challenge in the field of fuel cells. Herein, we rationally design a high entropy intermetallic compound (HEIC, Pt(FeCoNiCu)3) for catalyzing oxygen reduction reaction (ORR) by an efficient machine learning stategy, where crystal graph convolutional neural networks are employed to expedite the multicomponent design. Based on a dataset generated from first‐principles calculations, the model can achieve a high prediction accuracy with mean absolute errors of 0.003 for surface strain and 0.011 eV atom‐1 for formation energy. In addition, we identify two chemical features (atomic size difference and mixing enthalpy) as new descriptors to explore advanced ORR catalysts. The carbon supported Pt(FeCoNiCu)3 catalyst with small particle size is successfully synthesized by a freeze‐drying‐annealing technology, and exhibits ultrahigh mass activity (4.09 A mgPt‐1) and specific activity (7.92 mA cm‐2). Meanwhile, The catalyst also shows significantly enhanced electrochemical stability which can be ascribed to the sluggish difussion effect in the HEIC structure. Beyond offering a promising low‐Pt electrocatalysts for fuel cell cathode, this work offers a new paradigm to rationally design advanced catalysts for energy storage and conversion devices.

Machine Learning-Aided Discovery of Low-Pt High Entropy Intermetallic Compounds for Electrochemical Oxygen Reduction Reaction.

Advancing the design of cathode catalysts to significantly maximize platinum utilization and augment the longevity has emerged as a formidable challenge in the field of fuel cells. Herein, we rationally design a high entropy intermetallic compound (HEIC, Pt(FeCoNiCu)3) for catalyzing oxygen reduction reaction (ORR) by an efficient machine learning stategy, where crystal graph convolutional neural networks are employed to expedite the multicomponent design. Based on a dataset generated from first-principles calculations, the model can achieve a high prediction accuracy with mean absolute errors of 0.003 for surface strain and 0.011 eV atom-1 for formation energy. In addition, we identify two chemical features (atomic size difference and mixing enthalpy) as new descriptors to explore advanced ORR catalysts. The carbon supported Pt(FeCoNiCu)3 catalyst with small particle size is successfully synthesized by a freeze-drying-annealing technology, and exhibits ultrahigh mass activity (4.09 A mgPt-1) and specific activity (7.92 mA cm-2). Meanwhile, The catalyst also shows significantly enhanced electrochemical stability which can be ascribed to the sluggish difussion effect in the HEIC structure. Beyond offering a promising low-Pt electrocatalysts for fuel cell cathode, this work offers a new paradigm to rationally design advanced catalysts for energy storage and conversion devices.

Detection of Brain Tumor using Medical Images: A Comparative Study of Machine Learning Algorithms – A Systematic Literature Review

Abstract: Background: Brain tumors are a significant global health concern impacting both adults and children. Tumors are characterized by abnormal or excessive growth resulting from uncontrolled cell division. Diagnosing brain tumors poses various challenges, including limited funding, a shortage of qualified professionals, and insufficient access to medical facilities in remote regions. Different learning techniques for detecting brain tumors have been developed due to their ease of use, cost-effectiveness, and non-invasive nature, in contrast to other invasive methods. Methods: This research conducts a systematic literature review to explore modern trends and concepts of machine learning in healthcare, aiming to identify effective techniques for brain tumor detection. It also compares and analyzes the most efficient machine learning methods currently in use, focusing on aspects such as machine learning algorithms, image augmentation, evaluation metrics, and the sizes of datasets employed. Results: The findings indicate that non-invasive methods, such as machine learning algorithms for brain tumor detection, are cost-effective and provide quick results. Conclusions: This systematic literature review offers a technical overview, demonstrating the efficiency and effectiveness of machine learning techniques in making brain tumor detection feasible. The study utilizes deep learning and machine learning methods to comprehensively analyse diagnosis, imaging, and clinical evaluations in medical fields related to brain tumor detection.

Efficient machine learning models across multiple datasets for autism spectrum disorder diagnoses

Autism Spectrum Disorder (ASD) presents a complex neurodevelopmental challenge with diverse behavioral symptoms that overlap with other mental disorders, complicating diagnosis. Challenges in existing systems include the complexity and diversity of ASD symptoms, as well as the need for innovative and efficient detection strategies across different age groups. The application of machine learning (ML) offers a promising avenue for revolutionizing ASD prediction and diagnosis. The proposed work aims to overcome these challenges by leveraging ML and Automated Machine Learning (AutoML) techniques, combined with comprehensive datasets and advanced analytics, to enhance ASD detection and prediction capabilities. This study introduces the Autism Spectrum Disorder Detection (ASDD) Framework, which systematically applies ML and AutoML across text-based datasets for various age groups. A combined dataset is generated through the concatenation of various data sources, enriching the diagnostic scope. The framework incorporates AutoML tools such as Lazy Predict, TPOT, and AutoKeras, alongside feature selection methods like Principal Component Analysis (PCA) and Chi-Square. It also employs robust hyperparameter optimization techniques, including Bayesian optimization, Random Search, and genetic algorithms, and uses advanced ensemble methods like voting and bagging to boost prediction accuracy. An empirical evaluation of 27 distinct ML models across seven datasets, including a synthesized dataset named DB8, demonstrates exceptional performance, with many models achieving 100% accuracy and perfect F1 scores in various contexts. These outcomes highlight the effectiveness of the proposed framework in advancing ASD detection and prediction methodologies.

Efficient Privacy-Preserving Machine Learning with Lightweight Trusted Hardware

In this paper, we propose a new secure machine learning inference platform assisted by a small dedicated security processor, which will be easier to protect and deploy compared to today's TEEs integrated into high-performance processors. Our platform provides three main advantages over the state-of-the-art: (i) We achieve significant performance improvements compared to state-of-the-art distributed Privacy-Preserving Machine Learning (PPML) protocols, with only a small security processor that is comparable to a discrete security chip such as the Trusted Platform Module (TPM) or on-chip security subsystems in SoCs similar to the Apple enclave processor. In the semi-honest setting with WAN/GPU, our scheme is 4X-63X faster than Falcon (PoPETs'21) and AriaNN (PoPETs'22) and 3.8X-12X more communication efficient. We achieve even higher performance improvements in the malicious setting. (ii) Our platform guarantees security with abort against malicious adversaries under honest majority assumption. (iii) Our technique is not limited by the size of secure memory in a TEE and can support high-capacity modern neural networks like ResNet18 and Transformer. While previous work investigated the use of high-performance TEEs in PPML, this work represents the first to show that even tiny secure hardware with very limited performance can be leveraged to significantly speed-up distributed PPML protocols if the protocol can be carefully designed for lightweight trusted hardware.

The most efficient machine learning algorithms in stroke prediction: A systematic review.

Stroke is one of the most common causes of death worldwide, leading to numerous complications and significantly diminishing the quality of life for those affected. The purpose of this study is to systematically review published papers on stroke prediction using machine learning algorithms and introduce the most efficient machine learning algorithms and compare their performance. The papers have published in period from 2019 to August 2023. The authors conducted a systematic search in PubMed, Scopus, Web of Science, and IEEE using the keywords "Artificial Intelligence," "Predictive Modeling," "Machine Learning," "Stroke," and "Cerebrovascular Accident" from 2019 to August 2023. Twenty articles were included based on the inclusion criteria. The Random Forest (RF) algorithm was introduced as the best and most efficient stroke ML algorithm in 25% of the articles (n = 5). In addition, in other articles, Support Vector Machines (SVM), Stacking and XGBOOST, DSGD, COX& GBT, ANN, NB, and RXLM algorithms were introduced as the best and most efficient ML algorithms in stroke prediction. This research has shown a rapid increase in using ML algorithms to predict stroke, with significant improvements in model accuracy in recent years. However, no model has reached 100% accuracy or is entirely error-free. Variations in algorithm efficiency and accuracy stem from differences in sample sizes, datasets, and data types. Further studies should focus on consistent datasets, sample sizes, and data types for more reliable outcomes.

Efficient machine learning based techniques for fault detection and identification in spacecraft reaction wheel

Efficient machine learning based techniques for fault detection and identification in spacecraft reaction wheel

A highly transferable and efficient machine learning interatomic potentials study of [formula omitted]-Fe–C binary system

Machine learning interatomic potentials (MLIPs) for α-iron and carbon binary system have been constructed aiming for understanding the mechanical behavior of Fe–C steel and carbides. The MLIPs were trained using an extensive reference database produced by spin polarized density functional theory (DFT) calculations. The MLIPs reach the DFT accuracies in many important properties which are frequently engaged in Fe and Fe–C studies, including kinetics and thermodynamics of C in α-Fe with vacancy, grain boundary, and screw dislocation, and basic properties of cementite and cementite–ferrite interfaces. In conjunction with these MLIPs, the impact of C atoms on the mobility of screw dislocation at finite temperature, and the C-decorated core configuration of screw dislocation were investigated, and a uniaxial tensile test on a model with multiple types of defects was conducted.

Analysis of regularized federated learning

Federated learning is an efficient machine learning tool for dealing with heterogeneous big data and privacy protection. Federated learning methods with regularization can control the level of communications between the central and local machines. Stochastic gradient descent is often used for implementing such methods on heterogeneous big data, to reduce the communication costs. In this paper, we consider such an algorithm called Loopless Local Gradient Descent which has advantages in reducing the expected communications by controlling a probability level. We improve the method by allowing flexible step sizes and carry out novel analysis for the convergence of the algorithm in a non-convex setting in addition to the standard strongly convex setting. In the non-convex setting, we derive rates of convergence when the smooth objective function satisfies a Polyak-Łojasiewicz condition. When the objective function is strongly convex, a sufficient and necessary condition for the convergence in expectation is presented.

Comparative study of ten machine learning algorithms for short-term forecasting in gas warning systems

This research aims to explore more efficient machine learning (ML) algorithms with better performance for short-term forecasting. Up-to-date literature shows a lack of research on selecting practical ML algorithms for short-term forecasting in real-time industrial applications. This research uses a quantitative and qualitative mixed method combining two rounds of literature reviews, a case study, and a comparative analysis. Ten widely used ML algorithms are selected to conduct a comparative study of gas warning systems in a case study mine. We propose a new assessment visualization tool: a 2D space-based quadrant diagram can be used to visually map prediction error assessment and predictive performance assessment for tested algorithms. Overall, this visualization tool indicates that LR, RF, and SVM are more efficient ML algorithms with overall prediction performance for short-term forecasting. This research indicates ten tested algorithms can be visually mapped onto optimal (LR, RF, and SVM), efficient (ARIMA), suboptimal (BP-SOG, KNN, and Perceptron), and inefficient algorithms (RNN, BP_Resilient, and LSTM). The case study finds results that differ from previous studies regarding the ML efficiency of ARIMA, KNN, LR, LSTM, and SVM. This study finds different views on the prediction performance of a few paired algorithms compared with previous studies, including RF and LR, SVM and RF, KNN and ARIMA, KNN and SVM, RNN and ARIMA, and LSTM and SVM. This study also suggests that ARIMA, KNN, LR, and LSTM should be investigated further with additional prediction error assessments. Overall, no single algorithm can fit all applications. This study raises 20 valuable questions for further research.

A graph network-based learnable simulator for spatial-temporal prediction of rigid projectile penetration

Predicting plate penetration by rigid projectiles (PPRP) is crucial in terminal ballistics, with broad applications in civil and military engineering. Empirical and analytical methods face challenges in predicting field variables like displacement and stress in target plates. Although numerical methods offer high accuracy, they suffer from low computational efficiency. Herein, we introduce an efficient data-driven machine learning (ML) method based on graph neural networks (GNNs), named PGN, specifically tailored to address the PPRP problem. Unlike traditional ML methods that establish direct input-output mappings, PGN predicts comprehensive spatial-temporal information pertaining to the projectile-target interaction process. A thorough analysis of PGN's performance in terms of accuracy, computational efficiency and generalization ability was performed. Compared to validated results of numerical simulations, PGN maintained high precision with RMSE for displacement, stress, and strain predictions below 0.5 %, 9.5 %, and 2.1 %, respectively. It also achieved R2 values exceeding 0.92 for the time history of projectile velocity and acceleration, while requiring only 9.8 % of the computation time compared to LS-DYNA. In generalization tests, PGN exhibited remarkable adaptability in tackling challenging scenarios that extend far beyond the training data distribution, with overall RMSE between 11 % and 13 %. Furthermore, we find that the maximum information propagation capacity of a simulated physical system must meet or exceed the information propagation need of the real-world physical phenomenon it aims to replicate. Consequently, an approach was proposed to determine the critical connectivity radius of the massage passing method directly from the wave speed in the target medium, which greatly improved the accuracy and efficiency of PGN.

Machine learning approaches to identify the link between heavy metal exposure and ischemic stroke using the US NHANES data from 2003 to 2018.

There is limited understanding of the link between exposure to heavy metals and ischemic stroke (IS). This research aimed to develop efficient and interpretable machine learning (ML) models to associate the relationship between exposure to heavy metals and IS. The data of this research were obtained from the National Health and Nutrition Examination Survey (US NHANES, 2003-2018) database. Seven ML models were used to identify IS caused by exposure to heavy metals. To assess the strength of the models, we employed 10-fold cross-validation, the area under the curve (AUC), F1 scores, Brier scores, Matthews correlation coefficient (MCC), precision-recall (PR) curves, and decision curve analysis (DCA) curves. Following these tests, the best-performing model was selected. Finally, the DALEX package was used for feature explanation and decision-making visualization. A total of 15,575 participants were involved in this study. The best-performing ML models, which included logistic regression (LR) (AUC: 0.796) and XGBoost (AUC: 0.789), were selected. The DALEX package revealed that age, total mercury in blood, poverty-to-income ratio (PIR), and cadmium were the most significant contributors to IS in the logistic regression and XGBoost models. The logistic regression and XGBoost models showed high efficiency, accuracy, and robustness in identifying associations between heavy metal exposure and IS in NHANES 2003-2018 participants.

Decoupling and predicting natural gas deviation factor using machine learning methods

Accurately predicting the deviation factor (Z-factor) of natural gas is crucial for the estimation of natural gas reserves, evaluation of gas reservoir recovery, and assessment of natural gas transport in pipelines. Traditional machine learning algorithms, such as Support Vector Machine (SVM), Extreme Gradient Boosting (XGBoost), Light Gradient Boosting Machine (LightGBM), Artificial Neural Network (ANN) and Bidirectional Long Short-Term Memory Neural Networks (BiLSTM), often lack accuracy and robustness in various situations due to their inability to generalize across different gas components and temperature-pressure conditions. To address this limitation, we propose a novel and efficient machine learning framework for predicting natural gas Z-factor. Our approach first utilizes a signal decomposition algorithm like Variational Mode Decomposition (VMD), Empirical Fourier Decomposition (EFD) and Ensemble Empirical Mode Decomposition (EEMD) to decouple the Z-factor into multiple components. Subsequently, traditional machine learning algorithms is employed to predict each decomposed Z-factor component, where combination of SVM and VMD achieved the best performance. Decoupling the Z-factors firstly and then predicting the decoupled components can significantly improve prediction accuracy of all traditional machine learning algorithms. We thoroughly evaluate the impact of the decoupling method and the number of decomposed components on the model’s performance. Compared to traditional machine learning models without decomposition, our framework achieves an average correlation coefficient exceeding 0.99 and an average mean absolute percentage error below 0.83% on 10 datasets with different natural gas components, high temperatures, and pressures. These results indicate that hybrid model effectively learns the patterns of Z-factor variations and can be applied to the prediction of natural gas Z-factors under various conditions. This study significantly advances methodologies for predicting natural gas properties, offering a unified and robust solution for precise estimations, thereby benefiting the natural gas industry in resource estimation and reservoir management.

Efficient machine learning approach for accurate free-energy profiles and kinetic rates.

The computational exploration of reactive processes is challenging due to the requirement of thorough sampling across the free energy landscape using accurate ab initio methods. To address these constraints, machine learning potentials are employed, yet their training for this kind of problem is still a laborious and tedious task. In this study, we present an efficient approach to train these potentials by cleverly using a single batch of unbiased trajectories that avoid the pitfalls of trajectories artificially biased along a suboptimal collective variable. This strategy, when integrated with current enhanced sampling techniques, allows to obtain free energy profiles and kinetic rates of ab initio quality, yet dramatically reducing the computational cost.