Performance Of Machine Learning Algorithms Research Articles

Towards Prosthesis Control: Identification of Locomotion Activities through EEG-Based Measurements

The integration of advanced control systems in prostheses necessitates the accurate identification of human locomotion activities, a task that can significantly benefit from EEG-based measurements combined with machine learning techniques. The main contribution of this study is the development of a novel framework for the recognition and classification of locomotion activities using electroencephalography (EEG) data by comparing the performance of different machine learning algorithms. Data of the lower limb movements during level ground walking as well as going up stairs, down stairs, up ramps, and down ramps were collected from 10 healthy volunteers. Time- and frequency-domain features were extracted by applying independent component analysis (ICA). Successively, they were used to train and test random forest and k-nearest neighbors (kNN) algorithms. For the classification, random forest revealed itself as the best-performing one, achieving an overall accuracy up to 92%. The findings of this study contribute to the field of assistive robotics by confirming that EEG-based measurements, when combined with appropriate machine learning models, can serve as robust inputs for prosthesis control systems.

Assessment of Machine Learning Algorithms for Land Cover Classification in a Complex Mountainous Landscape

Mapping land cover (LC) in mountainous regions, such as the Gilgit-Baltistan (GB) area of Pakistan, presents significant challenges due to complex terrain, limited data availability, and accessibility constraints. This study addresses these challenges by developing a robust, data-driven approach to classify LC using high-resolution Sentinel-2 (S-2) satellite imagery from 2019 within Google Earth Engine (GEE). The research evaluated the performance of various machine learning (ML) algorithms, including classification and regression tree (CART), maximum entropy (gmoMaxEnt), minimum distance (minDistance), support vector machine (SVM), and random forest (RF), without extensive hyperparameter tuning. Additionally, ten different scenarios based on various band combinations of S-2 data were used as input for running the ML models. The LC classification was performed using 2759 sample points, with 70% for training and 30% for validation. The results indicate that the RF algorithm outperformed all other classifiers under scenario S1 (using 10 bands), achieving an overall accuracy (OA) of 0.79 and a kappa coefficient of 0.76. The final RF-based LC mapping shows the following percentage distribution: barren land (46.7%), snow cover (22.9%), glacier (7.9%), grasses (7.2%), water (4.7%), wetland (2.9%), built-up (2.7%), agriculture (1.9%), and forest (1.2%). It is suggested that the best identified RF classifier within the GEE environment should be used for advanced multi-source data image classification with hyperparameter tuning to increase OA. Additionally, it is suggested to build the capacity of various stakeholders in GB for better monitoring of LC changes and resource management using geospatial big data.

Good results from sensor data: Performance of machine learning algorithms for regression problems in chemical sensors

Accurately predicting unseen data, instead of mere memorization of training examples, is a critical goal of machine learning. This generalization is particularly important in the field of chemical sensors, where the ability to accurately predict the chemical properties or concentration levels of unknown samples is crucial. The paper presents a comprehensive yet accessible introduction to various machine learning concepts, highlighting the importance of model interpretability and generalization in ensuring reliable and accurate results in this context. Nonlinear sensor array data are utilized to introduce key concepts (e.g., bias-variance tradeoff) and techniques (linear models, partial least squares regression, support vector machines, k-nearest neighbors, decision trees, ensemble methods, automated machine learning, symbolic regression, and artificial neural networks), providing a solid foundation to make informed decisions when selecting machine learning techniques for sensor-specific regression applications. The results clearly indicate a number of conclusions. First, overparameterized deep feedforward neural networks show great accuracy and generalization when trained on a sufficiently large dataset. Second, symbolic regression models proved to be more accurate than deep feedforward neural networks and classical machine learning techniques on smaller datasets. Third, the performance of various machine learning models was dataset-dependent, showing the importance of comparative studies to determine the most suitable approach. It is clear that the optimal model cannot be known a priori. This paper aims to provide a starting point for investigations on the performance of different machine learning techniques in chemical sensor applications.

Random forest machine learning for maize yield and agronomic efficiency prediction in Ghana

Maize (Zea mays) is an important staple crop for food security in Sub-Saharan Africa. However, there is need to increase production to feed a growing population. In Ghana, this is mainly done by increasing acreage with adverse environmental consequences, rather than yield increment per unit area. Accurate prediction of maize yields and nutrient use efficiency in production is critical to making informed decisions toward economic and ecological sustainability. We trained the random forest machine learning algorithm to predict maize yield and agronomic efficiency in Ghana using soil, climate, environment, and management factors, including fertilizer application. We calibrated and evaluated the performance of the random forest machine learning algorithm using a 5 × 10-fold nested cross-validation approach. Data from 482 maize field trials consisting of 3136 georeferenced treatment plots conducted in Ghana from 1991 to 2020 were used to train the algorithm, identify important predictor variables, and quantify the uncertainties associated with the random forest predictions. The mean error, root mean squared error, model efficiency coefficient and 90 % prediction interval coverage probability were calculated. The results obtained on test data demonstrate good prediction performance for yield (MEC = 0.81) and moderate performance for agronomic efficiency (MEC = 0.63, 0.55 and 0.54 for AE-N, AE-P and AE-K, respectively). We found that climatic variables were less important predictors than soil variables for yield prediction, but temperature was of key importance to yield prediction and rainfall to agronomic efficiency. The developed random forest models provided a better understanding of the drivers of maize yield and agronomic efficiency in a tropical climate and an insight towards improving fertilizer recommendations for sustainable maize production and food security in Sub-Saharan Africa.

Comparative Analysis of DNN, GBT, and KNN Models for Network Intrusion Detection

Network intrusion detection is critical to cybersecurity, aiming to identify and mitigate unauthorized access and attacks on computer systems and networks. This study evaluates the effectiveness of three machine learning techniques—deep neural networks (DNN), gradient boost trees (GBT), and k-nearest neighbors (KNN)—in detecting network intrusions. The performance of these models was assessed using a comprehensive dataset of 2,540,047 records encompassing 49 features across nine attack categories. The results indicate that GBT outperforms DNN and KNN in accuracy and robustness. These findings highlight the potential of GBT for enhancing intrusion detection systems and contribute valuable insights into the comparative performance of different machine learning algorithms in cybersecurity applications.

Enhancing Heart Attack Prediction Accuracy through Optimized Machine Learning and Deep Learning: A Survey

Heart attacks are a leading cause of mortality worldwide. Early and accurate prediction can significantly improve patient outcomes. This paper explores the potential of optimized machine learning and deep learning techniques to enhance heart attack prediction accuracy. We discuss the challenges associated with traditional methods and propose a framework that leverages advancements in machine learning and deep learning. The framework may involve techniques like data pre-processing, feature selection, hyperparameter tuning, and ensemble methods to optimize the performance of machine learning algorithms like random forests and support vector machines. Additionally, it may explore deep learning architectures like convolutional neural networks or recurrent neural networks for feature extraction and pattern recognition from complex medical data. The goal is to achieve a more robust and accurate prediction model for heart attacks. This can empower healthcare professionals to identify high-risk individuals, allowing for preventative measures and early intervention, ultimately saving lives. The paper will delve into the specific methods employed for optimization, evaluate their effectiveness, and discuss the potential impact on improving heart attack prediction accuracy

Investigation of Histological Image Classification Methods Using Different Feature Extraction Techniques

This paper examines the performance of different machine and deep learning algorithms in classifying colon histological images using different feature extraction methods. The relationship between the feature extraction methods and the selected machine learning methods to improve the classification accuracy is analyzed. Widely used methods like local binary patterns, histograms of oriented gradients, Gabor filter and Dobeshi wavelets are investigated for feature extraction from colon histological images. The features extracted by histogram of oriented gradients and Gabor filter methods were used as a single joint feature vector. And popular machine learning methods such as Support vector machine, Decision trees, Random forest, k-nearest neighbors and Naive Bayesian method were used to classify the selected images. The paper also investigates ensemble methods using gradient bousting and voting classifier as examples. The authors also focus on the study of convolutional neural networks as they are one of the main deep learning methods at the moment. The classification methods selected for analysis are compared in terms of classification accuracy and time taken for training and recognition. All pre-defined and adjustable parameters of both feature extraction methods and classification methods were personally selected by the authors as a result of experimental studies, which were conducted using a software tool created in the Python programming language on a set of LC25000 histological images. The software created is easily customizable and can be used in the future to investigate classification methods on other datasets.

Detection and Analysis of Malicious Software Using Machine Learning Models

The continuous evolution of malware poses a significant challenge in cybersecurity, adapting to technological advancements despite implemented security measures. This paper introduces an innovative approach to enhance the detection of obfuscated malware through the integration of machine learning (ML). Utilizing a real-world dataset of prevalent malware types such as spyware, ransomware, and trojan horses, our study addresses the evolving challenges of cybersecurity. In this study, we evaluate the performance of ML algorithms for obfuscated malware detection using the CIC-MalMem-2022 dataset. Our analysis encompasses binary and multi-class classification tasks under various experimental conditions, including percentage splits and 10-fold cross-validation. The evaluated algorithms include Random Tree (RT), Random Forest (RF), J-48 (C4.5), Naive Bayes (NB), and XGBoost. Experimental results demonstrate the effectiveness of RF, J-48, and XGBoost in achieving high accuracy rates across different classification tasks. NB also shows competitive performance but faces challenges in handling imbalanced datasets and multi-class classification. Our findings highlight the importance of employing advanced ML techniques for enhancing obfuscated malware detection capabilities and provide valuable insights for cybersecurity practitioners and researchers. Future research directions include fine-tuning model hyperparameters, exploring ensemble learning approaches, and expanding evaluation to diverse datasets and real-world scenarios.

The Multicollinearity Effect on the Performance of Machine Learning Algorithms: Case Examples in Healthcare Modelling

Background: The data extracted from various fields inherently consists of extremely correlated measurements in parallel with the exponential increase in the size of the data that need to be interpreted owing to the technological advances. This problem, called the multicollinearity, influences the performance of both statistical and machine learning algorithms. Statistical models proposed as a potential remedy to this problem have not been sufficiently evaluated in the literature. Therefore, a comprehensive comparison of statistical and machine learning models is required for addressing the multicollinearity problem. Methods: Statistical models (including Ridge, Liu, Lasso and Elastic Net regression) and the eight most important machine learning algorithms (including Cart, Knn, Mlp, MARS, Cubist, Svm, Bagging and XGBoost) are comprehensively compared by using two different healthcare datasets (including Body Fat and Cancer) having multicollinearity problem. The performance of the models is assessed through cross validation methods via root mean square error, mean absolute error and r-squared criteria. Results: The results of the study revealed that statistical models outperformed machine learning models in terms of root mean square error, mean absolute error and r-squared criteria in both training and testing performance. Particularly the Liu regression often achieved better relative performance (up to 7.60% to 46.08% for Body Fat data set and up to 1.55% to 21.53% for Cancer data set on training performance and up to 1.56% to 38.08% for Body Fat data set and up to 3.50% to 23.29% for Cancer data set on testing performance) among regression methods as well as compared to machine algorithms. Conclusions: Liu regression is mostly disregarded in the machine learning literature, but since it outperforms the most powerful and widely used machine learning algorithms, it appears to be a promising tool in almost all fields, especially for regression-based studies including data with multicollinearity problem.

Predicting GDP with Machine Learning Technique

This paper proposes a method for reducing model errors in regressions when modelling macroeconomic variables by using machine learning algorithms and traditional time series regression models. In this paper, machine learning models are subjected to repeated k-fold cross validation and hyperparameter tuning. The linear model uses repeated k-fold cross validation, on the other hand, the traditional time series model Mixed Data Sampling Auto Regressive Distribution Lag model is run without repeated k-fold cross validation and hyperparameter tuning. The results show that integrating repeated k-fold cross validation with hyperparameter tuning increases the overall performance of machine learning algorithms and each model records the average outcome from all folds and runs. These findings demonstrate how machine learning models outperform the traditional time series model.

Comparison of machine learning and electrical resistivity arrays to inverse modeling for locating and characterizing subsurface targets

This study evaluates the performance of multiple machine learning (ML) algorithms and electrical resistivity (ER) arrays for inversion with comparison to a conventional Gauss-Newton numerical inversion method. Four different ML models and four arrays were used for the estimation of only six variables for locating and characterizing hypothetical subsurface targets. The combination of dipole-dipole with Multilayer Perceptron Neural Network (MLP-NN) had the highest accuracy. Evaluation showed that both MLP-NN and Gauss-Newton methods performed well for estimating the matrix resistivity while target resistivity accuracy was lower, and MLP-NN produced sharper contrast at target boundaries for the field and hypothetical data. Both methods exhibited comparable target characterization performance, whereas MLP-NN had increased accuracy compared to Gauss-Newton in prediction of target width and height, which was attributed to numerical smoothing present in the Gauss-Newton approach. MLP-NN was also applied to a field dataset acquired at U.S. DOE Hanford site.

Accurate Fake News Prediction by Comparing Performance of Machine learning algorithms

Accurate Fake News Prediction by Comparing Performance of Machine learning algorithms

Dual-dual subspace learning with low-rank consideration for feature selection

The performance of machine learning algorithms can be affected by redundant features of high-dimensional data. Furthermore, these irrelevant features increase the time of computation for learning model. These problems can be addressed by leveraging different techniques including feature selection and dimensionality reduction. Unsupervised feature selection has drawn increased attention due to the difficulty of label collection for supervised feature selection. To this end, we developed an innovative approach based on nonnegative matrix factorization (NMF) to remove redundant information. In this technique, for the first time, the local information preserving regularization and global information preserving regularization are applied for both feature weight matrix and representation matrix which is why we called Dual-Dual regularized feature selection. Furthermore, Schatten p-norm is utilized to extract inherent low-rank properties of data. To demonstrate the effectiveness of the proposed method, experimental studies are conducted on six benchmark datasets. The computational results show that the proposed method in comparison with state-of-the-art unsupervised feature selection techniques is more efficient for feature selection.

Recent advancements in postpartum depression prediction through machine learning approaches: a systematic review

Postpartum depression (PPD) is a significant mental health concern affecting mothers worldwide, irrespective of demographic factors. Detecting and managing PPD at an early stage is crucial for effective intervention. In the context of mental health, intelligent predictive models based on machine learning (ML) have emerged as valuable tools. However, there remains a relative scarcity of research specifically targeting postpartum mental health due to several prominent factors that collectively impede the widespread adoption and practical implementation of ML in the field of PPD. This paper provides an updated overview of ML approaches for PPD prediction. A systematic search across IEEE Xplore, PubMed, Science Direct, and Scopus yielded 1,074 relevant articles. The performance of ML algorithms varies depending on the dataset and the problem being addressed. Notably, the findings reveal that the random forest (RF) algorithm consistently demonstrates the highest predictive accuracy, followed by support vector machine (SVM), logistic regression (LR), XGBoost, and AdaBoost. The development of advanced data techniques in PPD has encouraged interdisciplinary collaboration between researchers in psychiatry and computer science that holds great potential for refining the accuracy and reliability of PPD predictive models, ultimately resulting in improved outcomes for mothers and their families through early detection, intervention, and support.

Comparing online wrist and forearm EMG-based control using a rhythm game-inspired evaluation environment

Objective.The use of electromyogram (EMG) signals recorded from the wrist is emerging as a desirable input modality for human-machine interaction (HMI). Although forearm-based EMG has been used for decades in prosthetics, there has been comparatively little prior work evaluating the performance of wrist-based control, especially in online, user-in-the-loop studies. Furthermore, despite different motivating use cases for wrist-based control, research has mostly adopted legacy prosthesis control evaluation frameworks.Approach.Gaining inspiration from rhythm games and the Schmidt's law speed-accuracy tradeoff, this work proposes a new temporally constrained evaluation environment with a linearly increasing difficulty to compare the online usability of wrist and forearm EMG. Compared to the more commonly used Fitts' Law-style testing, the proposed environment may offer different insights for emerging use cases of EMG as it decouples the machine learning algorithm's performance from proportional control, is easily generalizable to different gesture sets, and enables the extraction of a wide set of usability metrics that describe a users ability to successfully accomplish a task at a certain time with different levels of induced stress.Main results.The results suggest that wrist EMG-based control is comparable to that of forearm EMG when using traditional prosthesis control gestures and can even be better when using fine finger gestures. Additionally, the results suggest that as the difficulty of the environment increased, the online metrics and their correlation to the offline metrics decreased, highlighting the importance of evaluating myoelectric control in real-time evaluations over a range of difficulties.Significance.This work provides valuable insights into the future design and evaluation of myoelectric control systems for emerging HMI applications.

Analisis Kinerja Algoritma Machine Learning dalam Prediksi Harga Cryptocurrency

Cryptocurrency has become an increasingly popular digital asset in recent years. However, cryptocurrency prices are highly volatile and difficult to predict due to being influenced by many factors such as market sentiment, regulations, and technological adoption. This study aims to analyze the performance of several popular machine learning algorithms in accurately predicting cryptocurrency prices. We evaluated four algorithms: Linear Regression, Random Forest, Support Vector Machine (SVM), and Long Short-Term Memory (LSTM) using historical price datasets of Bitcoin, Ethereum, and Litecoin. The data were analyzed by preprocessing steps such as normalization and splitting into training and testing sets. Evaluation metrics used were Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), and prediction accuracy. The experimental results showed that the LSTM algorithm had the best performance in predicting cryptocurrency prices with the highest accuracy and lowest error, followed by SVM, Random Forest, and Linear Regression. Further analysis revealed that LSTM was able to capture patterns and trends in complex time series data.

Visual analytics of an interpretable prediction model for the glass transition temperature of fluoroelastomers

In development, precise measurement and control of Tg is essential for researchers to thoroughly understand and master how variations in formulation and production processes impact product performance. Given the complexity of industrial production, most manufacturers repeatedly produce fluorine materials and test their Tg until it satisfies the application environment’s demands. Consequently, this study utilized an FKM dataset from actual synthesis trials, subjected to data classification, alignment, and feature filtering, to develop a predictive model based on Elastic Net Regression, enhancing the accuracy of Tg predictions for FKM. We evaluated the performance of several regression machine learning algorithms, including Random Forest, Support Vector Machines, Decision Trees, Extreme Gradient Boosting, and Ensemble Learning. The findings show that Random Forest and Elastic Net models exceeded other models by approximately 5% to 10 % in the coefficient of determination, indicating superior predictive capabilities. The Elastic Net Regression model excelled particularly in terms of evaluation coefficients and error rates. To boost the model’s interpretability, this research developed and implemented a visualization technology scheme for the excellently performing models, integrating SHAP value analysis to vividly depict the feature space, prediction processes, and experimental outcomes, thereby aiding the exploration of Tg influencing factors. This research not only offers an innovative machine learning framework for Tg prediction in FKM but also enhances the model’s transparency and credibility using visualization technology, holding significant theoretical and practical implications for materials science research.

Isotopological remeshing and statistical shape analysis: Enhancing premolar tooth wear classification and simulation with machine learning

ObjectiveThe aim of this study was to evaluate the accuracy of a combined approach based on an isotopological remeshing and statistical shape analysis (SSA) to capture key anatomical features of altered and intact premolars. Additionally, the study compares the capabilities of four Machine Learning (ML) algorithms in identifying or simulating tooth alterations. Methods113 premolar surfaces from a multicenter database were analyzed. These surfaces were processed using an isotopological remeshing method, followed by a SSA. Mean Euclidean distances between the initial and remeshed STL files were calculated to assess deviation in anatomical landmark positioning. Seven anatomical features were extracted from each tooth, and their correlations with shape modes and morphological characteristics were explored. Four ML algorithms, validated through three-fold cross-validation, were assessed for their ability to classify tooth types and alterations. Additionally, twenty intact teeth were altered and then reconstructed to verify the method's accuracy. ResultsThe first five modes encapsulated 76.1% of the total shape variability, with a mean landmark positioning deviation of 10.4 µm (±6.4). Significant correlations were found between shape modes and specific morphological features. The optimal ML algorithms demonstrated high accuracy (>83%) and precision (>86%). Simulations on intact teeth showed discrepancies in anatomical features below 3%. ConclusionThe combination of an isotopological remeshing with SSA showed good reliability in capturing key anatomical features of the tooth. Clinical significanceThe encouraging performance of ML algorithms suggests a promising direction for supporting practitioners in diagnosing and planning treatments for patients with altered teeth, ultimately improving preventive care.

The Value of Radiomic Features of Primary Breast Tumor in STIR Sequences in Predicting Axilla Metastasis

Background: Detection of axillary metastases in breast cancer is critical for treatment options and prognosis. The aim of this study is to investigate the value of radiomic features obtained from short tau inversion recovery (STIR) sequences in magnetic resonance imaging (MRI) of primary tumor in breast cancer in predicting axillary lymph node metastasis (ALNM). Methods: Lesions of 165 patients with a mean age of 51.12 ±11 (range 28-82) with newly diagnosed invasive breast cancer who underwent breast MRI before treatment were manually segmented from STIR sequences in the 3D Slicer program in all sections. Machine learning (ML) analysis was performed using the extracted 851 features Python 3.11, Pycaret library program. Datasets were randomly divided into train (123, 80%) and independent test (63, 20%) datasets. The performances of ML algorithms were compared with area under curve (AUC), accuracy, recall, presicion and F1 scores. Results: Accuracy and AUC in the training set were in the range of 57 %-86 % and 0.50-0.95, respectively. The best model in the training set was the catBoost classifier with an AUC of 0.95 and 84% accuracy. The AUC, accuracy, recall, precision values and F1 score of the CatBoost classifier on the test set were 0.92, 84 %, 89 %, 85 %, 86 %, respectively. Conclusion: Radiomic features obtained from primary tumors on STIR sequences have the potential to predict ALNM in invasive breast cancer.

Integrating Feature Selection with Machine Learning for Accurate Reservoir Landslide Displacement Prediction

Accurate prediction of reservoir landslide displacements is crucial for early warning and hazard prevention. Current machine learning (ML) paradigms for predicting landslide displacement demonstrate superior performance, while often relying on various feature engineering techniques, such as decomposing into different temporal lags and feature selection. This study investigates the impact of various feature selection techniques on the performance of ML algorithms for landslide displacement prediction. The Shuping and Baishuihe landslides in China’s Three Gorges Reservoir Area are used to comprehensively benchmark four prevalent ML algorithms. Both static ML models, including backpropagation neural network (BPNN), support vector machine (SVM), and dynamic models, such as long short-term memory (LSTM), and gated recurrent unit (GRU), are included. Each ML model is evaluated under three feature engineering techniques: raw multivariate time series, and feature selection under maximal information coefficient-partial autocorrelation function (MIC-PACF), or grey relational analysis-PACF (GRA-PACF). The results demonstrate that appropriate feature selection methods could significantly improve the performance of static ML models. In contrast, dynamic models effectively leverage inherent capabilities in capturing temporal dynamics within raw multivariate time series, seeing marginal gains with extensive feature engineering compared to no feature selection strategy. The optimal feature selection approach varies based on the ML model and specific landslide, highlighting the importance of case-specific assessments. The findings in this study offer guidance on integrating feature selection techniques with different machine learning models to maximize the robustness and generalizability of data-driven landslide displacement prediction frameworks.