Comparison Of Machine Learning Models Research Articles

Development and comparison of machine learning models for in-vitro drug permeation prediction from microneedle patch

The field of machine learning (ML) is advancing to a larger extent and finding its applications across numerous fields. ML has the potential to optimize the development process of microneedle patch by predicting the drug release pattern prior to its fabrication and production. The early predictions could not only assist the in-vitro and in-vivo experimentation of drug release but also conserve materials, reduce cost, and save time. In this work, we have used a dataset gleaned from the literature to train and evaluate different ML models, such as stacking regressor, artificial neural network (ANN) model, and voting regressor model. In this study, models were developed to improve prediction accuracy of the in-vitro drug release amount from the hydrogel-type microneedle patch and the in-vitro drug permeation amount through the micropores created by solid microneedles on the skin. We compared the performance of these models using various metrics, including R-squared score (R2 score), root mean squared error (RMSE), and mean absolute error (MAE). Voting regressor model performed better with drug permeation percentage as an outcome feature having RMSE value of 3.24. In comparison, stacking regressor have a RMSE value of 16.54, and ANN model has shown a RMSE value of 14. The value of permeation amount calculated from the predicted percentage is found to be more accurate with RMSE of 654.94 than direct amount prediction, having a RMSE of 669.69. All our models have performed far better than the previously developed model before this research, which had a RMSE of 4447.23. We then optimized voting regressor model’s hyperparameter and cross validated its performance. Furthermore, it was deployed in a webapp using Flask framework, showing a way to develop an application to allow other users to easily predict drug permeation amount from the microneedle patch at a particular time period. This project demonstrates the potential of ML to facilitate the development of microneedle patch and other drug delivery systems.

Performance Comparison of Machine Learning Models for Concrete Compressive Strength Prediction.

This study explores the prediction of concrete compressive strength using machine learning models, aiming to overcome the time-consuming and complex nature of conventional methods. Four models-an artificial neural network (ANN), a multiple linear regression, a support vector machine, and a regression tree-are employed and compared for performance, using evaluation metrics such as mean absolute deviation, root mean square error, coefficient of correlation, and mean absolute percentage error. After preprocessing 1030 samples, the dataset is split into two subsets: 70% for training and 30% for testing. The ANN model, further divided into training, validation (15%), and testing (15%), outperforms others in accuracy and efficiency. This outcome streamlines compressive strength determination in the construction industry, saving time and simplifying the process.

Comparison of machine learning models for flood forecasting in the Mahanadi River Basin, India

Abstract Developing accurate flood forecasting models is necessary for flood control, water resources and management in the Mahanadi River Basin. In this study, convolutional neural network (CNN) is integrated with random forest (RF) and support vector regression (SVR) for making a hybrid model (CNN–RF and CNN–SVR) where CNN is used as feature extraction technique while RF and SVR are used as forecasting models. These hybrid models are compared with RF, SVR, and artificial neural network (ANN). The influence of training–testing data division on the performance of hybrid models has been tested. Hyperparameter sensitivity analyses are performed for forecasting models to select the best value of hyperparameters and to exclude the nonsensitive hyperparameters. Two hydrological stations (Kantamal and Kesinga) are selected as case studies. Results indicated that CNN–RF model performs better than other models for both stations. In addition, it is found that CNN has improved the accuracy of RF and SVR models for flood forecasting. The results of the training–testing division show that both models’ performance is better at 50–50% data division. Validation results show that both models are not overfitting or underfitting. Results demonstrate that CNN–RF model can be used as a potential model for flood forecasting in river basins.

Comparison of Machine Learning Models in Simulating Glacier Mass Balance: Insights from Maritime and Continental Glaciers in High Mountain Asia

Accurately simulating glacier mass balance (GMB) data is crucial for assessing the impacts of climate change on glacier dynamics. Since physical models often face challenges in comprehensively accounting for factors influencing glacial melt and uncertainties in inputs, machine learning (ML) offers a viable alternative due to its robust flexibility and nonlinear fitting capability. However, the effectiveness of ML in modeling GMB data across diverse glacier types within High Mountain Asia has not yet been thoroughly explored. This study addresses this research gap by evaluating ML models used for the simulation of annual glacier-wide GMB data, with a specific focus on comparing maritime glaciers in the Niyang River basin and continental glaciers in the Manas River basin. For this purpose, meteorological predictive factors derived from monthly ERA5-Land datasets, and topographical predictive factors obtained from the Randolph Glacier Inventory, along with target GMB data rooted in geodetic mass balance observations, were employed to drive four selective ML models: the random forest model, the gradient boosting decision tree (GBDT) model, the deep neural network model, and the ordinary least-square linear regression model. The results highlighted that ML models generally exhibit superior performance in the simulation of GMB data for continental glaciers compared to maritime ones. Moreover, among the four ML models, the GBDT model was found to consistently exhibit superior performance with coefficient of determination (R2) values of 0.72 and 0.67 and root mean squared error (RMSE) values of 0.21 m w.e. and 0.30 m w.e. for glaciers within Manas and Niyang river basins, respectively. Furthermore, this study reveals that topographical and climatic factors differentially influence GMB simulations in maritime and continental glaciers, providing key insights into glacier dynamics in response to climate change. In summary, ML, particularly the GBDT model, demonstrates significant potential in GMB simulation. Moreover, the application of ML can enhance the accuracy of GMB modeling, providing a promising approach to assess the impacts of climate change on glacier dynamics.

Comparison of machine learning models to predict the risk of breast cancer-related lymphedema among breast cancer survivors: a cross-sectional study in China.

The aim of this study was to develop and validate a series of breast cancer-related lymphoedema risk prediction models using machine learning algorithms for early identification of high-risk individuals to reduce the incidence of postoperative breast cancer lymphoedema. This was a retrospective study conducted from January 2012 to July 2022 in a tertiary oncology hospital. Subsequent to the collection of clinical data, variables with predictive capacity for breast cancer-related lymphoedema (BCRL) were subjected to scrutiny utilizing the Least Absolute Shrinkage and Selection Operator (LASSO) technique. The entire dataset underwent a randomized partition into training and test subsets, adhering to a 7:3 distribution. Nine classification models were developed, and the model performance was evaluated based on accuracy, sensitivity, specificity, recall, precision, F-score, and area under curve (AUC) of the ROC curve. Ultimately, the selection of the optimal model hinged upon the AUC value. Grid search and 10-fold cross-validation was used to determine the best parameter setting for each algorithm. A total of 670 patients were investigated, of which 469 were in the modeling group and 201 in the validation group. A total of 174 had BCRL (25.97%). The LASSO regression model screened for the 13 features most valuable in predicting BCRL. The range of each metric in the test set for the nine models was, in order: accuracy (0.75-0.84), sensitivity (0.50-0.79), specificity (0.79-0.93), recall (0.50-0.79), precision (0.51-0.70), F score (0.56-0.69), and AUC value (0.71-0.87). Overall, LR achieved the best performance in terms of accuracy (0.81), precision (0.60), sensitivity (0.79), specificity (0.82), recall (0.79), F-score (0.68), and AUC value (0.87) for predicting BCRL. The study established that the constructed logistic regression (LR) model exhibits a more favorable amalgamation of accuracy, sensitivity, specificity, recall, and AUC value. This configuration adeptly discerns patients who are at an elevated risk of BCRL. Consequently, this precise identification equips nurses with the means to undertake timely and tailored interventions, thus averting the onset of BCRL.

Performance comparison of machine learning models used for predicting subclinical mastitis in dairy cows: bagging, boosting, stacking and super-learner ensembles versus single machine learning models

Mastitis has a substantial impact on the dairy industry across the world, causing dairy producers to suffer losses due to the reduced quality and quantity of produced milk. A further problem, related to this issue, is the excessive use of antibiotics that leads to the development of resistance in different bacterial strains. The growing consumer awareness oriented toward food safety and rational use of antibiotics has promoted the search for new methods of early identification of cows that may be at risk of developing the disease. Subclinical mastitis does not cause any visible changes to the udder or milk, and therefore it is more difficult to detect than clinical mastitis. The collection of large amounts of data related to milk performance of cows allows using machine learning (ML) methods to build models that could be used for classifying cows into healthy and at risk of subclinical mastitis. The data used for the purpose of this study included information from routine milk recording procedures. The data set consisted of 19,856 records of 2,227 Polish Holstein-Friesian cows from 3 herds. The authors decided to use the approach of building ensemble ML models, in particular bagging, boosting, stacking and super learner models, and comparing them for accuracy of identification of disease-affected cows against single ML models based on the Support Vector Machines, Logistic Regression, Gaussian Naïve Bayes, k-Nearest Neighbors and Decision Tree algorithms. The models were trained and evaluated based on the information recorded for herd 1 and using an 80:20 train-test split ratio according to animal ID (to avoid data leakage). The information recorded for herds 2 and 3 was only used to evaluate on unseen data models developed using the herd 1 data set. Among the single ML models, the Support Vector Machines model was found to be the most accurate in predicting subclinical mastitis at subsequent test-day when used both for the training set (mean F1-score of 0.760) and the testing sets containing data for herds 1, 2 and 3 (F1-score of 0.778, 0.790 and 0.741 respectively). The Gradient Boosting model was found to be the best performing model among the ensemble ML models (F1-score of 0.762, 0.779, 0.791 and 0.723 for the training set and the testing sets respectively). The super learner model, featuring the most advanced design and Logistic Regression in the meta layer, achieved the highest mean F1-score of 0.775 during the cross-validation, however, it was characterized by a slightly worse prediction accuracy of the testing sets (mean F1-score of 0.768, 0.790 and 0.693 for herds 1, 2 and 3 respectively). The study findings confirm the promising role of ensemble ML methods that were found to be slightly superior with respect to most of the single ML models.

Feature correlation analysis and comparison of machine learning models for air ticket price prediction

The price fluctuations of air tickets are caused by many aspects, such as flight duration, departure time, arrival time, and the origin and destination of flight, etc. Passengers always hope to buy air tickets at a lower price, while airlines hope to introduce reasonable fares to achieve more stable and higher income. This paper obtained a set of 13,354 pieces of data from Kaggle, which consists of 11 variables of ticket information from the ticket booking platform "Easy My Trip", to study the impact of relevant factors on flight prices. Predict the price movement trend based on the existing relatively stable technology of machine learning. Using various factors that may affect flight prices in the data set as the data for training the model, four different regression methods are used to predict flight prices. Through a variety of regression result evaluation indicators, the optimal regression algorithm is selected. Experiments show that the prediction results of the regression algorithm based on ensemble learning are significantly better than other regression models

Comparison of machine learning models for the estimation of solar power generation in Australia

Solar power is a renewable energy source that contributes a lot to improving the environmental sustainability of energy production. In Australia, rooftop solar panel systems are installed for power generation. By seeking the optimal installation strategy, people could develop more efficient technologies and systems. In this work, data related to power generation was gathered between January 1 and December 31, 2022. This article only analyzes qualitative data in the dataset. Firstly, the support vector machine (SVM) model is used to compare the results obtained by removing only one qualitative feature at a time with the results obtained by including all features. It is concluded that the shading condition feature has a significant impact on power generation, and then. By comparing the accuracy of K-nearest neighbor (KNN), Logistic Regression, SVM with Radial Basis Function (RBF) kernel, and Decision Tree, it was found that SVM with RBF kernel is the most suitable classification method for the feature of the shading condition.

Research on loan approval and credit risk based on the comparison of Machine learning models

Nowadays, home loan is a frequently accessed component of people’s financing activities. Homeowners wants to increase the probability of loan acceptance, however banks seek to borrow money to low risk customers. This paper compared and examined the machine learning models to select when loan applicants evaluating their probability of success. This paper introduced the recommended models for the problem, explanations on how to use the selected model. 6 candidate models, including Logistic regression, Decision tree, Random Forest, support vector machine (SVM), Ada Boost and Neural Network are selected. The model selection process would focus on the model’s accuracy on test data as well as the interpretability of these models. The models’ result was interpreted to derive optimal strategies to be undertaken by both debtors and creditors. Throughout comparison between these models, logistic regression was the best in terms of interpretability and accuracy. Nonetheless, other models could bolster the decision-making process by examining their confusion matrices and the fitted importance of predictors in each model. This paper revealed practical implications of machine learning theories on home loan approval and credit risk and aimed to help decision making for both debtors and creditors.

Comparison of machine learning models on breast cancer risk prediction challenge

Breast cancer is a malignant tumor that poses a serious risk to women's life and wellbeing. To make matters worse, this cancer is less symptomatic in its early stages. It is not easily diagnosed through traditional means. The topic of this essay is to investigate machine learning for the determination of breast cancer.. The methods based on machine learning are as followed: automated nuclear section segmentation model, BCRecommender System, DNNs, and computer-aided diagnosis model (CADM). The methods studied are all based on the BreCaHad dataset and use a comparative metric.To measure the performance of each model, the accuracy, F1-score, specificity, and precision are used. The result shows that the approaches based on machine learning work well in diagnosing breast carcinoma, with high accuracy. Most of them have a percentage over 90% in accuracy and some of them are even higher than 95%. However, some of the models work poorly, such as layer 1 of BCRecommender with 61.06% accuracy and EfficientNetB0 with 72.96%. With every aspect taken into consideration, computer-aided diagnosis (CADM: Using combined features of HOG, WPD, ResNet as well as PCA + SVM) has the greatest advantage in diagnosing BC.

Predicting survival of advanced laryngeal squamous cell carcinoma: comparison of machine learning models and Cox regression models

Laryngeal squamous cell carcinoma (LSCC) is a common tumor type. High recurrence rates remain an important factor affecting the survival and quality of life of advanced LSCC patients. We aimed to build a new nomogram and a random survival forest model using machine learning to predict the risk of LSCC progress. The study included 671 patients with AJCC stages III–IV LSCC. To develop a prognostic model, Cox regression analyses were used to assess the relationship between clinic-pathologic factors and disease-free survival (DFS). RSF analysis was also used to predict the DFS of LSCC patients. The ROC curve revealed that the Cox model exhibited good sensitivity and specificity in predicting DFS in the training and validation cohorts (1 year, validation AUC = 0.679, training AUC = 0.693; 3 years, validation AUC = 0.716, training AUC = 0.655; 5 years, validation AUC = 0.717, training AUC = 0.659). Random survival forest analysis showed that N stage, clinical stage, and postoperative chemoradiotherapy were prognostically significant variables associated with survival. The random forest model exhibited better prediction ability than the Cox regression model in the training cohort; however, the two models showed similar prediction ability in the validation cohort.

Comparison of machine learning models for MRI image-based brain tumor classification and segmentation

Brain tumors have a high-risk factor and are extremely harmful to the human body. With the development of science and technology in recent years, automatic segmentation has become popular in medical diagnosis because it provides higher accuracy than traditional hand segmentation. At present, more and more people start to study and improve it. Due to the non-invasive nature of MRI, MR images are often used to segment and classify brain tumors. However, limited by the inaccuracy and inoperability of manual segmentation, it is very necessary to have a complete and comprehensive automatic brain tumor segmentation and classification algorithm technology. This article discusses the benefits, drawbacks, and areas of application of several traditional algorithms as well as more modern, improved, and more advanced algorithms. Segmentation methods and classification methods can be used to classify these techniques. Convolutional neural networks (CNN), Support vector machines, and Transformers are examples of classification methods. Random forests, decision trees, and improved U-Net algorithms are examples of segmentation methods. To discuss the capability of classification and segmentation, there are three sections in the area used for segmenting brain tumors with three types, including Tumor Core, Enhance Tumor, and Whole Tumor, which could be abbreviated as TC, ET, and WT. Through the comparative analysis of these methods, useful insights for future research are provided.

Feature statistical analysis and comparison of machine learning models for university admission prediction

In recent years, the pursue for academic degrees has intensified, leading to a surge in the number of undergraduate students applying for graduate programs at renowned universities worldwide. Consequently, universities have adopted a multifaceted approach to evaluate applicants, moving beyond traditional metrics like GPA to assess their overall potential. This study aims to comprehend the criteria employed by universities to select graduate applicants and assist undergraduate students in planning their academic trajectory. To achieve this, a diverse set of machine learning models are compared, including multiple linear regression and K-nearest neighbors, decision trees, support vector machines, and Bayesian classifiers. These models were trained with online admission probability data to predict the likelihood of admission and uncover the primary factors guiding university selection processes. The findings reveal that while research experience can enhance competitiveness in graduate admissions, academic indicators such as GPA, GRE scores, and language proficiency remain critical determinants of acceptance. Moreover, higher-ranked institutions exhibit a higher proportion of applicants with research experience. For candidates with strong GPAs, it is essential to demonstrate competitive language proficiency, augment research experience through well-crafted recommendation letters and personal statements. Conversely, applicants with lower GPAs should strive for outstanding GRE scores to compensate for academic performance.

Examination of the Accuracy of Movement Tracking Systems for Monitoring Exercise for Musculoskeletal Rehabilitation.

When patients perform musculoskeletal rehabilitation exercises, it is of great importance to observe the correctness of their performance. The aim of this study is to increase the accuracy of recognizing human movements during exercise. The process of monitoring and evaluating musculoskeletal rehabilitation exercises was modeled using various tracking systems, and the necessary algorithms for processing information for each of the tracking systems were formalized. An approach to classifying exercises using machine learning methods is presented. Experimental studies were conducted to identify the most accurate tracking systems (virtual reality trackers, motion capture, and computer vision). A comparison of machine learning models is carried out to solve the problem of classifying musculoskeletal rehabilitation exercises, and 96% accuracy is obtained when using multilayer dense neural networks. With the use of computer vision technologies and the processing of a full set of body points, the accuracy of classification achieved is 100%. The hypotheses on the ranking of tracking systems based on the accuracy of positioning of human target points, the presence of restrictions on application in the field of musculoskeletal rehabilitation, and the potential to classify exercises are fully confirmed.

A performance comparison of machine learning models for stock market prediction with novel investment strategy.

Stock market forecasting is one of the most challenging problems in today's financial markets. According to the efficient market hypothesis, it is almost impossible to predict the stock market with 100% accuracy. However, Machine Learning (ML) methods can improve stock market predictions to some extent. In this paper, a novel strategy is proposed to improve the prediction efficiency of ML models for financial markets. Nine ML models are used to predict the direction of the stock market. First, these models are trained and validated using the traditional methodology on a historic data captured over a 1-day time frame. Then, the models are trained using the proposed methodology. Following the traditional methodology, Logistic Regression achieved the highest accuracy of 85.51% followed by XG Boost and Random Forest. With the proposed strategy, the Random Forest model achieved the highest accuracy of 91.27% followed by XG Boost, ADA Boost and ANN. In the later part of the paper, it is shown that only classification report is not sufficient to validate the performance of ML model for stock market prediction. A simulation model of the financial market is used in order to evaluate the risk, maximum draw down and returns associate with each ML model. The overall results demonstrated that the proposed strategy not only improves the stock market returns but also reduces the risks associated with each ML model.

A Comparison of Machine Learning Models for Predicting Rainfall in Urban Metropolitan Cities

Current research studies offer an investigation of machine learning methods used for forecasting rainfall in urban metropolitan cities. Time series data, distinguished by their temporal complexities, are exploited using a unique data segmentation approach, providing discrete training, validation, and testing sets. Two unique models are created: Model-1, which is based on daily data, and Model-2, which is based on weekly data. A variety of performance criteria are used to rigorously analyze these models. CatBoost, XGBoost, Lasso, Ridge, Linear Regression, and LGBM are among the algorithms under consideration. This research study provides insights into their predictive abilities, revealing significant trends across the training, validation, and testing phases. The results show that ensemble-based algorithms, particularly CatBoost and XGBoost, outperform in both models. CatBoost emerged as the model of choice throughout all assessment stages, including training, validation, and testing. The MAE was 0.00077, the RMSE was 0.0010, the RMSPE was 0.49, and the R2 was 0.99, confirming CatBoost’s unrivaled ability to identify deep temporal intricacies within daily rainfall patterns. Both models had an R2 of 0.99, indicating their remarkable ability to predict weekly rainfall trends. Significant results for XGBoost included an MAE of 0.02 and an RMSE of 0.10, indicating their ability to handle longer time intervals. The predictive performance of Lasso, Ridge, and Linear Regression varies. Scatter plots demonstrate the robustness of CatBoost and XGBoost by demonstrating their capacity to sustain consistently low prediction errors across the dataset. This study emphasizes the potential to transform urban meteorology and planning, improve decision-making through precise rainfall forecasts, and contribute to disaster preparedness measures.

Using Landsat-5 for Accurate Historical LULC Classification: A Comparison of Machine Learning Models

This study investigates the application of various machine learning models for land use and land cover (LULC) classification in the Kerch Peninsula. The study utilizes archival field data, cadastral data, and published scientific literature for model training and testing, using Landsat-5 imagery from 1990 as input data. Four machine learning models (deep neural network, Random Forest, support vector machine (SVM), and AdaBoost) are employed, and their hyperparameters are tuned using random search and grid search. Model performance is evaluated through cross-validation and confusion matrices. The deep neural network achieves the highest accuracy (96.2%) and performs well in classifying water, urban lands, open soils, and high vegetation. However, it faces challenges in classifying grasslands, bare lands, and agricultural areas. The Random Forest model achieves an accuracy of 90.5% but struggles with differentiating high vegetation from agricultural lands. The SVM model achieves an accuracy of 86.1%, while the AdaBoost model performs the lowest with an accuracy of 58.4%. The novel contributions of this study include the comparison and evaluation of multiple machine learning models for land use classification in the Kerch Peninsula. The deep neural network and Random Forest models outperform SVM and AdaBoost in terms of accuracy. However, the use of limited data sources such as cadastral data and scientific articles may introduce limitations and potential errors. Future research should consider incorporating field studies and additional data sources for improved accuracy. This study provides valuable insights for land use classification, facilitating the assessment and management of natural resources in the Kerch Peninsula. The findings contribute to informed decision-making processes and lay the groundwork for further research in the field.

A performance comparison of machine learning models for wildfire occurrence risk prediction in the Brazilian Federal District region

A performance comparison of machine learning models for wildfire occurrence risk prediction in the Brazilian Federal District region

Comparison of Machine Learning Models to Predict Lake Area in an Arid Area

Machine learning (ML)-based models are popular for complex physical system simulation and prediction. Lake is the important indicator in arid and semi-arid areas, and to achieve the proper management of the water resources in a lake basin, it is crucial to estimate and predict the lake dynamics, based on hydro-meteorological variations and anthropogenic disturbances. This task is particularly challenging in arid and semi-arid regions, where water scarcity poses a significant threat to human life. In this study, a typical arid area of China was selected as the study area, and the performances of eight widely used ML models (i.e., Bayesian Ridge (BR), K-Nearest Neighbor (KNN), Gradient Boosting Decision Tree (GBDT), Extra Trees (ET), Random Forest (RF), Adaptive Boosting (AB), Bootstrap aggregating (Bagging), eXtreme Gradient Boosting (XGB)) were evaluated in predicting lake area. Monthly lake area was determined by meteorological (precipitation, air temperature, Standardised Precipitation Evapotranspiration Index (SPEI)) and anthropogenic factors (ETc, NDVI, LUCC). Lake area determined by Landsat satellite image classification for 2000–2020 was analysed side-by-side with the Standardised Precipitation Evapotranspiration Index (SPEI) on 9 and 12-month time scales. With the evaluation of six input variables and eight ML algorithms, it was found that the RF models performed best when using the SPEI-9 index, with R2 = 0.88, RMSE = 1.37, LCCC = 0.95, and PRD = 1331.4 for the test samples. Furthermore, the performance of the ML model constructed with the 9-month time scale SPEI (SPEI-9) as an input variable (MLSPEI-9) depended on seasonal variations, with the average relative errors of up to 0.62 in spring and a minimum of 0.12 in summer. Overall, this study provides valuable insights into the effectiveness of different ML models for predicting lake area by demonstrating that the right inputs can lead to a remarkable increase in performance of up to 13.89%. These findings have important implications for future research on lake area prediction in arid zones and demonstrate the power of ML models in advancing scientific understanding of complex natural systems.

Comparison of Machine Learning Models in Forecasting Reservoir Water Level

Reservoirs are important for flood mitigation and water supply storage. The reservoir water release decision, however, must be intelligently modeled due to the unknown volume of input. The model can help reservoir operators make early water release decisions during heavy rainstorms and hold water during drought seasons. One of the promising techniques has been a machine learning-based forecasting model. Therefore, in this study, several machine learning models were identified and compared in terms of performance using Mean Absolute Error (MAE), R-Square, and Root Mean Square (RMSE). The findings show that VARMAX has the highest R-squared value. This identifies the data set as a time series having a seasonal component. ARIMA, on the other hand, is unable to produce adequate results when a seasonal component is included. Both models' MAE and RMSE values accurately reflect the above-mentioned argument.