Random Forest Regression Research Articles

Application of machine learning for predictions of consecutive dependent data of type {[(a, b)->c]->d}

Objective: Machine learning techniques have emerged in response to the desire for automatic pattern detection withindatasets in fields such as statistics, mathematics, and data analytics. They allow for the extraction of relevant informationfrom datasets of significantly large volumes, providing the possibility of making predictions. This paper presents an application focused on decision trees, linear regression, and random forest regression algorithms to predict final data fromconsecutive dependent data of type {[(a, b) → c] → D}. Methodology: The study adopts a quantitative research design, which takes as input datasets based on interval data. It utilizes a correlational research model by implementing Python and its Scikit-Learn library, which includes various algorithms for prediction. Specifically, we compare the application of decision trees, linear regression, and random forest regression on the same set of datasets, but with a characteristic of dependency between them. Results: Upon application of the proposed model, it yields an estimated prediction score, which indicates the accuracy of the model concerning the data provided. Conclusions: The application of a complex algorithm does not inherently guarantee a higher rate of accuracy. Conversely, configuring the model correctly, training multiple trees, or adjusting parameter values can significantly enhance the obtained results

Predicting and Monitoring Anxiety and Depression: Advanced Machine Learning Techniques for Mental Health Analysis

Anxiety and depression are considered among the most prevailing mental illnesses; they affect millions in the USA and worldwide. Besides being highly prevalent, these conditions have major implications for individuals and American society as a whole. The prime objective of this research project was to design and evaluate advanced machine learning methodologies for the monitoring and prediction of anxiety and depression. The rise in recent advances in Machine Learning and AI technologies has unleashed tremendous potential in the diagnosis and monitoring of mental health conditions such as anxiety and depression. Predictive models, powered by Machine Learning algorithms, process vast amounts of data and detect patterns that might have evaded human clinicians. This dataset for the current research project was retrieved from the website kaggle.com and shared publicly with anyone by the Harvard Data Verse repository. The dataset contained behavioral, psychophysiological, and demographic data that were collected from 593 participants aged 18-35 years for the prediction of anxiety and depression disorder risk. For this study, three machine learning algorithms were deployed: Logistic Regression, XG-Boost, and Random Forest. To assess and evaluate the performance of the algorithms, two key performance evaluation metrics were utilized MSE & R-squared. By reviewing the performance of the aforementioned three machine learning models, Linear Regression, Random Forest Regressor, and XG-Boost Regressor, using evaluation metrics MSE and R-squared are compared in a tabular form. Retrospectively, all three models performed remarkably well, with very low MSE values and R-squared values close to 1. Linear Regression marginally outperformed the others, but all models were successful in predicting the anxiety or depression indicator accurately. The proposed models are valid and reliable models for predicting mental health, therefore enabling the identification of at-risk individuals well in advance, allowing early intervention to prevent symptom onsets or advancements in their course and thus improve overall outcomes.

Analysis of Lung Disease Prediction using Machine Learning Algorithms

Lung diseases are a notable in global health concern, requiring early diagnosis for better recovery and survival rates. Deep learning strategies, especially CNNs, have shown great promise in self learning lung disease diagnosis from medical images like chest X-rays. Ensemble learning methods using pretrained networks such as VGG16, InceptionV3, and MobileNetV2 have achieved up to 94% accuracy in identifying conditions like COVID-19, pneumonia, and lung opacity. Lightweight CNN models also performed well, with accuracy up to 89.89%. Traditional machine learning algorithms, including Random Forest and Logistic Regression, yielded accuracy rates between 88% and 90%. A hybrid deep learning approach, combining CNN based feature extraction with classifiers like AdaBoost, SVM, and Random Forest, improved classification accuracy by 3.1% and reduced computational complexity by 16.91%. This hybrid method highlights the main feature for integrating deep learning with traditional classifiers to enhance lung disease detection efficiency

Prediction of municipal waste generation using multi-expression programming for circular economy: a data-driven approach.

The existing surge in municipal waste generation (MWG), characterized by swiftly changing and uncontrollable factors, poses a significant challenge to sustainable development. This prompted the need for improved predictive models to guide strategic waste management within the circular economy framework. This study aims to develop a predictive model using multi-expression programming (MEP) to assess MWG. The model was developed using historical data on socioeconomic and environmental factors and validated via comparative analyses with artificial neural network (ANN), random forest (RF), and multiple linear regression (MLR) using various evaluation metrics. The parametric and sensitivity analyses of the MEP model were also conducted. The MEP, ANN, RF, and MLR models have a coefficient of determination (R2) (for testing datasets) of 0.977, 0.974, 0.957, and 0.964, respectively. The MEP model is superior in terms of accuracy and performance for the prediction of MWG when compared to the other three models. The sensitivity analysis revealed the relative importance of each input variable in the established MEP model. The novelty of this research lies in the application of MEP to predict MWG and the formulation of a new mathematical model that links socioeconomic and environmental factors with MWG. The model can be used by waste management authorities to optimize waste collection, transportation, and disposal infrastructure for an effective circular economy and sustainable development. This model also aids in the development of effective waste management policies.

UAV-Based Multispectral Winter Wheat Growth Monitoring with Adaptive Weight Allocation

Comprehensive growth index (CGI) more accurately reflects crop growth conditions than single indicators, which is crucial for precision irrigation, fertilization, and yield prediction. However, many current studies overlook the relationships between different growth parameters and their varying contributions to yield, leading to overlapping information and lower accuracy in monitoring crop growth. Therefore, this study focuses on winter wheat and constructs a comprehensive growth monitoring index (CGIac), based on adaptive weight allocation of growth parameters’ contribution to yield, using data such as leaf area index (LAI), soil plant analysis development (SPAD) values, plant height (PH), biomass (BM), and plant water content (PWC). Using UAV data on vegetation indices, feature selection was performed using the Elastic Net. The growth inversion model was then constructed using machine learning methods, including linear regression (LR), random forest (RF), gradient boosting (GB), and support vector regression (SVR). Based on the optimal growth inversion model for winter wheat, spatial distribution of wheat growth in the study area is obtained. The findings demonstrated that CGIac outperforms CGIav (constructed using equal weighting) and CGIcv (built using the coefficient of variation) in yield correlation and prediction accuracy. Specifically, the yield correlation of CGIac improved by up to 0.76 compared to individual indices, while yield prediction accuracy increased by up to 23.14%. Among the evaluated models, the RF model achieved the best performance, with a coefficient of determination (R2) of 0.895 and a root mean square error (RMSE) of 0.0058. A comparison with wheat orthophotos from the same period confirmed that the inversion results were highly consistent with actual growth conditions in the study area. The proposed method significantly improved the accuracy and applicability of winter wheat growth monitoring, overcoming the limitations of single parameters in growth prediction. Additionally, it provided new technological support and innovative solutions for regional crop monitoring and precision farming operations.

Characterisation and prediction of mechanical properties in laser powder bed fusion-printed parts: a comparative analysis using machine learning

ABSTRACT This study investigates the effects of process parameters including scanning strategy, build orientation, and hatching distance on the mechanical properties of AlSi10Mg parts produced by Laser Powder Bed Fusion (L-PBF). The experiment varied these parameters within defined ranges and used statistical analysis to evaluate their impact on tensile strength and ductility. Results showed that scanning strategy had the greatest influence, followed by hatching distance, while build orientation affected anisotropic properties. Microstructural analysis showed clear correlation between process conditions and mechanical strength, thereby showing the underlying mechanisms that govern material behavior. Moreover, Machine learning models, including Random Forest Regression (RFR), Support Vector Regression (SVR), and Artificial Neural Networks (ANNs), were applied to predict tensile strength and ductility characteristics. RFR and SVR outperformed ANNs, showing high predictive accuracy with limited datasets. These findings emphasize the importance of optimizing L-PBF process parameters to minimize anisotropy and achieve consistent mechanical properties in produced parts.

Modeling rate of penetration using hybridization of Artificial Neural Network and Artificial Fish Swarm algorithm

This study aims to develop a robust and efficient approach for predicting the Rate of Penetration (ROP) by integrating the Artificial Fish Swarm Algorithm (AFSA) with the Back Propagation (BP) algorithm in an Artificial Neural Network (ANN). The integration of AFSA with Back Propagation is the primary novelty of this work, as it seeks to achieve optimal weight and bias values for the ANN, thereby enhancing prediction accuracy. A dataset of 1944 data points from a vertical well in southern Algeria was utilized. The performance of the developed models was evaluated using correlation coefficient and root mean square error (RMSE). The results demonstrated that the AFSA-ANN model significantly outperforms conventional ANN, Support Vector Regression (SVR), Random Forest regressor (RFR), and Bourgoyne and Young’s model in terms of accuracy. Additionally, the application of leverage method revealed that only 0.98% of the data falls outside the model’s applicability domain, indicating that the data and the model are statistically valid and reliable. The findings of this study have significant implications for the oil and gas field, providing a more accurate and reliable method for predicting ROP, which can lead to more efficient drilling operations and reduced costs.

A multi-step regularity assessment and joint prediction system for ordering time series based on entropy and deep learning

Customer maintenance is of vital importance to the enterprise management. Valuable assessment and efficient prediction for customer ordering behavior can offer better decision-making and reduce business costs significantly. According to existing studies about customer behavior regularity segment and demand prediction most focus on e-commerce and other fields with large amount of data, making them not suitable for small enterprises and data features like sparsity and outliers are not mined when doing regularity quantification. Additionally, more and more complex network structures for demand prediction are proposed, which builds on the assumption that all the samples have predictive value, ignoring the fine-grained analysis of different time series regularity with high cost. To deal with the above issues, a multi-step regularity assessment and joint prediction system for ordering time series is proposed. For extracting features, comprehensive assessment of customer regularity based on entropy weight method with the result of predictability quantification using K-Means clustering algorithm, real entropy, LZW algorithm and anomaly detection adopting Isolation Forest algorithm not only gives an objective result to ‘how high the regularity of customers is’, filling the gap in the field of regularity quantification, but also provides a theoretical basis for demand prediction models selection. Prediction models: Random Forest regression, XGBoost, CNN and LSTM network are experimented with sMAPE and MSLE for performance evaluation to verify the effectiveness of the proposed regularity quantitation method. Moreover, a merged CNN-BiLSTM neural network model is established for predicting those customers with low regularity and difficult to predict by traditional machine leaning algorithms, which performs better on the data set compared to others. Random Forest is still used for prediction of customers with high regularity due to its high training efficiency. Finally, the results of prediction, regularity quantification, and classification are output from the intelligent system, which is capable of providing scientific basis for corporate strategy decision and has highly extendibility in other enterprises and fields for follow-up research.

Predictive Modeling of the Hydrate Formation Temperature in Highly Pressurized Natural Gas Pipelines

In this study, we aim to develop advanced machine learning regression models for the prediction of hydrate temperature based on the chemical composition of sweet gas mixtures. Data were collected in accordance with the BOTAS Gas Network Code specifications, approved by the Turkish Energy Market Regulatory Authority (EMRA), and generated using DNV GasVLe v3.10 software, which predicts the phase behavior and properties of hydrocarbon-based mixtures under various pressure and temperature conditions. We employed linear regression, decision tree regression, random forest regression, generalized additive models, and artificial neural networks to create prediction models for hydrate formation temperature (HFT). The performance of these models was evaluated using the hold-out cross-validation technique to ensure unbiased results. This study demonstrates the efficacy of ensemble learning methods, particularly random forest with an R2 and Adj. R2 of 0.998, for predicting hydrate formation conditions, thereby enhancing the safety and efficiency of gas transport and processing. This research illustrates the potential of machine learning techniques in advancing the predictive accuracy for hydrate formations in natural gas pipelines and suggests avenues for future optimizations through hybrid modeling approaches.

Machine Learning Models for Predicting Significant Liver Fibrosis in Patients with Severe Obesity and Nonalcoholic Fatty Liver Disease.

Although noninvasive tests can be used to predict liver fibrosis, their accuracy is limited for patients with severe obesity and nonalcoholic fatty liver disease (NAFLD). We developed machine learning (ML) models to predict significant liver fibrosis in patients with severe obesity through noninvasive tests. This prospective study included 194 patients with severe obesity who underwent wedge liver biopsy and metabolic bariatric surgery at Taipei Medical University Hospital between September 2016 and December 2020. Significant liver fibrosis was defined as a fibrosis score ≥ 2. Patients were randomly divided into a training group (70%) and a validation group (30%). ML models, including support vector machine, random forest, k-nearest neighbor, XGBoost, and logistic regression, were trained to predict significant liver fibrosis, using DM status, AST, ALT, ultrasonographic fibrosis scores, and liver stiffness measurements (LSM). An ensemble model including these ML models was also used for prediction. Among the ML models, the XGBoost model exhibited the highest AUROC of 0.77, with a sensitivity, specificity, and accuracy of 61.5%, 75.8%, and 69.5%, in validation set, while LSM, AST, ALT showed strongest effects on the model. The ensemble model outperformed all ML models in terms of sensitivity, specificity, and accuracy of 73.1%, 90.9%, and 83.1%. For patients with severe obesity and NAFLD, the XGBoost model and the ensemble model exhibit high predictive performance for significant liver fibrosis. These models may be used to screen for significant liver fibrosis in this patient group and monitor treatment response after metabolic bariatric surgery.

Improvement of Saline–Alkali Soil and Straw Degradation Efficiency in Cold and Arid Areas Using Klebsiella sp. and Pseudomonas sp.

Corn straw is an important renewable resource, which could improve the quality of saline–alkali cultivated land. However, the slow decomposition of crop residues in cold, arid, and saline–alkali soils can lead to serious resource waste and ecological crises. The use of beneficial microorganisms with degradation functions could solve these problems. In this study, three types of saline–alkali soil with low, medium, and high salinity levels were used in the straw-returning experiment. The experiment was conducted with four treatments: GF2 (Klebsiella sp.), GF7 (Pseudomonas sp.), GF2+GF7, and CK (control without bacteria). Microbial characteristics, straw degradation efficiency, element release rate, and soil factors were compared, and random forest linear regression and partial least squares path modeling analysis methods were utilized. The results indicated that the degradation of bacterial metabolites, the efficiency of corn stover degradation, the efficiency of component degradation, and the release rates of elements (C, N, P, and K) initially increased and then decreased with the increase in salinity. At the maximum value of moderately saline–alkali soil, the effect of GF2+GF7 treatment was significantly better than that of other treatments (p < 0.05). Given the interactive effects of saline–alkali soil and microbial factors, the application of exogenous degrading bacteria could significantly increase soil enzyme activity and soil available nutrients, as well as regulate the salt–alkali ion balance in soil. The cation exchange capacity (9.13%, p < 0.01) was the primary driving force for the degradation rate of straw in saline–alkali soil with different degrees of salinization under the influence of exogenous degrading bacteria. Straw decomposition directly affected the soil chemical properties and indirectly affected soil enzyme activity. The results of this study would provide new strategies and insights into the utilization of microbial resources to promote straw degradation.

Metasurface-enabled multifunctional single-frequency sensors without external power

IoT sensors are crucial for visualizing multidimensional and multimodal information and enabling future IT applications/services such as cyber-physical spaces, digital twins, autonomous driving, smart cities and virtual/augmented reality (VR or AR). However, IoT sensors need to be battery-free to realistically manage and maintain the growing number of available sensing devices. Here, we provide a novel sensor design approach that employs metasurfaces to enable multifunctional sensing without requiring an external power source. Importantly, unlike existing metasurface-based sensors, our metasurfaces can sense multiple physical parameters even at a fixed frequency by breaking classic harmonic oscillations in the time domain, making the proposed sensors viable for usage with limited frequency resources. Moreover, we provide a method for predicting physical parameters via the machine learning-based approach of random forest regression. The sensing performance was confirmed by estimating the temperature and light intensity, and excellent determination coefficients larger than 0.96 were achieved. Our study affords new opportunities for sensing multiple physical properties without relying on an external power source or requiring multiple frequencies, which markedly simplifies and facilitates the design of next-generation wireless communication systems.

FEM-driven machine learning approach for characterizing stress magnitude, peak temperature and weld zone deformation in ultrasonic welding of metallic multilayers: application to battery cells

Abstract This study investigates the innovative application of machine learning (ML) models to predict critical parameters—stress magnitude (SM), peak temperature (PT), and plastic strain (PS)—in ultrasonic welding of metallic multilayers. Extensive numerical simulations were employed to develop and evaluate three ML models: Radial Basis Function (RBF), Random Forest (RF), and Kernel Ridge Regression (KRR). According to the results, the KRR model demonstrated superior performance, achieving the lowest RMSE and highest R 2 values of 0.068 (R 2 = 0.941) for SM, 0.075 (R 2 = 0.929) for PT, and 0.071 (R 2 = 0.946) for PS, with fewer data samples required. KRR also exhibited low squared bias and variance values, ranging from 1 × 10 − 4 − 3.2 × 10 − 4 for bias and 2.2 × 10 − 4 − 3.6 × 10 − 4 for variance, indicating its precision in predicting the output targets. Moreover, the systematic categorization of input features, including material properties, geometrical factors, and welding parameters, highlighted their significant influence on predictive accuracy, particularly the crucial role of welding parameters at higher output values. Finally, a case study on ultrasonic welding of copper multilayers underscores the model’s effectiveness in unraveling complex relationships, providing a robust tool for optimizing and advancing ultrasonic welding processes.

Development of a quantitative prediction algorithm for human cord blood-derived CD34+ hematopoietic stem-progenitor cells using parametric and non-parametric machine learning models

The transplantation of CD34+ hematopoietic stem-progenitor cells (HSPCs) derived from cord blood serves as the standard treatment for selected hematological, oncological, metabolic, and immunodeficiency disorders, of which the dose is pivotal to the clinical outcome. Based on numerous maternal and neonatal parameters, we evaluated the predictive power of mathematical pipelines to the proportion of CD34+ cells in the final cryopreserved cord blood product adopting both parametric and non-parametric algorithms. Twenty-four predictor variables associated with the cord blood processing of 802 processed cord blood units randomly sampled in 2020–2022 were retrieved and analyzed. Prediction models were developed by adopting the parametric (multivariate linear regression) and non-parametric (random forest and back propagation neural network) statistical models to investigate the data patterns for determining the single outcome (i.e., the proportion of CD34+ cells). The multivariate linear regression model produced the lowest root-mean-square deviation (0.0982). However, the model created by the back propagation neural network produced the highest median absolute deviation (0.0689) and predictive power (56.99%) in comparison to the random forest and multivariate linear regression. The predictive model depending on a combination of continuous and discrete maternal with neonatal parameters associated with cord blood processing can predict the CD34+ dose in the final product for clinical utilization. The back propagation neural network algorithm produces a model with the highest predictive power which can be widely applied to assisting cell banks for optimal cord blood unit selection to ensure the highest chance of transplantation success.

Early estimation of glutelin to gliadin ratio in wheat grain using high-dimensional and hyperspectral reflectance

Precise and timely estimation of the glutelin-to-gliadin ratio (Glu/Gli) in wheat grain is pivotal for crop monitoring, as it is a crucial quality indicator ensuring the production of high-quality wheat flour. Despite the recognized potential of hyperspectral technology in crop phenotype estimation, its application to estimate Glu/Gli in wheat grains faces challenges due to complex spectral-chemical relationships and the influence of growing seasons. This study addresses this gap by cultivating 11 wheat varieties and collecting high-dimensional hyperspectral data from field experiments during various growth stages of wheat (2018–2019 and 2019–2020). Utilizing vegetation indices (VIs) in conjunction with linear mixed-effects model (LMM) and random forest regression model (RFR), it constructs a robust Glu/Gli estimation model (with a Glu/Gli range of 1.063 to 2.218). Results reveal that a singular VI application suffers from data limitations, while the integration of multiple VIs significantly enhances estimation accuracy. The mid-grain filling period emerges as a critical stage for accurate Glu/Gli estimation, with TCARI (transformed chlorophyll absorption reflectance index) demonstrating notable significance and high correlation. In model performance, RFR (R2 = 0.691, rRMSE = 0.096, RPD = 1.872, RER = 6.028) outperforms LMM (R2 = 0.477, rRMSE = 0.131, RPD = 1.383, RER = 4.453), exhibiting superior accuracy in estimating grain Glu/Gli for diverse wheat varieties. This study introduces a rapid and accurate approach for early wheat grain Glu/Gli estimation, offering valuable insights for wheat value chain and precision farming.

Enhanced Crop Leaf Area Index Estimation via Random Forest Regression: Bayesian Optimization and Feature Selection Approach

The Leaf Area Index (LAI) is a crucial structural parameter linked to the photosynthetic capacity and biomass of crops. While integrating machine learning algorithms with spectral variables has improved LAI estimation over large areas, excessive input parameters can lead to data redundancy and reduced generalizability across different crop species. To address these challenges, we propose a novel framework based on Bayesian-Optimized Random Forest Regression (Bayes-RFR) for enhanced LAI estimation. This framework employs a tree model-based feature selection method to identify critical features, reducing redundancy and improving model interpretability. A Gaussian process serves as a prior model to optimize the hyperparameters of the Random Forest Regression. The field experiments conducted over two years on maize and wheat involved collecting LAI, hyperspectral, multispectral, and RGB data. The results indicate that the tree model-based feature selection outperformed the traditional correlation analysis and Recursive Feature Elimination (RFE). The Bayes-RFR model demonstrated a superior validation accuracy compared to the standard Random Forest Regression and Pso-optimized models, with the R2 values increasing by 27% for the maize hyperspectral data, 12% for the maize multispectral data, and 47% for the wheat hyperspectral data. These findings suggest that the proposed Bayes-RFR framework significantly enhances the stability and predictive capability of LAI estimation across various crop types, offering valuable insights for precision agriculture and crop monitoring.

A prototype early warning system for diarrhoeal disease to combat health threats of climate change in the asia-pacific region

Abstract Ongoing climate variability and change are increasing the burden of diarrhoeal disease worldwide. Meaningful early warning systems with adequate lead times (weeks to months) are needed to guide public health decision–making and enhance community resilience against health threats posed by climate change. Toward this goal, we trained various machine-learning models to predict diarrhoeal disease rates in Nepal (2002–2014), Taiwan (2008–2019), and Vietnam (2000–2015) using temperature, precipitation, previous disease rates, and El Niño Southern Oscillation phases. We also compared the performance of shallow time-series neural network (NN), Random Forest Regressor, artificial nn, gradient boosting regressor, and long short-term memory–based methods for their effectiveness in predicting diarrhoeal disease burden across multiple countries. We evaluated model performance using a test dataset and assessed the accuracy of predicted diarrhoeal disease incidence rates for the last year of available data in each district. Our results suggest that even in the absence of the most recent disease surveillance data, a likely scenario in most low- and middle-income countries, our NN-based early warning system using historical data performs reasonably well. However, future studies are needed to perform prospective evaluations of such early warning systems in real-world settings.

Optimising Neural Networks for Enhanced Fracture Density Prediction in Surrounding Rock of Coalbed Methane Reservoir

ABSTRACTFractures influence the mechanical strength of coal roof and floor, constraining the design of hydraulic fracturing for coalbed methane production. Currently, the predominant approach involves the integration of petrophysical logging with machine learning for fracture prediction. Nevertheless, challenges exist regarding the model's accuracy. In this study, we present a novel approach to predict fracture density. Our method optimises a back‐propagation (BP) neural network and utilises principal component analysis for feature extraction. We employ logging parameters (density, compensated neutron and acoustic time difference) obtained from Shouyang Block well SY‐1 and fracture density data from electrical imaging logging to construct the FVDC model's dataset. The BP neural network model is optimised using the Sparrow Search algorithm and Tent Chaotic Mapping. The results demonstrate a substantial enhancement over the BP neural network model, with reductions of 80.102% in mean absolute error, 94.182% in mean square error, 75.879% in root mean square error and 79.764% in mean absolute percentage error. When considering accuracy, the optimised model (97.098%) surpasses the support vector regression model (96.478%), the random forest model (94.404%) and the BP neural network model (85.657%). Scalability testing for the optimised model was conducted using data from well SY‐2, yielding a remarkable prediction accuracy of 96.775%. This performance exceeds that of the BP neural network (with an accuracy of 85.102%), as well as the random forest and support vector regression models (with accuracies of 91.234% and 90.384%, respectively). These results underscore the potential of well logging and machine learning in FVDC prediction.

Performance Comparison of Random Forest (RF) and Classification and Regression Trees (CART) for Hotel Star Rating Prediction

Purpose: This study proposes to evaluate the effectiveness of Random Forest (RF) compared to Classification and Regression Trees (CART) in prediction of hotel star ratings. The objective is to identify the algorithm that provides the most reliable and accurate classification outcomes based on diverse hotel attributes in accordance with the standard categorization of star hotel categories. This is necessary due to the important role of accurate star ratings in guiding consumer choices and enhancing competitive positioning in the hospitality industry. Method: This study conducted a comprehensive dataset about Hotel in Banyumas Regency, including location, facilities, the size of rooms, type of rooms, price of rooms, and customer reviews, subjected to training through both RF and CART algorithms. Both algorithms are evaluated using accuracy, precision, recall, and F1 score. Additionally, both algorithms due to in the same preprocessing while performing hyperparameter tuning improve the efficacy of each model. Result: The results showed that RF achieved the best overall accuracy and robustness than CART across all tests conducted. Furthermore, RF also outperformed CART in classification effectiveness among classes, including enhanced precision and recall scores across multiple stars rating categories, signifying increased generalization and consistency in classification tasks. RF classifier consistently surpassed the CART classifier in terms of both accuracy and F1-score throughout all random states and test sizes, with a highest score of 0.9932 at a random state of 100 and a test size of 0.4. The most reliable results were obtained using RF with 42 random states and a test size of 0.2, resulting in an accuracy of 0.9909, precision of 1.0, recall of 1.0, and F1 score of 1.0. Simultaneously, CART shows values of 0.9818, 1.0, 1.0, and 1.0, respectively, while maintaining the same variation. This consistent performance, regardless of fluctuations, illustrates the robustness and suitability of RF for classification tasks compared to CART. Novelty: This study offered new insights about the implementation of machine learning about hotel star rating predictions using RF and CART algorithms. Also, the novelty of the collected hotel dataset used in this study. A detailed comparative analysis was also provided, contributing to the existing literature by showing the effectiveness of RF over CART for this specific application. Future studies could explore the integration of additional machine learning methods to further enhance prediction accuracy and operational efficiency in the hospitality industry.

Unmasking Neuroendocrine Prostate Cancer with a Machine Learning-Driven Seven-Gene Stemness Signature That Predicts Progression.

Prostate cancer (PCa) poses a significant global health challenge, particularly due to its progression into aggressive forms like neuroendocrine prostate cancer (NEPC). This study developed and validated a stemness-associated gene signature using advanced machine learning techniques, including Random Forest and Lasso regression, applied to large-scale transcriptomic datasets. The resulting seven-gene signature (KMT5C, DPP4, TYMS, CDC25B, IRF5, MEN1, and DNMT3B) was validated across independent cohorts and patient-derived xenograft (PDX) models. This signature demonstrated strong prognostic value for progression-free, disease-free, relapse-free, metastasis-free, and overall survival. Importantly, the signature not only identified specific NEPC subtypes, such as large-cell neuroendocrine carcinoma, which is associated with very poor outcomes, but also predicted a poor prognosis for PCa cases that exhibit this molecular signature, even when they were not histopathologically classified as NEPC. This dual prognostic and classifier capability makes the seven-gene signature a robust tool for personalized medicine, providing a valuable resource for predicting disease progression and guiding treatment strategies in PCa management.