Random Forest Method Research Articles

The Microstructure Characterization of a Titanium Alloy Based on a Laser Ultrasonic Random Forest Regression

The traditional microstructure detecting methods such as metallography and electron backscatter diffraction are destructive to the sample and time-consuming and they cannot meet the needs of rapid online inspection. In this paper, a random forest regression microstructure characterization method based on a laser ultrasound technique is investigated for evaluating the microstructure of a titanium alloy (Ti-6Al-4V). Based on the high correlation between the longitudinal wave velocity of ultrasonic waves, the average grain size of the primary α phase, and the volume fraction of the transformed β matrix of the titanium alloy, and with the longitudinal wave velocity as the input feature and the average grain size of the primary α phase and the volume fraction of the transformed β matrix as the output features, prediction models for the average grain size of the primary α phase and the volume fraction of the transformed β matrix were developed based on a random forest regression. The results show that the mean values of the mean relative errors of the predicted mean grain size of the native α phase and the volume fraction of the transformed β matrix for the six samples in the two prediction models were 11.55% and 10.19%, respectively, and the RMSE and MAE obtained from both prediction models were relatively small, which indicates that the two established random forest regression models have a high prediction accuracy.

Prediction of The Patients at Risk for Development Hematoma After Percutaneous Coronary Angiography: A Nursing Decision Support Model Pilot Study

The study aimed to develop a nursing clinical decision support model using the machine learning method, which is one of the important fields today, to identify patients with risk of hematoma development after Percutaneous Coronary Intervention and to help plan appropriate nursing interventions. In this study, the data of 100 patients with myocardial infarction was used in the development of the decision support model. R open-source programming language was used for statistical analysis of the data and the random forest method, one of the machine learning methods was used for the development of the model. The result of this pilot study, a nursing decision support model with a sensitivity of 69% and a specificity of 64% was developed with the Random forest method using 24 features regarding the demographic, laboratory, and percutaneous coronary intervention procedures of the patients.

Intra-annual vegetation changes and spatial variation in China over the past two decades based on remote sensing and time-series clustering.

Vegetation is an important link between land, atmosphere, and water, making its changes of great significance. However, existing research has predominantly focused on long-term vegetation changes, neglecting the intra-annual variations of vegetation. Hence, this study is based on the Enhanced Vegetation Index (EVI) data from 2000 to 2022, with a time step of 16days, to analyze the intra-annual patterns of vegetation changes in China. The average intra-annual EVI values for each municipal-level administrative region were calculated, and the time-series k-means clustering algorithm was employed to divide these regions, exploring the spatial variations in China's intra-annual vegetation changes. Finally, the ridge regression and random forest methods were utilized to assess the drivers of intra-annual vegetation changes. The results showed that: (1) China's vegetation status exhibits a notable intra-annual variation pattern of "high in summer and low in winter," and the changes are more pronounced in the northern regions than in the southern regions; (2) the intra-annual vegetation changes exhibit remarkable regional disparities, and China can be optimally clustered into four distinct clusters, which align well with China's temperature and precipitation zones; and (3) the intra-annual vegetation changes demonstrate significant correlations with meteorological factors such as dew point temperature, precipitation, maximum temperature, and sea-level pressure. In conclusion, our study reveals the characteristics, spatial patterns and driving forces of intra-annual vegetation changes in China, which contribute to explaining ecosystem response mechanisms, providing valuable insights for ecological research and the formulation of ecological conservation and management strategies.

Tongue Disease Prediction Based on Machine Learning Algorithms

The diagnosis of tongue disease is based on the observation of various tongue characteristics, including color, shape, texture, and moisture, which indicate the patient’s health status. Tongue color is one such characteristic that plays a vital function in identifying diseases and the levels of progression of the ailment. With the development of computer vision systems, especially in the field of artificial intelligence, there has been important progress in acquiring, processing, and classifying tongue images. This study proposes a new imaging system to analyze and extract tongue color features at different color saturations and under different light conditions from five color space models (RGB, YcbCr, HSV, LAB, and YIQ). The proposed imaging system trained 5260 images classified with seven classes (red, yellow, green, blue, gray, white, and pink) using six machine learning algorithms, namely, the naïve Bayes (NB), support vector machine (SVM), k-nearest neighbors (KNN), decision trees (DTs), random forest (RF), and Extreme Gradient Boost (XGBoost) methods, to predict tongue color under any lighting conditions. The obtained results from the machine learning algorithms illustrated that XGBoost had the highest accuracy at 98.71%, while the NB algorithm had the lowest accuracy, with 91.43%. Based on these obtained results, the XGBoost algorithm was chosen as the classifier of the proposed imaging system and linked with a graphical user interface to predict tongue color and its related diseases in real time. Thus, this proposed imaging system opens the door for expanded tongue diagnosis within future point-of-care health systems.

Comparative Analysis of Multiple – Linear Regression Algorithm with Random Forest Regression for Prediction of House Plot Prices

Humans basically have a basic need to have a place to live, which can be a house or shelter. Along with the rapid population growth in Indonesia, which continues to increase every year, many people do not have or have a decent place to live. Therefore, careful planning is needed so that every family can have a decent home. One very important aspect in planning investment in the form of property is predicting future house prices. One approach that can be used is to use a Random Forest and Multiple Linear Regression algorithm, which is an algorithm from Machine Learning. There are several factors that can influence the price of a house, including land area, building area, number of bedrooms, bathrooms and garage. In this research, multiple linear regression and random forest regression methods were chosen. The aim of this research is to find the best prediction results between the two methods. To achieve accurate predictions, research was carried out repeatedly by dividing the dataset into 80% for training and 20% for testing. The research results show that the random forest regression algorithm provides the best results, with an accuracy of 81.6%.

INFORMATION SYSTEM FOR DATA PROCESSING IN SPORTS USING THE RANDOM FOREST METHOD

A huge amount of data is collected and generated in modern sports. This data can be used to improve athletes' performance, make more informed coaching and strategic decisions, and increase fan engagement. However, processing, analyzing, and interpreting this data can be challenging. This article is devoted to the development of an information system for data processing in the sports sector using the random forest method. The system aims to ensure efficient collection, processing, and analysis of large amounts of data generated during sports competitions, training, and interaction with fans and other stakeholders. Research methods. This article proposes an information system (IS) for data processing in the sports industry using the Random Forest (RF) method. As one of the machine learning methods, it is well suited for working with large amounts of data and complex classification and prediction tasks. The proposed IS consists of three main components. The data collection module accumulates data from various sources such as sensors, GPS trackers, websites, and social networks. The data processing module cleans, normalizes, and transforms the data to prepare it for analysis. The data analysis module uses the RF method to analyze data, predict outcomes, identify patterns, and make decisions. The conducted research has shown that the proposed IS can be an effective tool for predicting the results of sports competitions with high accuracy, identifying patterns in the data that can be useful for coaches and athletes to improve their training and strategy, personalizing training programs and recommendations for athletes, increasing the level of fan engagement by providing them with personalized content and forecasts. The proposed IS based on the random forest method is a powerful tool for processing and analyzing data in the sports industry. Its use can lead to improved athletes' performance, more informed coaching and strategic decisions, and increased fan engagement. One of the most powerful and accurate machine learning methods, the random forest method, allows for reliable analysis and forecasting based on various types of data, including player statistics, match results, physiological indicators, and fan behavior data. The article describes the stages of creating an information system: from data collection to data processing, storage, and analysis.

Recognition and Prediction of Precursory Feature Signals of Coal Mine Rock Burst Based on Random Forest and MK Trend Test

This paper aims to identify and predict the precursory characteristic signals of coal mine rock burst by employing the Random Forest and MK (Mann-Kendall) trend test methods. Initially, the study conducts data preprocessing and analysis on indicators such as electromagnetic radiation intensity, acoustic wave intensity, and type. It uses clustering methods to distinguish various data types and analyzes the data after visual representation. The visualization of data illustrates the distribution and trends, which aids in understanding the characteristics of the data, such as the upward trend observed in precursory feature data. During the data preprocessing phase, diagrams of various classes of data for Acoustic Emission (AE) and Electromagnetic Radiation (EMR) intensity are presented, providing an intuitive reference for subsequent analysis. The research utilizes the Random Forest algorithm and MK trend test to recognize precursor signals and predict their occurrence intervals. The Random Forest model is chosen for its efficiency and accuracy in handling classification and regression issues, while the MK trend test provides a statistical basis for identifying precursory signals by analyzing monotonic trends within the dataset. This study not only enhances the accuracy of precursory signal identification for coal mine rock bursts but also offers scientific early warning and control measures for coal mine safety production, which is of significant practical value.

A hybrid deep learning model towards fault diagnosis of drilling pump

This paper proposes a novel method namely WaveletKernelNet-Convolutional Block Attention Module-BiLSTM for intelligent fault diagnosis of drilling pumps. Initially, the random forest method is applied to determine the target signals that can reflect the fault characteristics of drilling pumps. Accordingly, the WaveletKernelNet-Convolutional Block Attention Module Net is constructed for noise reduction and fault feature extraction based on signals. The Convolutional Block Attention Module embedded in WaveletKernelNet-CBAM adjusts the weight and enhances the feature representation of channel and spatial dimension. Finally, the Bidirectional Long-Short Term Memory concept is introduced to enhance the ability of the model to process time series data. Upon constructing the network, a Bayesian optimization algorithm is utilized to ascertain and fine-tune the ideal hyperparameters, thereby ensuring the network reaches its optimal performance level. With the hybrid deep learning model presented, an accurate fault diagnosis of a real five-cylinder drilling pump is carried out and the results confirmed its applicability and reliability. Two sets of comparative experiments validated the superiority of the proposed method. Additionally, the generalizability of the model is verified through domain adaptation experiments. The proposed method contributes to the safe production of the oil and gas sector by providing accurate and robust fault diagnosis of industrial equipment.

Spatial evolution of global household clean cooking energy transition: Convergent clubs and drivers

An understanding of the spatial evolution of global household energy and its determinants is needed to achieve global access to clean cooking energy before 2030. Based on a novel global household energy database, we adopt the log t regression test to identify the global trend and find the potential convergent clubs. Besides, we utilize Random Forest method and Ordered Probit model to investigate the drivers affecting the club convergence. As a result: (1) The global sample exhibits divergence from 2000 to 2020; (2) The 191 countries and regions can be classified into 3 convergent clubs, characterized by significant disparities in both the mean and growth rate of their access to clean energy; (3) Per capita GDP, urbanization level, infrastructure development, and educational attainment are identified as the most important factors influencing the club convergence; (4) Countries with a higher level of socio-economic development generally have a higher proportion of residents using clean fuels, with gas energy playing a pivotal role in driving this transformation. This paper adds more evidence to understand the disparity of global household cooking energy use, we propose that economic and infrastructure development, education attainment, and international cooperation are favorable.

Novel Ensemble Learning Algorithm for Early Detection of Lower Back Pain Using Spinal Anomalies

Lower back pain (LBP) is a musculoskeletal condition that affects millions of people worldwide and significantly limits their mobility and daily activities. Appropriate ergonomics and exercise are crucial preventive measures that play a vital role in managing and reducing the risk of LBP. Individuals with LBP often exhibit spinal anomalies, which can serve as valuable indicators for early diagnosis. We propose an advanced machine learning methodology for LBP detection that incorporates data balancing and bootstrapping techniques. Leveraging the features associated with spinal anomalies, our method offers a promising approach for the early detection of LBP. Our study utilizes a standard dataset comprising 310 patient records, including spinal anomaly features. We propose an ensemble method called the random forest gradient boosting XGBoost Ensemble (RGXE), which integrates the combined power of the random forest, gradient boosting, and XGBoost methods for LBP detection. Experimental results demonstrate that the proposed ensemble method, RGXE Voting, outperforms state-of-the-art methods, achieving a high accuracy of 0.99. We fine-tuned each method and validated its performance using k-fold cross-validation in addition to determining the computational complexity of the methods. This innovative research holds significant potential to revolutionize the early detection of LBP, thereby improving the quality of life.

Driver drowsiness is associated with altered facial thermal patterns: Machine learning insights from a thermal imaging approach

Driver drowsiness is a significant factor in road accidents. Thermal imaging has emerged as an effective tool for detecting drowsiness by enabling the analysis of facial thermal patterns. However, it is not clear which facial areas are most affected and correlate most strongly with drowsiness. This study examines the variations and importance of various facial areas and proposes an approach for detecting driver drowsiness. Twenty participants underwent tests in a driving simulator, and temperature changes in various facial regions were measured. The random forest method was employed to evaluate the importance of each facial region. The results revealed that temperature changes in the nasal area exhibited the highest value, while the eyes had the most correlated changes with drowsiness. Furthermore, drowsiness was classified with an accuracy of 88 % utilizing thermal variations in the facial region identified as the most important regions by the random forest feature importance model. These findings provide a comprehensive overview of facial thermal imaging for detecting driver drowsiness and introduce eye temperature as a novel and effective measure for investigating cognitive activities.

Decadal Monitoring of Upwelling Dynamics in Satonda Island Waters Using Landsat-8 and Machine Learning Regression

Global warming and associated weather changes, notably the El Niño Southern Oscillation (ENSO), significantly impact marine ecosystems by altering water quality parameters such as chlorophyll-a (Chl-a) and sea surface temperature (SST). These changes are crucial in understanding the biogeochemical and ecological dynamics of marine environments, especially in regions affected by upwelling. This study aims to monitor upwelling events on Satonda Island, a volcanic island with unique central lake and status as a protected area using remote sensing. Utilizing Landsat-8 imagery and machine learning regression techniques—Random Forest (RF), Support Vector Machine (SVM), and Classification and Regression Tree (CART)—this research evaluates the water quality in Satonda waters over a decade (2013– 2023). The RF method emerged as the most accurate in estimating Chl-a and SST, indicating its efficacy in monitoring marine ecosystems with the result (RMSE = 0.309 and 0.274). The analysis reveals seasonal upwelling patterns, characterized by decreased SST and increased Chl-a concentration, with peaks varying annually between June and November. This study highlights the crucial role of remote sensing and machine learning in monitoring the effects of climate change on marine biodiversity. It provides valuable insights into the temporal dynamics of upwelling in the shallow waters of Indonesia.

Examining the nonlinear relationship between neighborhood environment and residents' health

Although numerous studies have revealed linear associations between the urban environment and health, the nonlinear effects of subjective and objective neighborhood environment on health have been under-researched. Using Beijing as a case study, this study employs the random forest method to investigate the nonlinear relationship between subjective/objective neighborhood environment and physical/mental health, respectively. The findings indicate that the subjective environment is the most important for both physical and mental health, and subjective air and noise pollution are the key factors. Neighborhood environmental variables have nonlinear correlations with health. Improved perception of facility accessibility is positively associated with physical health, whereas extremely high levels of accessibility may inversely decrease the probability of reporting good health. Road connectivity and bus stop density exhibit inverted U-shaped patterns with physical health and mental health, separately. Furthermore, the study highlights different dimensions of green space affect residents' health in diverse ways.

Landslide Susceptibility Assessment by Machine Learning and Frequency Ratio Methods Using XRAIN Radar-Acquired Rainfall Data

This study is an efficiency comparison between four methods for the production of landslide susceptibility maps (LSMs), which include random forest (RF), artificial neural network (ANN), and logistic regression (LR) as the machine learning (ML) techniques and frequency ratio (FR) as a statistical method. The study area is located in the Southern Hiroshima Prefecture in western Japan, a locality known to suffer from rainfall-induced landslide disasters, the most recent one in July 2018. The landslide conditioning factors (LCFs) considered in this study are lithology, land use, altitude, slope angle, slope aspect, distance to drainage, distance to lineament, soil class, and mean annual precipitation. The rainfall LCF data comprise XRAIN (eXtended RAdar Information Network) radar records, which are novel in the task of LSM production. The accuracy of the produced LSMs was calculated with the area under the receiver operating characteristic curve (AUROC), and an automatic hyperparameter tuning and result comparison system based on AUROC scores was utilized. The calculated AUROC scores of the resulting LSMs were 0.952 for the RF method, 0.9247 for the ANN method, 0.9016 for the LR method, and 0.8424 for the FR. It is also noteworthy that the ML methods are substantially swifter and more practical than the FR method and allow for multiple and automatic experimentations with different hyperparameter settings, providing fine and accurate outcomes with the given data. The results evidence that ML techniques are more efficient when dealing with hazard assessment problems such as the one exemplified in this study. Although the conclusion that the RF method is the most accurate for LSM production as found by other authors in the literature, ML method efficiency may vary depending on the specific study area, and thus the use of an automatic multi-method LSM production system with hyperparameter tuning such as the one utilized in this study is advised. It was also found that XRAIN radar-acquired mean annual precipitation data are effective when used as an LCF in LSM production.

DeepAFT: A nonlinear accelerated failure time model with artificial neural network.

The Cox regression model or accelerated failure time regression models are often used for describing the relationship between survival outcomes and potential explanatory variables. These models assume the studied covariates are connected to the survival time or its distribution or their transformations through a function of a linear regression form. In this article, we propose nonparametric, nonlinear algorithms (deepAFT methods) based on deep artificial neural networks to model survival outcome data in the broad distribution family of accelerated failure time models. The proposed methods predict survival outcomes directly and tackle the problem of censoring via an imputation algorithm as well as re-weighting and transformation techniques based on the inverse probabilities of censoring. Through extensive simulation studies, we confirm that the proposed deepAFT methods achieve accurate predictions. They outperform the existing regression models in prediction accuracy, while being flexible and robust in modeling covariate effects of various nonlinear forms. Their prediction performance is comparable to other established deep learning methods such as deepSurv and random survival forest methods. Even though the direct output is the expected survival time, the proposed AFT methods also provide predictions for distributional functions such as the cumulative hazard and survival functions without additional learning efforts. For situations where the popular Cox regression model may not be appropriate, the deepAFT methods provide useful and effective alternatives, as shown in simulations, and demonstrated in applications to a lymphoma clinical trial study.

Treatment plan complexity quantification for predicting gamma passing rates in patient-specific quality assurance for stereotactic volumetric modulated arc therapy.

To investigate the beam complexity of stereotactic Volumetric Modulated Arc Therapy (VMAT) plans quantitively and predict gamma passing rates (GPRs) using machine learning. The entire dataset is exclusively made of stereotactic VMAT plans (301 plans with 594 beams) from Varian Edge LINAC. The GPRs were analyzed using Varian's portal dosimetry with 2%/2mm criteria. A total of 27 metrics were calculated to investigate the correlation between metrics and GPRs. Random forest and gradient boosting models were developed and trained to predict the GPRs based on the extracted complexity features. The threshold values of complexity metric were obtained to predict a given beam to pass or fail from ROC curve analysis. The three moderately significant values of Spearman's rank correlation to GPRs were 0.508 (p < 0.001), 0.445 (p < 0.001), and -0.416 (p < 0.001) for proposed metric LAAM, the ratio of the average aperture area over jaw area (AAJA) and index of modulation, respectively. The random forest method achieved 98.74% prediction accuracy with mean absolute error of 1.23% using five-fold cross-validation, and 98.71% with 1.25% for gradient boosting regressor method, respectively. LAAM, leaf travelling distance (LT), AAJA, LT modulation complexity score (LTMCS) and index of modulation, were the top five most important complexity features. The LAAM metric showed the best performance with AUC value of 0.801, and threshold value of 0.365. The calculated metrics were effective in quantifying the complexity of stereotactic VMAT plans. We have demonstrated that the GPRs could be accurately predicted using machine learning methods based on extracted complexity metrics. The quantification of complexity and machine learning methods have the potential to improve stereotactic treatment planning and identify the failure of QA results promptly.

Targeted genotyping-by-sequencing of potato and data analysis with R/polyBreedR.

Mid-density targeted genotyping-by-sequencing (GBS) combines trait-specific markers with thousands of genomic markers at an attractive price for linkage mapping and genomic selection. A 2.5K targeted GBS assay for potato (Solanum tuberosum L.) was developed using the DArTag technology and later expanded to 4K targets. Genomic markers were selected from the potato Infinium single nucleotide polymorphism (SNP) array to maximize genome coverage and polymorphism rates. The DArTag and SNP array platforms produced equivalent dendrograms in a test set of 298 tetraploid samples, and 83% of the common markers showed good quantitative agreement, with RMSE (root mean squared error) <0.5. DArTag is suited for genomic selection candidates in the clonal evaluation trial, coupled with imputation to a higher density platform for the training population. Using the software polyBreedR, an R package for the manipulation and analysis of polyploid marker data, the RMSE for imputation by linkage analysis was 0.15 in a small half-diallel population (N=85), which was significantly lower than the RMSE of 0.42 with the random forest method. Regarding high-value traits, the DArTag markers for resistance to potato virus Y, golden cyst nematode, and potato wart appeared to track their targets successfully, as did multi-allelic markers for maturity and tuber shape. In summary, the potato DArTag assay is a transformative and publicly available technology for potato breeding and genetics.

Spatio-Temporal Dynamics Coupling between Land Use/Cover Change and Water Quality in Dongjiang Lake Watershed Using Satellite Remote Sensing

With rapid social and economic development, land use/land cover change (LUCC) has intensified with serious impacts on water quality in the watershed. In this study, we took Dongjiang Lake watershed as the study area and obtained measured data on water quality parameters from the watershed’s water quality monitoring stations. Based on Landsat-5, Landsat-8, or Sentinel-2 remote sensing data for multiple periods per year between 1992 and 2022, the sensitive satellite bands or band combinations of each water quality parameter were determined. The Random Forest method was used to classify the land use types in the watershed into six categories, and the area proportion of each type was calculated. We established machine learning regression models and polynomial regression models with WQI as the dependent variable and the area proportion of each land use type as the independent variable. Accuracy test results showed that, among them, the quadratic cubic polynomial regression model with grassland, forest land, construction land, and unused land as its independent variables was the best model for coupling watershed water quality with LUCC. This study’s results provide a scientific basis for monitoring spatial and temporal changes in water quality caused by LUCC in the Dongjiang Lake watershed.

Landslide susceptibility assessment and mapping using new ensemble model

Landslides pose significant impact on human life and society such as loss of livelihood, destruction of infrastructure, and damage to natural resources around the world. Due to existing complications in conditional factors of landslide, mapping and predicting landslide occurrences with high accuracy needs more attention. In light of this, we aim to develop an ensemble landslide susceptibility model named as support vector regression–grasshopper optimization algorithm (SVR–GOA). This model is validated along with other landslide susceptibility models such as artificial neural network (ANN), boosted regression tree (BRT), and elastic net models. The present study carried out over the Kalaleh Basin in Iran, in which we selected 140 landslides with 16 conditional factors to construct a geographic database of the region. The multicollinearity analysis was done on the hazard conditioning factors using variance inflation factor and tolerance indices. Similarly, significance of these factors and their association with selected locations were identified through random forest method. The state of the art of the study is implementing SVR-GOA in landslide susceptibility mapping, including this model we use other landslide models such as ANN, BRT, and elastic net for validation and development using the area under the curve (AUC), kappa, and root mean squared error values. Our results show lithology, slope degree, rainfall, topography position index, topography wetness index, surface area, and landuse/landcover were found to be the most influential conditioning factors. We have also observed that, despite accurate prediction, SVR-GOA outperforms the others by showing the highest AUC values around AUC = 0.930 and others show ANN (AUC = 0.833), BRT (AUC = 0.822) and elastic net (AUC = 0.726) respectively. This innovative approach to landslide mapping using SVR-GOA ensembles would enhance the advancement of landslide research at multiple scales.

Comparison of Chi-Square Automatic Interaction Detector (CHAID) and Random Forest Methods in the Classification of Household Poverty Status in Central Java

Central Java was in second position as the province with the highest number of poor people in Indonesia in March 2020. Poverty alleviation efforts have been carried out, but many are still not yet on target. The purpose of this study was to model the classification of household poverty status in Central Java using CHAID and random forest methods and compare the two methods. The data used in this study is data from the 2020 National Socioeconomic Survey (SUSENAS) conducted by the Central Bureau of Statistics (BPS) for Central Java. The number of poor households is much less than non-poor households. Therefore, Synthetic Minority Oversampling Technique (SMOTE) was performed to handle unbalanced data. The random forest method produced better classification performance than the CHAID method with accuracy, sensitivity, specificity, and AUC of 93,95%, 98,43%, 89,92%, and 0,9417, respectively. The important variables that build the random forest model are the floor area of the house, the age of the head of the household, cooking fuel, the place for the final disposal of feces, and ownership of the place to defecate.