Gradient Boosting Decision Tree Method Research Articles

Exploring the dynamic impacts of COVID-19 on intercity travel in China

Many studies have explored the effects of transportation and population movement on the spread of pandemics. However, little attention has been paid to the dynamic impact of pandemics on intercity travel and its recovery during a public health event period. Using intercity mobility and COVID-19 pandemic data, this study adopts the gradient boosting decision tree method to explore the dynamic effects of the COVID-19 on intercity travel in China. The influencing factors were classified into daily time-varying factors and time-invariant factors. The results show that China's intercity travel decreased on average by 51.35% from Jan 26 to Apr 7, 2020. Furtherly, the COVID-19 pandemic reduces intercity travel directly and indirectly by influencing industry development and transport connectivity. With the spread of COVID-19 and changes of control measures, the relationship between intercity travel and COVID-19, socio-economic development, transport is not linear. The relationship between intercity travel and secondary industry is illustrated by an inverted U-shaped curve from pre-pandemic to post-pandemic, whereas that with tertiary industry can be explained by a U-shaped curve. Meanwhile, this study highlights the dynamic effect of the COVID-19 on intercity mobility. These implications shed light on policies regarding the control measures during public health events that should include the dynamic impact of pandemics on intercity travel.

Estimation of Gourami Supplies Using Gradient Boosting Decision Tree Method of XGBoost

The need for food supplies are very crucial in a food business, therefore it is necessary to estimate the right supplies to maximize profit. One of the methods to determine these is by looking for patterns and forecasting transaction data. The purpose of this research is to estimate the gourami supplies using transaction data to forecast using the gradient boosting decision tree method from XGBoost. The transaction data used comes from Restaurant X with a time period from 2016 to 2019. A measurement error rate of the model is achieved by using MAE (Mean Absolute Error) and MAPE (Mean Absolute Percentage Error). This study tried five XGBoost models with different features such as lag, rolling window, mean encoding, and mix. The results of this study indicate that the mixed feature model produces an accuracy of 97.54% with an MAE of 0.63 and a MAPE of 2.64%.

The LEukemia Artificial Intelligence Program (LEAP) in chronic myeloid leukemia in chronic phase: A model to improve patient outcomes.

Extreme gradient boosting methods outperform conventional machine-learning models. Here, we have developed the LEukemia Artificial intelligence Program (LEAP) with the extreme gradient boosting decision tree method for the optimal treatment recommendation of tyrosine kinase inhibitors (TKIs) in patients with chronic myeloid leukemia in chronic phase (CML-CP). A cohort of CML-CP patients was randomly divided into training/validation (N = 504) and test cohorts (N = 126). The training/validation cohort was used for 3-fold cross validation to develop the LEAP CML-CP model using 101 variables at diagnosis. The test cohort was then applied to the LEAP CML-CP model and an optimum TKI treatment was suggested for each patient. The area under the curve in the test cohort was 0.81899.Backward multivariate analysis identified age at diagnosis, the degree of comorbidities, and TKI recommended therapy by the LEAP CML-CP model as independent prognostic factors for overall survival. The bootstrapping method internally validated the association of the LEAP CML-CP recommendation with overall survival as an independent prognostic for overall survival. Selecting treatment according to the LEAP CML-CP personalized recommendations, in this model, is associated with better survival probability compared to treatment with a LEAP CML-CP non-recommended therapy. This approach may pave a way of new era of personalized treatment recommendations for patients with cancer.

A Novel Data-Driven Method to Estimate Methane Adsorption Isotherm on Coals Using the Gradient Boosting Decision Tree: A Case Study in the Qinshui Basin, China

The accurate determination of methane adsorption isotherms in coals is crucial for both the evaluation of underground coalbed methane (CBM) reserves and design of development strategies for enhancing CBM recovery. However, the experimental measurement of high-pressure methane adsorption isotherms is extremely tedious and time-consuming. This paper proposed the use of an ensemble machine learning (ML) method, namely the gradient boosting decision tree (GBDT), in order to accurately estimate methane adsorption isotherms based on coal properties in the Qinshui basin, China. The GBDT method was trained to correlate the adsorption amount with coal properties (ash, fixed carbon, moisture, vitrinite, and vitrinite reflectance) and experimental conditions (pressure, equilibrium moisture, and temperature). The results show that the estimated adsorption amounts agree well with the experimental ones, which prove the accuracy and robustness of the GBDT method. A comparison of the GBDT with two commonly used ML methods, namely the artificial neural network (ANN) and support vector machine (SVM), confirms the superiority of GBDT in terms of generalization capability and robustness. Furthermore, relative importance scanning and univariate analysis based on the constructed GBDT model were conducted, which showed that the fixed carbon and ash contents are primary factors that significantly affect the adsorption isotherms for the coal samples in this study.

Fish meal freshness detection by GBDT based on a portable electronic nose system and HS-SPME–GC–MS

The volatile compounds of super fresh, superior fresh, general fresh, corrupt and completely corrupt fish meal were studied by headspace solid-phase microextraction–gas chromatography–mass spectrometry. Principal component analysis was used to analyze the sensor and gas chromatography-mass spectrometry data, so as to study the resolution of sensor array. A total of 198 fish meal samples with different freshness were classified by the gradient boosting decision tree method, yielding a model between the sensor array data and the freshness index, such as the acid value and the volatile base nitrogen value. The gradient boosting decision tree model shows that the correlation between the predicted acid value by electronic nose and the measured acid value is 0.90 and the correlation between the predicted volatile base nitrogen value and the measured volatile base nitrogen is 0.97. The combination of an electronic nose and a pattern recognition method based on a gas sensor can predict the acid value and volatile base nitrogen of the freshness index and can detect the freshness of fish meal.

Mapping landslide susceptibility at the Three Gorges Reservoir, China, using gradient boosting decision tree, random forest and information value models

This work was to generate landslide susceptibility maps for the Three Gorges Reservoir (TGR) area, China by using different machine learning models. Three advanced machine learning methods, namely, gradient boosting decision tree (GBDT), random forest (RF) and information value (InV) models, were used, and the performances were assessed and compared. In total, 202 landslides were mapped by using a series of field surveys, aerial photographs, and reviews of historical and bibliographical data. Nine causative factors were then considered in landslide susceptibility map generation by using the GBDT, RF and InV models. All of the maps of the causative factors were resampled to a resolution of 28.5 m. Of the 486289 pixels in the area, 28526 pixels were landslide pixels, and 457763 pixels were non-landslide pixels. Finally, landslide susceptibility maps were generated by using the three machine learning models, and their performances were assessed through receiver operating characteristic (ROC) curves, the sensitivity, specificity, overall accuracy (OA), and kappa coefficient (KAPPA). The results showed that the GBDT, RF and InV models in overall produced reasonable accurate landslide susceptibility maps. Among these three methods, the GBDT method outperforms the other two machine learning methods, which can provide strong technical support for producing landslide susceptibility maps in TGR.

Detecting self-paced walking intention based on fNIRS technology for the development of BCI.

Since more and more elderly people suffer from lower extremity movement problems, it is of great social significance to assist persons with motor dysfunction to walk independently again and reduce the burden on caregivers. The self-paced walking intention, which could increase the ability of self-control on the start and stop of motion, was studied by applying brain-computer interface (BCI) technology, a novel research field. The cerebral hemoglobin signal, which was obtained from 30 subjects by applying functional near-infrared spectroscopy (fNIRS) technology, was processed to detect self-paced walking intention in this paper. Teager-Kaiser energy was extracted at each sampling point for five sub-bands (0.0095~0.021Hz, 0.021~0.052Hz, 0.052~0.145Hz, 0.145~0.6Hz, and 0.6~2.0Hz). Gradient boosting decision tree (GBDT) was then utilized to establish the detecting model in real-time. The proposed method had a good performance to detect the walking intention and passed the pseudo-online test with a true positive rate of 100% (80/80), a false positive rate of 2.91% (4822/165171), and a detection latency of 0.39 ± 1.06s. GBDT method had an area under the curve value of 0.944 and was 0.125 (p < 0.001) higher than linear discriminant analysis (LDA). The results reflected that it is feasible to decode self-paced walking intention by applying fNIRS technology. This study lays a foundation for applying fNIRS-based BCI technology to control walking assistive devices practically. Graphical abstract Graphical representation of the detecting process for pseudo-online test. The lower figure is a partial enlargement of the upper figure. In the lower figure, the blue line represents the probability of walking predicted by GBDT without smoothing and the orange-red line represents the smoothed probability. The dark-red ellipse shows the effect of the smoothing-threshold method.

Determination of Corrosion Types from Electrochemical Noise by Gradient Boosting Decision Tree Method

Determination of Corrosion Types from Electrochemical Noise by Gradient Boosting Decision Tree Method

Landslide Susceptibility Mapping Based on Weighted Gradient Boosting Decision Tree in Wanzhou Section of the Three Gorges Reservoir Area (China)

The main goal of this study is to produce a landslide susceptibility map in the Wanzhou section of the Three Gorges reservoir area (China) with a weighted gradient boosting decision tree (weighted GBDT) model. According to the current research on landslide susceptibility mapping (LSM), the GBDT method is rarely used in LSM. Furthermore, previous studies have rarely considered the imbalance of landslide samples and simply regarded the LSM problem as a binary classification problem. In this paper, we considered LSM as an imbalanced learning problem and obtained a better predictive model using the weighted GBDT method. The innovations of the article mainly include the following two points: introducing the GBDT model into the evaluation of landslide susceptibility; using the weighted GBDT method to deal with the problem of landslide sample imbalance. The logistic regression (LR) model and gradient boosting decision tree (GBDT) model were also used in the study to compare with the weighted GBDT model. Five kinds of data from different data source were used in the study: geology, topography, hydrology, land cover, and triggered factors (rainfall, earthquake, land use, etc.). Twenty nine environmental parameters and 233 landslides were used as input data. The receiver operating characteristic (ROC) curve, the area under the ROC curve (AUC) value, and the recall value were used to estimate the quality of the weighted GBDT model, the GBDT model, and the LR model. The results showed that the GBDT model and the weighted GBDT model had a higher AUC value (0.977, 0.976) than the LR model (0.845); the weighted GBDT model had a little higher AUC value (0.977) than the GBDT model (0.976); and the weighted GBDT model had a higher recall value (0.823) than the GBDT model (0.426) and the LR model (0.004). The weighted GBDT method could be considered to have the best performance considering the AUC value and the recall value in landslide susceptibility mapping dealing with imbalanced landslide data.

Estimating Surface Downward Shortwave Radiation over China Based on the Gradient Boosting Decision Tree Method

Downward shortwave radiation (DSR) is an essential parameter in the terrestrial radiation budget and a necessary input for models of land-surface processes. Although several radiation products using satellite observations have been released, coarse spatial resolution and low accuracy limited their application. It is important to develop robust and accurate retrieval methods with higher spatial resolution. Machine learning methods may be powerful candidates for estimating the DSR from remotely sensed data because of their ability to perform adaptive, nonlinear data fitting. In this study, the gradient boosting regression tree (GBRT) was employed to retrieve DSR measurements with the ground observation data in China collected from the China Meteorological Administration (CMA) Meteorological Information Center and the satellite observations from the Advanced Very High Resolution Radiometer (AVHRR) at a spatial resolution of 5 km. The validation results of the DSR estimates based on the GBRT method in China at a daily time scale for clear sky conditions show an R2 value of 0.82 and a root mean square error (RMSE) value of 27.71 W·m−2 (38.38%). These values are 0.64 and 42.97 W·m−2 (34.57%), respectively, for cloudy sky conditions. The monthly DSR estimates were also evaluated using ground measurements. The monthly DSR estimates have an overall R2 value of 0.92 and an RMSE of 15.40 W·m−2 (12.93%). Comparison of the DSR estimates with the reanalyzed and retrieved DSR measurements from satellite observations showed that the estimated DSR is reasonably accurate but has a higher spatial resolution. Moreover, the proposed GBRT method has good scalability and is easy to apply to other parameter inversion problems by changing the parameters and training data.