Boruta Feature Selection Research Articles

Feature-weighted Random Forest with Boruta for Fault Diagnosis of Satellite Attitude Control Systems

The performance of random forest (RF) based satellite attitude control system (ACS) fault diagnosis methods is limited by uninformative features in high-dimensional data. To solve this problem, we proposed a feature-weighted random forest with Boruta (FWRFB) based fault diagnosis method is proposed for fault diagnosis of ACSs. Firstly, a Boruta feature selection algorithm is used to obtain a feature set and determine significant feature weights. Subsequently, a novel feature-weighted random forest (FWRF) algorithm is designed, which utilizes feature-weighted random sampling instead of simple random sampling to generate feature subsets in the RF. The FWRFB effectively utilizes the feature information while mitigating noise interference. Finally, a FWRFB-based diagnostic module is developed for online fault diagnosis of ACSs. The effectiveness of the proposed method is verified by the ACS data from a semi-physical simulation platform.

A three-phase framework for mapping barriers to blockchain adoption in sustainable supply chain

PurposeBlockchain technology is one of the major contributors to supply chain sustainability because of its inherent features. However, its adoption rate is relatively low due to reasons such as the diverse barriers impeding blockchain adoption. The purpose of this study is to identify blockchain adoption barriers in sustainable supply chain and uncovers their interrelationships.Design/methodology/approachA three-phase framework that combines machine learning (ML) classifiers, BORUTA feature selection algorithm, and Grey-DEMATEL method. From the literature review, 26 potential barriers were identified and evaluated through the performance of ML models with accuracy and f-score.FindingsThe findings reveal that feature selection algorithm detected 15 prominent barriers, and random forest (RF) classifier performed with the highest accuracy and f-score. Moreover, the performance of the RF increased by 2.38% accuracy and 2.19% f-score after removing irrelevant barriers, confirming the validity of feature selection algorithm. An RF classifier ranked the prominent barriers and according to ranking, financial constraints, immaturity, security, knowledge and expertise, and cultural differences resided at the top of the list. Furthermore, a Grey-DEMATEL method is employed to expose interrelationships between prominent barriers and to provide an overview of the cause-and-effect group.Practical implicationsThe outcome of this study can help industry practitioners develop new strategies and plans for blockchain adoption in sustainable supply chains.Originality/valueThe research on the adoption of blockchain technology in sustainable supply chains is still evolving. This study contributes to the ongoing debate by exploring how practitioners and decision-makers adopt blockchain technology, developing strategies and plans in the process.

A robust multi-model framework for groundwater level prediction: The BFSA-MVMD-GRU-RVM model

Groundwater level prediction is critical for environmental protection and agricultural planning. Accurate predictions help manage risks associated with excessive groundwater extraction and land subsidence. This study introduces a novel model combining multivariate variational mode decomposition (MVMD), gated recurrent unit (GRU), and relevance vector machine (RVM), along with the Boruta feature selection algorithm (BFSA), for precise groundwater level forecasting. The model operates in several stages. First, BFSA selects the most informative features as input data. Next, the MVMD method decomposes the time series of these features. The GRU model then extracts crucial information from these decompositions. Finally, the extracted data is fed into the RVM model to predict groundwater levels one month ahead in Iran's Bastam Plain. To assess the model's accuracy, multiple error indices were employed. The MVMD-GRU-RVM model outperformed other models, improving the testing Nash–Sutcliffe Efficiency and mean absolute error by 24–31 % and 6–61 %, respectively. Additionally, it enhanced R2 values of the MVMD-CNN, MVMD-RNN, MVMD-MLP, and MVMD-RBFNN models by 1.0–3.33 %. These results demonstrate that the MVMD-GRU-RVM model significantly improves groundwater level prediction accuracy. The key points of the paper are the successful effectiveness of MVMD in processing non-stationary time series and improving the predictive performance of the models, as well as the high ability of the GRU model in data feature extraction. The study also shows that the novel model can provide outputs with lower uncertainty.

Machine learning-derived peripheral blood transcriptomic biomarkers for early lung cancer diagnosis: Unveiling tumor-immune interaction mechanisms.

Lung cancer continues to be the leading cause of cancer-related mortality worldwide. Early detection and a comprehensive understanding of tumor-immune interactions are crucial for improving patient outcomes. This study aimed to develop a novel biomarker panel utilizing peripheral blood transcriptomics and machine learning algorithms for early lung cancer diagnosis, while simultaneously providing insights into tumor-immune crosstalk mechanisms. Leveraging a training cohort (GSE135304), we employed multiple machine learning algorithms to formulate a Lung Cancer Diagnostic Score (LCDS) based on peripheral blood transcriptomic features. The LCDS model's performance was evaluated using the area under the receiver operating characteristic (ROC) curve (AUC) in multiple validation cohorts (GSE42834, GSE157086, and an in-house dataset). Peripheral blood samples were obtained from 20 lung cancer patients and 10 healthy control subjects, representing an in-house cohort recruited at the Sixth People's Hospital of Chengdu. We employed advanced bioinformatics techniques to explore tumor-immune interactions through comprehensive immune infiltration and pathway enrichment analyses. Initial screening identified 844 differentially expressed genes, which were subsequently refined to 87 genes using the Boruta feature selection algorithm. The random forest (RF) algorithm demonstrated the highest accuracy in constructing the LCDS model, yielding a mean AUC of 0.938. Lower LCDS values were significantly associated with elevated immune scores and increased CD4+ and CD8+ T-cell infiltration, indicative of enhanced antitumor-immune responses. Higher LCDS scores correlated with activation of hypoxia, peroxisome proliferator-activated receptor (PPAR), and Toll-like receptor (TLR) signaling pathways, as well as reduced DNA damage repair pathway scores. Our study presents a novel, machine learning-derived peripheral blood transcriptomic biomarker panel with potential applications in early lung cancer diagnosis. The LCDS model not only demonstrates high accuracy in distinguishing lung cancer patients from healthy individuals but also offers valuable insights into tumor-immune interactions and underlying cancer biology. This approach may facilitate early lung cancer detection and contribute to a deeper understanding of the molecular and cellular mechanisms underlying tumor-immune crosstalk. Furthermore, our findings on the relationship between LCDS and immune infiltration patterns may have implications for future research on therapeutic strategies targeting the immune system in lung cancer.

Feature selection with annealing for forecasting financial time series

Stock market and cryptocurrency forecasting is very important to investors as they aspire to achieve even the slightest improvement to their buy-or-hold strategies so that they may increase profitability. However, obtaining accurate and reliable predictions is challenging, noting that accuracy does not equate to reliability, especially when financial time-series forecasting is applied owing to its complex and chaotic tendencies. To mitigate this complexity, this study provides a comprehensive method for forecasting financial time series based on tactical input–output feature mapping techniques using machine learning (ML) models. During the prediction process, selecting the relevant indicators is vital to obtaining the desired results. In the financial field, limited attention has been paid to this problem with ML solutions. We investigate the use of feature selection with annealing (FSA) for the first time in this field, and we apply the least absolute shrinkage and selection operator (Lasso) method to select the features from more than 1000 candidates obtained from 26 technical classifiers with different periods and lags. Boruta (BOR) feature selection, a wrapper method, is used as a baseline for comparison. Logistic regression (LR), extreme gradient boosting (XGBoost), and long short-term memory are then applied to the selected features for forecasting purposes using 10 different financial datasets containing cryptocurrencies and stocks. The dependent variables consisted of daily logarithmic returns and trends. The mean-squared error for regression, area under the receiver operating characteristic curve, and classification accuracy were used to evaluate model performance, and the statistical significance of the forecasting results was tested using paired t-tests. Experiments indicate that the FSA algorithm increased the performance of ML models, regardless of problem type. The FSA hybrid models showed better performance and outperformed the other BOR models on seven of the 10 datasets for regression and classification. FSA-based models also outperformed Lasso-based models on six of the 10 datasets for regression and four of the 10 datasets for classification. None of the hybrid BOR models outperformed the hybrid FSA models. Lasso-based models, excluding the LR type, were comparable to the best models for six of the 10 datasets for classification. Detailed experimental analysis indicates that the proposed methodology can forecast returns and their movements efficiently and accurately, providing the field with a useful tool for investors.

Trap colour strongly affects the ability of deep learning models to recognize insect species in images of sticky traps.

The use of computer vision and deep learning models to automatically classify insect species on sticky traps has proven to be a cost- and time-efficient approach to pest monitoring. As different species are attracted to different colours, the variety of sticky trap colours poses a challenge to the performance of the models. However, the effectiveness of deep learning in classifying pests on different coloured sticky traps has not yet been sufficiently explored. In this study, we aim to investigate the influence of sticky trap colour and imaging devices on the performance of deep learning models in classifying pests on sticky traps. Our results show that using the MobileNetV2 architecture with transparent sticky traps as training data, the model predicted the pest species on transparent sticky traps with an accuracy of at least 0.95 and on other sticky trap colours with at least 0.85 of the F1 score. Using a generalised linear model (GLM) and a Boruta feature selection algorithm, we also showed that the colour and architecture of the sticky traps significantly influenced the performance of the model. Our results support the development of an automatic classification of pests on a sticky trap, which should focus on colour and deep learning architecture to achieve good results. Future studies could aim to incorporate the trap system into pest monitoring, providing more accurate and cost-effective results in a pest management programme. © 2024 The Author(s). Pest Management Science published by John Wiley & Sons Ltd on behalf of Society of Chemical Industry.

Multimodal data-driven, vertical visualization prediction model for early prediction of atherosclerotic cardiovascular disease in patients with new-onset hypertension.

: Hypertension is an important contributing factor to atherosclerotic cardiovascular disease (ASCVD), and multiple risk factors, many of which are implicated in metabolic disorders, contribute to the cause of hypertension. Despite the promise of multimodal data-driven prediction model, no such prediction model was available to predict the risk of ASCVD in Chinese individuals with new-onset hypertension and no history of ASCVD. : A total of 514 patients were randomly allocated to training and verification cohorts (ratio, 7 : 3). We employed Boruta feature selection and conducted multivariate Cox regression analyses to identify variables associated with ASCVD in these patients, which were subsequently utilized for constructing the predictive model. The performance of prediction model was assessed in terms of discriminatory power (C-index), calibration (calibration curves), and clinical utility [decision curve analysis (DCA)]. : This model was derived from four clinical variables: 24-h SBP coefficient of variation, 24-h DBP coefficient of variation, urea nitrogen and the triglyceride-glucose (TyG) index. Bootstrapping with 500 iterations was conducted to adjust the C-indexes were C-index = 0.731, 95% confidence interval (CI) 0.620-0.794 and C-index: 0.799, 95% CI 0.677-0.892 in the training and verification cohorts, respectively. Calibration plots with 500 bootstrapping iterations exhibited a strong correlation between the predicted and observed occurrences of ASCVD in both the training and verification cohorts. DCA analysis confirmed the clinical utility of this prediction model. The constructed nomogram demonstrated significant additional prognostic utility for ASCVD, as evidenced by improvements in the C-index, net reclassification improvement, integrated discrimination improvement, and DCA compared with the overall ASCVD risk assessment. The developed longitudinal prediction model based on multimodal data can effectively predict ASCVD risk in individuals with an initial diagnosis of hypertension. : The trial was registered in the Chinese Clinical Trial Registry (ChiCTR2300074392).

Sentinel-2 Multispectral Satellite Remote Sensing Retrieval of Soil Cu Content Changes at Different pH Levels

With the development of multispectral imaging technology, retrieving soil heavy metal content using multispectral remote sensing images has become possible. However, factors such as soil pH and spectral resolution affect the accuracy of model inversion, leading to low precision. In this study, 242 soil samples were collected from a typical area of the Pearl River Delta, and the Cu content in the soil was detected in the laboratory. Simultaneously, Sentinel-2 remote sensing image data were collected, and two-dimensional and three-dimensional spectral indices were established. Constructing independent decision trees based on pH values, using the Successive Projections Algorithm (SPA) combined with the Boruta algorithm to select the characteristic bands for soil Cu content, and this was combined with Optuna automatic hyperparameter optimization for ensemble learning models to establish a model for estimating Cu content in soil. The research results indicated that in the SPA combined with the Boruta feature selection algorithm, the characteristic spectral indices were mainly concentrated in the spectral transformation forms of TBI2 and TBI4. Full-sample modeling lacked predictive ability, but after classifying the samples based on soil pH value, the R2 of the RF and XGBoost models constructed with the samples with pH values between 5.85 and 7.75 was 0.54 and 0.76, respectively, with corresponding RMSE values of 22.48 and 16.12 and RPD values of 1.51 and 2.11. This study shows that the inversion of soil Cu content under different pH conditions exhibits significant differences, and determining the optimal pH range can effectively improve inversion accuracy. This research provides a reference for further achieving the efficient and accurate remote sensing of heavy metal pollution in agricultural soil.

Optimized ensemble deep random vector functional link with nature inspired algorithm and boruta feature selection: Multi-site intelligent model for air quality index forecasting

Air quality index (AQI) forecasting is complex due to its variability, instability, and inconsistent trends resulting from dynamic atmospheric conditions, various contaminants, and interactions between environmental factors. Advanced modeling techniques are needed to accurately forecast AQI values to capture subtle patterns and variations in air quality data. Thus, a new forecasting model is suggested in this study to improve the accuracy of AQI forecasting. The model integrates three-phase decomposition technique, a feature selection approach, and ensemble Deep Random Vector Functional Link (EDRVFL), optimized using adaptive teaching-learning-based optimization and differential evolution (ATLDE). The AQI series was first broken down into a group of intrinsic mode functions (IMFs) with different frequencies using multivariate variational mode decomposition (MVMD). Subsequently, a feature selection method based on the Boruta technique was applied to identify the most significant input variables. Finally, for daily AQI levels forecasting, ATLDE optimized the EDRVFL model (EDRVFL-ATLDE). Three daily AQI series gathered from Chengdu, Wuhan, and Taiyuan in China from January 1, 2018, to December 30, 2022, were used to test and confirm the proposed model via empirical research. Based on the results, the proposed model can yield the superior results for three cities (Chengdu: correlation coefficient (R = 0.987), root mean square error (RMSE = 5.583), Wuhan: (R = 0.987), (RMSE = 3.299), and Taiyuan: (R = 0.996), (RMSE = 4.521)) in China. The experimental findings demonstrated the feasibility of the three-phase hybrid methodology, outperforming all other models regarding forecast accuracy.

Tumor classification algorithm via parallel collaborative optimization of single- and multi-objective consistency on PET/CT

Malignant tumors still have a high incidence and mortality rate worldwide. Pathological examination remains the clinical gold standard for tumor diagnosis. However, some patients cannot undergo pathological examination due to advanced age and special lesion location. Therefore, making full use of PET/CT to assist doctors in tumor classification has important clinical significance. Since category labels are calibrated according to pathological images, it is difficult to obtain effective pathological category features directly using PET-CT image modeling. In response to this problem, this paper proposes a novel tumor classification algorithm. This method fully utilizes multi-gray-level 3D gray-level co-occurrence matrix and the proposed rough and fine constraint network under the constraint loss of rough and fine labels. Based on single- and multi-objective consistency, a parallel collaborative optimization method is proposed, including category consistency loss and feature specificity loss. To reduce the interference of redundant features, an improved Boruta feature selection method using multiple classifiers and multiple steps is proposed. The final result is obtained through a conditional weighted voting function. The proposed method shows excellent performance in both the submodels and the fusion model. We validated the proposed tumor classification method on three datasets and achieved good performance with the accuracy of 0.80–0.85 and F1-score of 0.78–0.88. The results indicate that the proposed method has good performance and generalization ability.

Knowledge-slanted random forest method for high-dimensional data and small sample size with a feature selection application for gene expression data

The use of prior knowledge in the machine learning framework has been considered a potential tool to handle the curse of dimensionality in genetic and genomics data. Although random forest (RF) represents a flexible non-parametric approach with several advantages, it can provide poor accuracy in high-dimensional settings, mainly in scenarios with small sample sizes. We propose a knowledge-slanted RF that integrates biological networks as prior knowledge into the model to improve its performance and explainability, exemplifying its use for selecting and identifying relevant genes. knowledge-slanted RF is a combination of two stages. First, prior knowledge represented by graphs is translated by running a random walk with restart algorithm to determine the relevance of each gene based on its connection and localization on a protein-protein interaction network. Then, each relevance is used to modify the selection probability to draw a gene as a candidate split-feature in the conventional RF. Experiments in simulated datasets with very small sample sizes (n≤30)\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$(n \\le 30)$$\\end{document} comparing knowledge-slanted RF against conventional RF and logistic lasso regression, suggest an improved precision in outcome prediction compared to the other methods. The knowledge-slanted RF was completed with the introduction of a modified version of the Boruta feature selection algorithm. Finally, knowledge-slanted RF identified more relevant biological genes, offering a higher level of explainability for users than conventional RF. These findings were corroborated in one real case to identify relevant genes to calcific aortic valve stenosis.

Ultrasound based radiomics model for assessment of placental function in pregnancies with preeclampsia

The goal of our research is to elucidate and better assess placental function in rats with preeclampsia through an innovative application of ultrasound-based radiomics. Using a rat model induced with L-NAME, we carefully investigated placental dysfunction via microstructural analysis and immunoprotein level assessment. Employing the Boruta feature selection method on ultrasound images facilitated the identification of crucial features, consequently enabling the development of a robust model for classifying placental dysfunction. Our study included 12 pregnant rats, and thorough placental evaluations were conducted on 160 fetal rats. Distinct alterations in placental microstructure and angiogenic factor expression were evident in rats with preeclampsia. Leveraging high-throughput mining of quantitative image features, we extracted 558 radiomic features, which were subsequently used to construct an impressive evaluation model with an area under the receiver operating curve (AUC) of 0.95. This model also exhibited a remarkable sensitivity, specificity, accuracy, positive predictive value, and negative predictive value of 88.7%, 91.5%, 90.2%, 90.4%, and 90.0%, respectively. Our findings highlight the ability of ultrasound-based radiomics to detect abnormal placental features, demonstrating its potential for evaluating both normative and impaired placental function with high precision and reliability.

Development and validation of nomograms for predicting cardiovascular disease risk in patients with prediabetes and diabetes

This study aimed to develop and validate distinct nomogram models for assessing CVD risk in individuals with prediabetes and diabetes. In a cross-sectional study design, we examined data from 2294 prediabetes and 1037 diabetics who participated in the National Health and Nutrition Examination Survey, which was conducted in the United States of America between 2007 and 2018. The dataset was randomly divided into training and validation cohorts at a ratio of 0.75–0.25. The Boruta feature selection method was used in the training cohort to identify optimal predictors for CVD diagnosis. A web-based dynamic nomogram was developed using the selected features, which were validated in the validation cohort. The Hosmer–Lemeshow test was performed to assess the nomogram's stability and performance. Receiver operating characteristics and calibration curves were used to assess the effectiveness of the nomogram. The clinical applicability of the nomogram was evaluated using decision curve analysis and clinical impact curves. In the prediabetes cohort, the CVD risk prediction nomogram included nine risk factors: age, smoking status, platelet/lymphocyte ratio, platelet count, white blood cell count, red cell distribution width, lactate dehydrogenase level, sleep disorder, and hypertension. In the diabetes cohort, the CVD risk prediction nomogram included eleven risk factors: age, material status, smoking status, systemic inflammatory response index, neutrophil-to-lymphocyte ratio, red cell distribution width, lactate dehydrogenase, high-density lipoprotein cholesterol, sleep disorder, hypertension, and physical activity. The nomogram models developed in this study have good predictive and discriminant utility for predicting CVD risk in patients with prediabetes and diabetes.

PET radiomics-based lymphovascular invasion prediction in lung cancer using multiple segmentation and multi-machine learning algorithms.

The current study aimed to predict lymphovascular invasion (LVI) using multiple machine learning algorithms and multi-segmentation positron emission tomography (PET) radiomics in non-small cell lung cancer (NSCLC) patients, offering new avenues for personalized treatment strategies and improving patient outcomes. One hundred and twenty-six patients with NSCLC were enrolled in this study. Various automated and semi-automated PET image segmentation methods were applied, including Local Active Contour (LAC), Fuzzy-C-mean (FCM), K-means (KM), Watershed, Region Growing (RG), and Iterative thresholding (IT) with different percentages of the threshold. One hundred five radiomic features were extracted from each region of interest (ROI). Multiple feature selection methods, including Minimum Redundancy Maximum Relevance (MRMR), Recursive Feature Elimination (RFE), and Boruta, and multiple classifiers, including Multilayer Perceptron (MLP), Logistic Regression (LR), XGBoost (XGB), Naive Bayes (NB), and Random Forest (RF), were employed. Synthetic Minority Oversampling Technique (SMOTE) was also used to determine if it boosts the area under the ROC curve (AUC), accuracy (ACC), sensitivity (SEN), and specificity (SPE). Our results indicated that the combination of SMOTE, IT (with 45% threshold), RFE feature selection and LR classifier showed the best performance (AUC = 0.93, ACC = 0.84, SEN = 0.85, SPE = 0.84) followed by SMOTE, FCM segmentation, MRMR feature selection, and LR classifier (AUC = 0.92, ACC = 0.87, SEN = 1, SPE = 0.84). The highest ACC belonged to the IT segmentation (with 45 and 50% thresholds) alongside Boruta feature selection and the NB classifier without SMOTE (ACC = 0.9, AUC = 0.78 and 0.76, SEN = 0.7, and SPE = 0.94, respectively). Our results indicate that selection of appropriate segmentation method and machine learning algorithm may be helpful in successful prediction of LVI in patients with NSCLC with high accuracy using PET radiomics analysis.

Establishing a nomogram for predicting necrotizing enterocolitis in premature infants: A retrospective multicenter cohort study

BackgroundTo construct a nomogram for predicting necrotizing enterocolitis (NEC) in preterm infants. MethodsA total of 4,724 preterm infants who were admitted into 8 hospitals between April 2019 and September 2020 were initially enrolled this retrospective multicenter cohort study. Finally, 1,092 eligible cases were divided into training set and test set based on a 7:3 ratio. A univariate logistic regression analysis was performed to compare the variables between the two groups. Stepwise backward regression, LASSO regression, and Boruta feature selection were utilized in the multivariate analysis to identify independent risk factors. Then a nomogram model was constructed based on the identified risk factors. ResultsRisk factors for NEC included gestational diabetes mellitus, gestational age, small for gestational age, patent ductus arteriosus, septicemia, red blood cell transfusion, intravenous immunoglobulin, severe feeding intolerance, and absence of breastfeeding. The nomogram model developed based on these factors showed well discriminative ability. Calibration and decision curve analysis curves confirmed the good consistency and clinical utility of the model. ConclusionsWe developed a nomogram model with strong discriminative ability, consistency, and clinical utility for predicting NEC. This model could be valuable for the early prediction of preterm infants at risk of developing NEC.

Predictive modelling of metabolic syndrome in Ghanaian diabetic patients: an ensemble machine learning approach

Abstract Objectives The burgeoning prevalence of cardiometabolic disorders, including type 2 diabetes mellitus (T2DM) and metabolic syndrome (MetS) within Africa is concerning. Machine learning (ML) techniques offer a unique opportunity to leverage data-driven insights and construct predictive models for MetS risk, thereby enhancing the implementation of personalised prevention strategies. In this work, we employed ML techniques to develop predictive models for pre-MetS and MetS among diabetic patients. Methods This multi-centre cross-sectional study comprised of 919 T2DM patients. Age, gender, novel anthropometric indices along with biochemical measures were analysed using BORUTA feature selection and an ensemble majority voting classification model, which included logistic regression, k-nearest neighbour, Gaussian Naive Bayes, Gradient boosting classification, and support vector machine. Results Distinct metabolic profiles and phenotype clusters were associated with MetS progression. The BORUTA algorithm identified 10 and 16 significant features for pre-MetS and MetS prediction, respectively. For pre-MetS, the top-ranked features were lipid accumulation product (LAP), triglyceride-glucose index adjusted for waist-to-height ratio (TyG-WHtR), coronary risk (CR), visceral adiposity index (VAI) and abdominal volume index (AVI). For MetS prediction, the most influential features were VAI, LAP, waist triglyceride index (WTI), Very low-density cholesterol (VLDLC) and TyG-WHtR. Majority voting ensemble classifier demonstrated superior performance in predicting pre-MetS (AUC = 0.79) and MetS (AUC = 0.87). Conclusion Identifying these risk factors reveals the complex interplay between visceral adiposity and metabolic dysregulation in African populations, enabling early detection and treatment. Ethical integration of ML algorithms in clinical decision-making can streamline identification of high-risk individuals, optimize resource allocation, and enable precise, tailored interventions.

Blue skies: Does the visual composition of sky guide subjective judgments of naturalness in the environment?

Expanding on previous findings, that highlighted the significance of sky in environmental perception, our analysis investigated whether the visual composition of the sky shapes perceptions of environmental naturalness. The study employed a novel, free-selection task in which participants viewed a series of environmental images with varying levels of natural and urban elements, as well as different sky visibility conditions, and were asked to identify “nature” within these images. The task procedure also involved subjective ratings of each scene. Using previously gathered data, we reassessed 105 participants' selection of the sky as “nature” across 96 photos of diverse outdoor scenes to understand which visuospatial features influence these perceptions. Utilizing the Boruta feature selection algorithm, we identified key characteristics—fractal dimensions, brightness, and entropy in brightness, hue, and saturation—that significantly predicted the selection of sky as “nature”, irrespective of the environment type (urban or natural). Results indicated that lower fractal dimensions are preferred for sky selected as “nature”, inversely affecting the naturalness judgment of scenes with the additional effect of brightness. These findings enhance our understanding of how visuospatial features influence environmental perception, offering implications for future research directions and theoretical advancements in understanding environmental perception.

A nomogram for predicting the overall survival in rectal cancer patients after total neoadjuvant therapy.

Total neoadjuvant therapy (TNT) has been recommended by the National Comprehensive Cancer Network for treating locally advanced rectal cancer (LARC), but extremely rare studies have focused on establishing nomograms to predict the prognosis in these patients after TNT. We aimed to develop a nomogram to predict overall survival (OS) in rectal cancer patients who underwent TNT. In retrospective cohort study, we extract the data of the rectal cancer patients from the SEER database between 2010 and 2015, including demographic information and tumor characteristics. The cohort was divided into training set and validation set based on a ratio of 7:3. Univariate logistic regression analysis was utilized for the comparison of variables in training set. Candidate variables with P < 0.1 in training set was entered into the best subset selection, LASSO regression and Boruta feature selection. Finally, the selected variables significantly associated with the 3-year, 5-year, and 8-year OS were used to build a nomogram, followed by validation using receiver operating characteristic (ROC) curve, area under the curve (AUC), and calibration curve. A total of 3265 rectal cancer patients (training set: 2285; test set: 980) were included in the present study. A nomogram was developed to predict the 3-year, 5-year, and 8-year OS based on age, household income, total number of in situ/malignant tumors, CEA, T stage, N stage and perineural invasion. The nomogram showed good efficiency in predicting the 3-year, 5-year and 8-year OS with good AUC for the training set and test set, respectively. We established a nomogram for predicting the 3-year, 5-year, and 8-year OS of the rectal cancer patients, which showed good prediction efficiency for the OS after TNT.

Deep learning for Bitcoin price direction prediction: models and trading strategies empirically compared

This paper applies deep learning models to predict Bitcoin price directions and the subsequent profitability of trading strategies based on these predictions. The study compares the performance of the convolutional neural network–long short-term memory (CNN–LSTM), long- and short-term time-series network, temporal convolutional network, and ARIMA (benchmark) models for predicting Bitcoin prices using on-chain data. Feature-selection methods—i.e., Boruta, genetic algorithm, and light gradient boosting machine—are applied to address the curse of dimensionality that could result from a large feature set. Results indicate that combining Boruta feature selection with the CNN–LSTM model consistently outperforms other combinations, achieving an accuracy of 82.44%. Three trading strategies and three investment positions are examined through backtesting. The long-and-short buy-and-sell investment approach generated an extraordinary annual return of 6654% when informed by higher-accuracy price-direction predictions. This study provides evidence of the potential profitability of predictive models in Bitcoin trading.

A two-tier feature selection method for predicting mortality risk in ICU patients with acute kidney injury

Acute kidney injury (AKI) is one of the most important lethal factors for patients admitted to intensive care units (ICUs), and timely high-risk prognostic assessment and intervention are essential to improving patient prognosis. In this study, a stacking model using the MIMIC-III dataset with a two-tier feature selection approach was developed to predict the risk of in-hospital mortality in ICU patients admitted for AKI. External validation was performed using separate MIMIC-IV and eICU-CRD. The area under the curve (AUC) was calculated using the stacking model, and features were selected using the Boruta and XGBoost feature selection methods. This study compares the performance of a stacking model using two-tier feature selection with a model using single-tier feature selection (XGBoost: 85; Boruta: 83; two-tier: 0.91). The predictive effectiveness of the stacking model was further validated by using different datasets (Validation 1: 0.83; Validation 2: 0.85) and comparing it with a simpler model and traditional clinical scores (SOFA: 0.65; APACH IV: 0.61). In addition, this study combined interpretable techniques and causal inference to analyze the causal relationship between features and predicted outcomes.