Grid Search Research Articles

A Highly Efficient Compressive Sensing Algorithm Based on Root-Sparse Bayesian Learning for RFPA Radar

Off-grid issues and high computational complexity are two major challenges faced by sparse Bayesian learning (SBL)-based compressive sensing (CS) algorithms used for random frequency pulse interval agile (RFPA) radar. Therefore, this paper proposes an off-grid CS algorithm for RFPA radar based on Root-SBL to address these issues. To effectively cope with off-grid issues, this paper derives a root-solving formula inspired by the Root-SBL algorithm for velocity parameters applicable to RFPA radar, thus enabling the proposed algorithm to directly solve the velocity parameters of targets during the fine search stage. Meanwhile, to ensure computational feasibility, the proposed algorithm utilizes a simple single-level hierarchical prior distribution model and employs the derived root-solving formula to avoid the refinement of velocity grids. Moreover, during the fine search stage, the proposed algorithm combines the fixed-point strategy with the Expectation-Maximization algorithm to update the hyperparameters, further reducing computational complexity. In terms of implementation, the proposed algorithm updates hyperparameters based on the single-level prior distribution to approximate values for the range and velocity parameters during the coarse search stage. Subsequently, in the fine search stage, the proposed algorithm performs a grid search only in the range dimension and uses the derived root-solving formula to directly solve for the target velocity parameters. Simulation results demonstrate that the proposed algorithm maintains low computational complexity while exhibiting stable performance for parameter estimation in various multi-target off-grid scenarios.

The Cost-Optimal Control of Building Air Conditioner Loads Based on Machine Learning: A Case Study of an Office Building in Nanjing

Building envelopes and indoor environments exhibit thermal inertia, forming a virtual energy storage system in conjunction with the building air conditioner (AC) system. This system represents a current demand response resource for building electricity use. Thus, this study centers on the CatBoost algorithm within machine learning (ML) technology, utilizing the LASSO regression model for feature selection and applying the Optuna framework for hyperparameter optimization (HPO) to develop a cost-optimal control method for minimizing building AC loads. This method addresses the challenges associated with traditional load forecasting and control methods, which are often impacted by environmental temperature, building parameters, and user behavior uncertainties. These methods struggle to accurately capture the complex dynamics and nonlinear relationships of AC operations, making it difficult to devise AC operation and virtual energy storage scheduling strategies effectively. The proposed method was applied and validated using a case study of an office building in Nanjing, China. The prediction results showed coefficient of variation in root mean square error (CV-RMSE) values of 6.4% and 2.2%. Compared with the original operating conditions, the indoor temperature remained within a comfortable range, the AC load was reduced by 5.25%, and the operating energy costs were reduced by 24.94%. These results demonstrate that the proposed method offers improved computational efficiency, enhanced model performance, and economic benefits.

Sentinel-2 Multispectral Satellite Remote Sensing Retrieval of Soil Cu Content Changes at Different pH Levels

With the development of multispectral imaging technology, retrieving soil heavy metal content using multispectral remote sensing images has become possible. However, factors such as soil pH and spectral resolution affect the accuracy of model inversion, leading to low precision. In this study, 242 soil samples were collected from a typical area of the Pearl River Delta, and the Cu content in the soil was detected in the laboratory. Simultaneously, Sentinel-2 remote sensing image data were collected, and two-dimensional and three-dimensional spectral indices were established. Constructing independent decision trees based on pH values, using the Successive Projections Algorithm (SPA) combined with the Boruta algorithm to select the characteristic bands for soil Cu content, and this was combined with Optuna automatic hyperparameter optimization for ensemble learning models to establish a model for estimating Cu content in soil. The research results indicated that in the SPA combined with the Boruta feature selection algorithm, the characteristic spectral indices were mainly concentrated in the spectral transformation forms of TBI2 and TBI4. Full-sample modeling lacked predictive ability, but after classifying the samples based on soil pH value, the R2 of the RF and XGBoost models constructed with the samples with pH values between 5.85 and 7.75 was 0.54 and 0.76, respectively, with corresponding RMSE values of 22.48 and 16.12 and RPD values of 1.51 and 2.11. This study shows that the inversion of soil Cu content under different pH conditions exhibits significant differences, and determining the optimal pH range can effectively improve inversion accuracy. This research provides a reference for further achieving the efficient and accurate remote sensing of heavy metal pollution in agricultural soil.

Binning Metagenomic Contigs Using Contig Embedding and Decomposed Tetranucleotide Frequency.

Metagenomic binning is a crucial step in metagenomic research. It can aggregate the genome sequences belonging to the same microbial species into independent bins. Most existing methods ignore the semantic information of contigs and lack effective processing of tetranucleotide frequency, resulting in insufficient and complex feature information extracted for binning and poor binning results. To address the above problems, we propose CedtBin, a metagenomic binning method based on contig embedding and decomposed tetranucleotide frequency. First, the improved BERT model is used to learn the contigs to obtain their embedding representation. Secondly, the tetranucleotide frequencies are decomposed using a non-negative matrix factorization (NMF) algorithm. After that, the two features are spliced and input into the clustering algorithm for binning. Considering the sensitivity of the DBSCAN clustering algorithm to input parameters, in order to solve the drawbacks of manual parameter input, we also propose an Annoy-DBSCAN algorithm that can adaptively determine the parameters of the DBSCAN algorithm. This algorithm uses Approximate Nearest Neighbors Oh Yeah (Annoy) and combines it with a grid search strategy to find the optimal parameters of the DBSCAN algorithm. On simulated and real datasets, CedtBin achieves better binning results than mainstream methods and can reconstruct more genomes, indicating that the proposed method is effective.

XGBOOST HYPERPARAMETER OPTIMIZATION USING RANDOMIZEDSEARCHCV FOR ACCURATE FOREST FIRE DROUGHT CONDITION PREDICTION

Climate change and increasing global temperatures have increased the frequency and intensity of forest fires, making fire risk evaluation increasingly important. This study aims to improve the accuracy of predicting forest fuel drought conditions (Drought Code) by using the XGBoost algorithm optimized with RandomizedSearchCV. The research methods include collecting data related to forest fires, preprocessing data to ensure quality and consistency, and using RandomizedSearchCV for XGBoost hyperparameter optimization. The results showed that the optimized XGBoost model resulted in a decrease in Mean Squared Error (MSE) and an increase in R-squared value compared to the default model. The optimized model achieved an MSE of 0.0210 and R2 of 0.9820 on the test data, indicating significantly improved prediction accuracy for forest fuel drought conditions. These findings emphasize the importance of hyperparameter optimization in improving the accuracy of predictive models for forest fire risk assessment.

COMPARISON OF MACHINE LEARNING ALGORITHMS FOR SENTIMENT ANALYSIS OF DIGITAL IDENTITY APPLICATION USERS

In the rapidly evolving digital era, the Population Identity Application (IKD) plays a crucial role in streamlining civil administration processes in Indonesia, allowing easier and faster access to population services. This study aims to explore the application of machine learning algorithms in analyzing user responses to the IKD application. Three popular algorithms: Support Vector Machine (SVM), K-Nearest Neighbors (K-NN), and Naïve Bayes were chosen to classify sentiment from 1301 user reviews on the Google Play Store into positive and negative categories. After performing data preprocessing such as tokenization and stemming, hyperparameter optimization was conducted using GridSearchCV to enhance classification accuracy. The research results indicate that the SVM algorithm, optimized with hyperparameters, including the use of the rbf kernel and a parameter value of C = 1, achieved the highest accuracy of 85.60%, making it the most effective method for sentiment classification of the IKD application. These findings provide valuable insights for the government and developers in refining the features and performance of IKD, contributing to the efficiency and security of digital administration in Indonesia. Furthermore, this study opens opportunities for further development that is more responsive to user needs and expectations in the future.

Interpretable Machine Learning-Based Influence Factor Identification for 3D Printing Process-Structure Linkages.

Three-dimensional printing technology is a rapid prototyping technology that has been widely used in manufacturing. However, the printing parameters in the 3D printing process have an important impact on the printing effect, so these parameters need to be optimized to obtain the best printing effect. In order to further understand the impact of 3D printing parameters on the printing effect, make theoretical explanations from the dimensions of mathematical models, and clarify the rationality of certain important parameters in previous experience, the purpose of this study is to predict the impact of 3D printing parameters on the printing effect by using machine learning methods. Specifically, we used four machine learning algorithms: SVR (support vector regression): A regression method that uses the principle of structural risk minimization to find a hyperplane in a high-dimensional space that best fits the data, with the goal of minimizing the generalization error bound. Random forest: An ensemble learning method that constructs a multitude of decision trees and outputs the class that is the mode of the classes (classification) or mean prediction (regression) of the individual trees. GBDT (gradient boosting decision tree): An iterative ensemble technique that combines multiple weak prediction models (decision trees) into a strong one by sequentially minimizing the loss function. Each subsequent tree is built to correct the errors of the previous tree. XGB (extreme gradient boosting): An optimized and efficient implementation of gradient boosting that incorporates various techniques to improve the performance of gradient boosting frameworks, such as regularization and sparsity-aware splitting algorithms. The influence of the print parameters on the results under the feature importance and SHAP (Shapley additive explanation) values is compared to determine which parameters have the greatest impact on the print effect. We also used feature importance and SHAP values to compare the importance impact of print parameters on results. In the experiment, we used a dataset with multiple parameters and divided it into a training set and a test set. Through Bayesian optimization and grid search, we determined the best hyperparameters for each algorithm and used the best model to make predictions for the test set. We compare the predictive performance of each model and confirm that the extrusion expansion ratio, elastic modulus, and elongation at break have the greatest influence on the printing effect, which is consistent with the experience. In future, we will continue to delve into methods for optimizing 3D printing parameters and explore how interpretive machine learning can be applied to the 3D printing process to achieve more efficient and reliable printing results.

Optimizing Deep Learning Models with Improved BWO for TEC Prediction.

The prediction of total ionospheric electron content (TEC) is of great significance for space weather monitoring and wireless communication. Recently, deep learning models have become increasingly popular in TEC prediction. However, these deep learning models usually contain a large number of hyperparameters. Finding the optimal hyperparameters (also known as hyperparameter optimization) is currently a great challenge, directly affecting the predictive performance of the deep learning models. The Beluga Whale Optimization (BWO) algorithm is a swarm intelligence optimization algorithm that can be used to optimize hyperparameters of deep learning models. However, it is easy to fall into local minima. This paper analyzed the drawbacks of BWO and proposed an improved BWO algorithm, named FAMBWO (Firefly Assisted Multi-strategy Beluga Whale Optimization). Our proposed FAMBWO was compared with 11 state-of-the-art swarm intelligence optimization algorithms on 30 benchmark functions, and the results showed that our improved algorithm had faster convergence speed and better solutions on almost all benchmark functions. Then we proposed an automated machine learning framework FAMBWO-MA-BiLSTM for TEC prediction, where MA-BiLSTM is for TEC prediction and FAMBWO for hyperparameters optimization. We compared it with grid search, random search, Bayesian optimization algorithm and beluga whale optimization algorithm. Results showed that the MA-BiLSTM model optimized by FAMBWO is significantly better than the MA-BiLSTM model optimized by grid search, random search, Bayesian optimization algorithm, and BWO.

Rapid Lactic Acid Content Detection in Secondary Fermentation of Maize Silage Using Colorimetric Sensor Array Combined with Hyperspectral Imaging

Lactic acid content is a crucial indicator for evaluating maize silage quality, and its accurate detection is essential for ensuring product quality. In this study, a quantitative prediction model for the change of lactic acid content during the secondary fermentation of maize silage was constructed based on a colorimetric sensor array (CSA) combined with hyperspectral imaging. Volatile odor information from maize silage samples with different days of aerobic exposure was obtained using CSA and recorded by a hyperspectral imaging (HSI) system. Subsequently, the acquired spectral data were subjected to preprocessing through five distinct methods before being modeled using partial least squares regression (PLSR). The coronavirus herd immunity optimizer (CHIO) algorithm was introduced to screen three color-sensitive dyes that are more sensitive to changes in lactic acid content of maize silage. To minimize model redundancy, three algorithms, such as competitive adaptive reweighted sampling (CARS), were used to extract the characteristic wavelengths of the three dyes, and the combination of the characteristic wavelengths obtained by each algorithm was used as an input variable to build an analytical model for quantitative prediction of the lactic acid content by support vector regression (SVR). Moreover, two optimization algorithms, namely grid search (GS) and crested porcupine optimizer (CPO), were compared to determine their effectiveness in optimizing the parameters of the SVR model. The results showed that the prediction accuracy of the model can be significantly improved by choosing appropriate pretreatment methods for different color-sensitive dyes. The CARS-CPO-SVR model had better prediction, with a prediction set determination coefficient (RP2), root mean square error of prediction (RMSEP), and a ratio of performance to deviation (RPD) of 0.9617, 2.0057, and 5.1997, respectively. These comprehensive findings confirm the viability of integrating CSA with hyperspectral imaging to accurately quantify the lactic acid content in silage, providing a scientific and novel method for maize silage quality testing.

Comparing durability and compressive strength predictions of hyperoptimized random forests and artificial neural networks on a small dataset of concrete containing nano SiO2 and RHA

Through the increasing use of supplementary cementitious materials, the properties of concrete have taken on increased significance in a design code. Using reliable prediction models based on a small data set for the mechanical properties and durability of concrete can reduce the number of trial batches and experiments needed to produce useful design data in the laboratory, reducing time as well as resources. In this study, we investigate how the properties of water penetration, chlorine resistance, and compressive strength can be predicted by polynomial regression (PR), random forest (RF) regression, and artificial neural networks (ANNs) based on the input values of density, workability, and the constituent amount of rice husk ash, cement, and nano SiO 2 . We vary the training data used and test the coefficient of determination ( R 2 score) on the remaining data as a test set to measure predictive capability. We show that RFs and ANNs outperform PR in all settings and have unambiguously extrapolating properties when hyperparameter optimization is designed for this purpose. Remarkably, we obtain R 2 scores on the test data of 0.858 − 0.990 for RFs and 0.825 − 0.985 for ANNs.

Abstract B019: A machine learning approach to predicting smoking cessation outcomes among Spanish-speaking smokers who completed a culturally targeted intervention

Abstract Introduction: Among the Hispanic/Latinx population in the US, four of five leading causes of death are attributed to smoking. Few evidence-based interventions have been developed to improve smoking cessation for this population. Our team has demonstrated the efficacy of a culturally targeted, extended self-help intervention for Spanish-speaking smokers, estimating a smoking abstinence rate of 33% at 24 months, compared to 24% for usual care. Further efforts are needed to enhance this efficacious, low-cost, scalable intervention approach. Machine learning (ML) is one approach to increase understanding of the predictors of treatment outcomes and inform strategies to improve the intervention. Toward that goal, this secondary data analysis utilized the decision tree (DT) model to predict self-reported 7-day point prevalence abstinence at 18-month follow-up for participants receiving our intervention. Method: Data from participants who reported smoking status at an 18-month follow-up (N=332 of 714 enrolled, 36% abstinent) were randomly split (80:20) into training and test datasets based on smoking status. We entered demographics, psychosocial, and smoking variables collected at baseline as predictors in the model. In addition to handling missing values and normalizing numeric features, we employed the Synthetic Minority Over-sampling Technique (SMOTE) combined with Tomek links (SMOTE-Tomek) to improve inter-class separability. Recursive Feature Elimination (RFE) using DT was implemented to identify the most relevant predictors. The cross-validation (CV) pipeline incorporated preprocessing, feature selection, handling class-imbalance, over-sampling, and model training with a DT as the interpretable classifier. Hyperparameters were tuned using stratified K-fold (K=5) CV to optimize parameters using Grid search. F1 score was selected as the primary metric as it accounts for each class performance by combining the precision and recall metrics. Finally, the performance of the classifier was evaluated in 20% of the unseen dataset. Results: The DT classifier for the CV achieved the F1 score of 0.73 [95% CI 0.66, 0.77], revealing a reasonably good performance in identifying smokers at 18-months. RFE selected familism, age, affect, and confidence as the most relevant predictors of smoking status. Individuals who had lower familism scores (<138), combined with higher age (>50), were more likely to be smokers at 18 months. Individuals who had higher familism scores (>138) combined with higher negative affect (>42) were more likely to be smokers. Conclusion: This study provides the first step toward personalized care for smoking cessation among the Hispanic/Latinx population and demonstrates the potential of DT classifier to predict cessation outcomes among individuals who received and completed a culturally and linguistically targeted smoking cessation intervention. Our future analysis will compare this model with conventional statistical modeling approaches and other ML algorithms to identify the best-performing parsimonious model. Citation Format: Ranjita Poudel, K. Ruwani M. Fernando, Matthew B. Schabath, Steven K. Sutton, Thomas H. Brandon, Issam El Naqa, Vani N. Simmons. A machine learning approach to predicting smoking cessation outcomes among Spanish-speaking smokers who completed a culturally targeted intervention [abstract]. In: Proceedings of the 17th AACR Conference on the Science of Cancer Health Disparities in Racial/Ethnic Minorities and the Medically Underserved; 2024 Sep 21-24; Los Angeles, CA. Philadelphia (PA): AACR; Cancer Epidemiol Biomarkers Prev 2024;33(9 Suppl):Abstract nr B019.

Hyperparameter Optimization for Convolutional Neural Network-Based Sentiment Analysis

The rapid development of digital technology brings about the importance of product or service opinions as a data source in business intelligence. Sentiment analysis is a business intelligence tool that can help gauge market trends by analysing the available opinions. Various studies have been developed to solve sentiment analysis problems, from selecting feature engineering techniques to selecting sentiment classification models based on classical or deep learning methods. However, these studies still select hyperparameters on a trial basis, which poses problems in terms of time and not optimal performance. Therefore, this research proposes the implementation of Bayesian Optimization to automate the selection of hyperparameters in sentiment analysis based on a Convolutional Neural Network (CNN). The results show that implementing the Bayesian Optimization method has the lowest computation time compared to Random and Grid Searches, which is only 175.746765 seconds, in the fifth trial. In addition, it made a reasonably large cut in terms of times compared to manual trial-based hyperparameter tuning that needs 540 trials. In the model assessment process, implementing Bayesian Optimization gives the highest values on Precision and Specificity, which are 0.8168 and 0.7176, respectively. Thus, implementing Bayesian Optimization is the right choice for sentiment analysis tasks since the precision of predicting negative sentiment classes is vital in hospitality business intelligence, especially the use of related information for product improvement or hotel service improvement. The implementation of Bayesian Optimization not only applied as a reliable hyperparameter selection technique for classification tasks but also regression prediction tasks.

Deep neural network based distribution system state estimation using hyperparameter optimization

In the past decade, distribution system state estimation has become a crucial topic in power system research due to the increasing importance of distribution networks amidst the decline of centralized energy production. This paper addresses a gap in the literature regarding the application of modern hyperparameter optimization techniques in low-voltage distribution system state estimation using deep neural networks. In particular, it demonstrates the use of the Tree-structured Parzen Estimator algorithm, which is a Bayesian hyperparameter optimization method, for distribution system state estimation on real Hungarian low-voltage networks. The study uses data from four real-life low-voltage supply areas in Hungary, which were modeled to address the challenges in obtaining network information. Compared to traditional methods like the weighted least squares method, the Tree-structured Parzen Estimator algorithm significantly improves the accuracy of the voltage amplitude and angle estimations, reducing the relative error by 14–73%. Additionally, it is shown that TPE outperforms simpler methods like Random Search in hyperparameter optimization. The results also reveal connections between the distribution system size and optimal hyperparameters, such as batch size, learning rate, and hidden layer configuration. The proposed non-iterative algorithm, combined with the parallel computation capabilities of deep neural networks utilizing GPU, resulted in four orders of magnitude improvement in runtime. These advancements make the proposed approach a valuable tool for renewable energy integration planning and real-time monitoring, highlighting its potential for practical applications in the power industry.

Establishment and external validation of an early warning model of diabetic peripheral neuropathy based on random forest and logistic regression

ObjectiveThe primary objective of this study was to investigate the risk factors for diabetic peripheral neuropathy (DPN) and to establish an early diagnostic prediction model for its onset, based on clinical data and biochemical indices.MethodsRetrospective data were collected from 1,446 diabetic patients at the First Affiliated Hospital of Anhui University of Chinese Medicine and were split into training and internal validation sets in a 7:3 ratio. Additionally, 360 diabetic patients from the Second Affiliated Hospital were used as an external validation cohort. Feature selection was conducted within the training set, where univariate logistic regression identified variables with a p-value < 0.05, followed by backward elimination to construct the logistic regression model. Concurrently, the random forest algorithm was applied to the training set to identify the top 10 most important features, with hyperparameter optimization performed via grid search combined with cross-validation. Model performance was evaluated using ROC curves, decision curve analysis, and calibration curves. Model fit was assessed using the Hosmer-Lemeshow test, followed by Brier Score evaluation for the random forest model. Ten-fold cross-validation was employed for further validation, and SHAP analysis was conducted to enhance model interpretability.ResultsA nomogram model was developed using logistic regression with key features: limb numbness, limb pain, diabetic retinopathy, diabetic kidney disease, urinary protein, diastolic blood pressure, white blood cell count, HbA1c, and high-density lipoprotein cholesterol. The model achieved AUCs of 0.91, 0.88, and 0.88 for the training, validation, and test sets, respectively, with a mean AUC of 0.902 across 10-fold cross-validation. Hosmer-Lemeshow test results showed p-values of 0.595, 0.418, and 0.126 for the training, validation, and test sets, respectively. The random forest model demonstrated AUCs of 0.95, 0.88, and 0.88 for the training, validation, and test sets, respectively, with a mean AUC of 0.886 across 10-fold cross-validation. The Brier score indicates a good calibration level, with values of 0.104, 0.143, and 0.142 for the training, validation, and test sets, respectively.ConclusionThe developed nomogram exhibits promise as an effective tool for the diagnosis of diabetic peripheral neuropathy in clinical settings.

Enhancing ground loss rate prediction in soft-soil shield tunneling: a synergistic approach of peck back analysis and eXtreme Gradient Boosting and bayesian optimization

This study investigates the prediction of ground loss rate during soft-soil shield tunneling using Peck’s back analysis method and XGBoost model. Bayesian optimization is employed to determine optimal hyperparameters, ensuring comprehensive and efficient model tuning. The XGBoost model is compared with Random Forest (RF) and Support Vector Machine (SVM) models to benchmark its performance. The results demonstrate the superior accuracy and robustness of the XGBoost model. Also, the results show that the soil properties and the grouting factors of the excavation face affect the duration of the instantaneous settlement of the ground surface. There is a specific correlation between the depth-to-diameter ratio, the coefficient of variation in the advancing speed of the shield machine, the maximum surface subsidence, and the ground loss rate. The prediction model of the ground loss rate based on the combined approach of Peck back analysis and eXtreme Gradient Boosting and Bayesian optimization has high reliability in soft-soil layers, and this method can provide a specific reference for predicting construction risk in related projects.

Spatiotemporal modelling of airborne birch and grass pollen concentration across Switzerland: A comparison of statistical, machine learning and ensemble methods

BackgroundStatistical and machine learning models are commonly used to estimate spatial and temporal variability in exposure to environmental stressors, supporting epidemiological studies. We aimed to compare the performances, strengths and limitations of six different algorithms in the retrospective spatiotemporal modeling of daily birch and grass pollen concentrations at a spatial resolution of 1 km across Switzerland. MethodsDaily birch and grass pollen concentrations were available from 14 measurement sites in Switzerland for 2000–2019. To develop the spatiotemporal models, we considered spatiotemporal, spatial and temporal predictors including meteorological factors, land-use, elevation, species distribution and Normalized Difference Vegetation Index (NDVI). We used six statistical and machine learning algorithms: LASSO, Ridge, Elastic net, Random forest, XGBoost and ANNs. We optimized model structures through feature selection and grid search techniques to obtain the best predictive performance. We used train-test split and cross-validation to avoid overfitting and overoptimistic performance indicators. We then combined these six models through multiple linear regression to develop an ensemble hybrid model. ResultsThe 5th-95th percentiles of birch and grass pollen concentrations were 0–151 and 0–105 grains/m3, respectively. The hybrid ensemble model achieved the best RMSE on the test dataset for both birch and grass pollen with 94.4 and 19.7 grains/m3, respectively.Nonlinear models (Random forest, XGBoost and ANNs) achieved lower test RMSE's than linear models (LASSO, Ridge, Elastic net) for both pollen types, with RMSE's ranging from 105.9 to 140.5 grains/m3 for birch and from 20.0 to 25.4 grains/m3 for grass pollen. The Random forest algorithm yielded the best spatial and temporal performance among the six evaluated modelling methods. The ensemble hybrid model outperformed the six linear and nonlinear algorithms. Country-wide pollen concentration, land use, weather, and NDVI were important predictors. ConclusionNonlinear algorithms outperformed linear models and accurately explained complex, nonlinear relationships between environmental factors and measured concentrations.

Grid Search Optimized Machine Learning based Modeling of CO2 Emissions Prediction from Cars for Sustainable Environment

Carbon emissions have increased dramatically because of industrialization, trapping heat in the atmosphere and hastening climate change. This is a serious threat to the wealth, security, and well-being of the world. The effects are extensive, ranging from severe weather, disease outbreaks, and economic disruption to food insecurity and water scarcity. The World Health Organization (WHO) has determined that climate change poses the greatest threat to public health in the twenty-first century. Thus, precise CO2 emissions have emerged as a crucial concern in recent times. Several studies have tried to forecast the amount CO2 from industry and power plant using statistical analysis. Efficiency, robustness and diverse application was the limitation of the study. In this study, we have proposed an AI based model that is able to predict the amounts of CO2 emissions from cars. We applied a grid search-optimized machine learning approach using the publicly available Canadian dataset. Incorporation of different statistical analyses and preprocessing techniques such as duplicate data management, outlier rejection, scaling contributed to enhance the quality of the dataset. Later, grid search techniques were applied to tune the KNN, RF, and SVR models. The approach has enhanced the performance of CO2 emissions prediction. In the study, we further used the explainability of the random forest model to check the bias and fairness of predictability. MSE, RMSE, and R-squared metrics of the proposed approach were the highest as the state of the art.

The application and clinical translation of the self-evolving machine learning methods in predicting diabetic retinopathy and visualizing clinical transformation.

This study aims to analyze the application and clinical translation value of the self-evolving machine learning methods in predicting diabetic retinopathy and visualizing clinical outcomes. A retrospective study was conducted on 300 diabetic patients admitted to our hospital between January 2022 and October 2023. The patients were divided into a diabetic retinopathy group (n=150) and a non-diabetic retinopathy group (n=150). The improved Beetle Antennae Search (IBAS) was used for hyperparameter optimization in machine learning, and a self-evolving machine learning model based on XGBoost was developed. Value analysis was performed on the predictive features for diabetic retinopathy selected through multifactor logistic regression analysis, followed by the construction of a visualization system to calculate the risk of diabetic retinopathy occurrence. Multifactor logistic regression analysis revealed that being male, having a longer disease duration, higher systolic blood pressure, fasting blood glucose, glycosylated hemoglobin, low-density lipoprotein cholesterol, and urine albumin-to-creatinine ratio were risk factors for the development of diabetic retinopathy, while non-pharmacological treatment was a protective factor. The self-evolving machine learning model demonstrated significant performance advantages in early diagnosis and prediction of diabetic retinopathy occurrence. The application of the self-evolving machine learning models can assist in identifying features associated with diabetic retinopathy in clinical settings, enabling early prediction of disease occurrence and aiding in the formulation of treatment plans to improve patient prognosis.

Hybrid attention-based deep neural networks for short-term wind power forecasting using meteorological data in desert regions

This study introduces an optimized hybrid deep learning approach that leverages meteorological data to improve short-term wind energy forecasting in desert regions. Over a year, various machine learning and deep learning models have been tested across different wind speed categories, with multiple performance metrics used for evaluation. Hyperparameter optimization for the LSTM and Conv-Dual Attention Long Short-Term Memory (Conv-DA-LSTM) architectures was performed. A comparison of the techniques indicates that the deep learning methods consistently outperform the classical techniques, with Conv-DA-LSTM yielding the best overall performance with a clear margin. This method obtained the lowest error rates (RMSE: 71.866) and the highest level of accuracy (R2: 0.93). The optimization clearly works for higher wind speeds, achieving a remarkable improvement of 22.9%. When we look at the monthly performance, all the months presented at least some level of consistent enhancement (RRMSE reductions from 1.6 to 10.2%). These findings highlight the potential of advanced deep learning techniques in enhancing wind energy forecasting accuracy, particularly in challenging desert environments. The hybrid method developed in this study presents a promising direction for improving renewable energy management. This allows for more efficient resource allocation and improves wind resource predictability.

An In-Depth Look at Rising Temperatures: Forecasting with Advanced Time Series Models in Major US Regions

With growing concerns over climate change, accurately predicting temperature trends is crucial for informed decision-making and policy development. In this study, we perform a comprehensive comparative analysis of four advanced time series forecasting models—Autoregressive Integrated Moving Average (ARIMA), Exponential Smoothing (ETS), Multilayer Perceptron (MLP), and Gaussian Processes (GP)—to assess changes in minimum and maximum temperatures across four key regions in the United States. Our analysis includes hyperparameter optimization for each model to ensure peak performance. The results indicate that the MLP model outperforms the other models in terms of accuracy for temperature forecasting. Utilizing this best-performing model, we conduct temperature projections to evaluate the hypothesis that the rates of change in temperatures are greater than zero. Our findings confirm a positive rate of change in both maximum and minimum temperatures, suggesting a consistent upward trend over time. This research underscores the critical importance of refining time series forecasting models to address the challenges posed by climate change and supporting the development of effective strategies to mitigate the impacts of rising temperatures. The insights gained from this work emphasize the need for continuous advancement in predictive modeling techniques to better understand and respond to the dynamics of climate change.