Grid Search Cross-validation Research Articles

Fusion of spectral and topographic features for land use mapping using a machine learning framework for a regional scale application.

This study investigated the dynamics of land use and land cover (LULC) modelling, mapping, and assessment in the Kegalle District ofSri Lanka, where policy decision-making is crucial in agricultural development where LULC temporal datasets are not readily available.Employing remotely sensed datasets and machine learning algorithms, the work presented here aims to compare the accuracy of three classification approaches in mapping LULC categories across the time in the study area primarily using the Google Earth Engine (GEE). Three classifiers namely random forest (RF), support vector machines (SVM), and classification and regression trees (CART) were used in LULC modelling, mapping, and change analysis. Different combinations of input features were investigated to improve classification performance. Developed models were optimised using the grid search cross-validation (CV) hyperparameter optimisation approach. It was revealed that the RF classifier constantly outstrips SVM and CART in terms of accuracy measures, highlighting its reliability in classifying the LULC. Land cover changes were examined for two periods, from 2001 to 2013 and 2013 to 2022, implying major alterations such as the conversion of rubber and coconut areas to built-up areas and barren lands. For suitable classification with higher accuracy, the study suggests utilising high spatial resolution satellite data, advanced feature selection approaches, and a combination of several spatial and spatial-temporal data sources. The study demonstrated practical applications of derived temporal LULC datasets for land management practices in agricultural development activities in developing nations.

Hybrid FCMG-OP-FIS model approach to convert regression into classification data for machine learning-based AQI prediction

Air pollution from vehicle emissions, industrial activities, and medical facilities poses significant health risks in urban areas, underscoring the necessity for robust air quality index (AQI) monitoring. This paper presents a novel method for AQI prediction by integrating a fuzzy centre merge graph with an optimal value-based fuzzy inference system (FCMG-OP-FIS) and machine learning (ML). Traditional ML techniques encounter difficulties when converting regression datasets into classification formats, particularly when unable to label the dataset using the traditional method. The proposed FCMG-OP-FIS model efficiently converts regression data into a classification framework. Unlike traditional AQI prediction methods that rely solely on pollutant data, this approach incorporates both pollutant and meteorological data to improve prediction accuracy. The innovative fuzzy centre merge graph (FCMG) balances the dataset for optimal solutions and facilitates input grouping for Simulink, simplifying rule management. The FCMG-OP-FIS model generates a regression output for AQI, which is subsequently classified into levels (healthy, moderate, or unhealthy) using IF-THEN rules. To enhance accuracy further, a random forest classifier (RFC) is trained on the FCMG-OP-FIS classified output data. The regression output of the FCMG-OP-FIS model is validated using metrics such as RMSE (0.48), MSE (0.23), MAE (0.23), and MAPE (1.77%). Additionally, the classification output from the RFC model employs advanced validation techniques including stratified shuffle validation, grid search cross-validation, and confusion matrix analysis, achieving an accuracy rate of 99%, with the F1 score, precision, and recall over all at 99%. These results demonstrate the effectiveness of the proposed model in accurately labelling data for classification and predicting AQI through ML, highlighting its potential for practical application in environmental monitoring and management.

Machine Learning Algorithms for Prediction of Boiler Steam Production

The continuous increase in global electricity demand has resulted in boiler power plants becoming a significant energy source. The production of steam is a principal indicator of boiler efficiency, and the accurate prediction of steam production is paramount importance for the enhancement of boiler efficiency and the reduction of operational costs. In this study employs a boiler dataset with a steam production capacity of 420 tons per hour. A total of 25 independent variables were extracted from the original 39 variables through data processing and feature engineering for the purpose of prediction analysis. Subsequently, 8 machine learning models were used for modeling predictions. Grid search cross-validation was employed in order to optimise the performance of the model. The models were analysed and assessed using the Mean Squared Error (MSE) metrics. The results show that random forest achieves the highest accuracy among the 8 single models. Based on 8 models, New Bagging ensemble model is proposed, which combined predictions from 8 single models, demonstrated the optimal overall fit and the lowest MSE, achieved the purpose of the research. The present study demonstrates the ability to analyse and predict complex industrial systems with machine learning algorithms, and provides insights into the use of machine learning algorithms for industrial big data analytics and Industry 4.0. Further work could explore using larger datasets and deep learning to make predictions more accurate.

Conventional Machine Learning and Ensemble Learning Techniques in Cardiovascular Disease Prediction and Analysis

Cardiovascular diseases, which significantly affect the heart and blood vessels, are one of the leading causes of death worldwide. Early diagnosis and treatment of these diseases, which cause approximately 19.1 million deaths, are essential. Many problems, such as coronary artery disease, blood vessel disease, irregular heartbeat, heart muscle disease, heart valve problems, and congenital heart defects, are included in this disease definition. Today, researchers in the field of cardiovascular disease are using approaches based on diagnosis-oriented machine learning. In this study, feature extraction is performed for the detection of cardiovascular disease, and classification processes are performed with a Support Vector Machine, Naive Bayes, Decision Tree, K-Nearest Neighbor, Bagging Classifier, Random Forest, Gradient Boosting, Logistic Regression, AdaBoost, Linear Discriminant Analysis and Artificial Neural Networks methods. A total of 918 observations from Cleveland, Hungarian Institute of Cardiology, University Hospitals of Switzerland, and Zurich, VA Medical Center were included in the study. Principal Component Analysis, a dimensionality reduction method, was used to reduce the number of features in the dataset. In the experimental findings, feature increase with artificial variables was also performed and used in the classifiers in addition to feature reduction. Support Vector Machines, Decision Trees, Grid Search Cross Validation, and existing various Bagging and Boosting techniques have been used to improve algorithm performance in disease classification. Gaussian Naïve Bayes was the highest-performing algorithm among the compared methods, with 91.0% accuracy on a weighted average basis as a result of a 3.0% improvement.

Machine learning and deep learning models based grid search cross validation for short-term solar irradiance forecasting

In late 2023, the United Nations conference on climate change (COP28), which was held in Dubai, encouraged a quick move from fossil fuels to renewable energy. Solar energy is one of the most promising forms of energy that is both sustainable and renewable. Generally, photovoltaic systems transform solar irradiance into electricity. Unfortunately, instability and intermittency in solar radiation can lead to interruptions in electricity production. The accurate forecasting of solar irradiance guarantees sustainable power production even when solar irradiance is not present. Batteries can store solar energy to be used during periods of solar absence. Additionally, deterministic models take into account the specification of technical PV systems and may be not accurate for low solar irradiance. This paper presents a comparative study for the most common Deep Learning (DL) and Machine Learning (ML) algorithms employed for short-term solar irradiance forecasting. The dataset was gathered in Islamabad during a five-year period, from 2015 to 2019, at hourly intervals with accurate meteorological sensors. Furthermore, the Grid Search Cross Validation (GSCV) with five folds is introduced to ML and DL models for optimizing the hyperparameters of these models. Several performance metrics are used to assess the algorithms, such as the Adjusted R2 score, Normalized Root Mean Square Error (NRMSE), Mean Absolute Deviation (MAD), Mean Absolute Error (MAE) and Mean Square Error (MSE). The statistical analysis shows that CNN-LSTM outperforms its counterparts of nine well-known DL models with Adjusted R2 score value of 0.984. For ML algorithms, gradient boosting regression is an effective forecasting method with Adjusted R2 score value of 0.962, beating its rivals of six ML models. Furthermore, SHAP and LIME are examples of explainable Artificial Intelligence (XAI) utilized for understanding the reasons behind the obtained results.

Development of laminar burning velocity prediction model and correlation of iso-octane air mixtures using artificial neural network

Surrogate fuels provide an economical alternative for forecasting the combustion properties of transportation fuels like diesel, gasoline, and kerosene. Iso-octane (2,2,4-trimethylpentane), a primary reference fuel for gasoline, is extensively used as a surrogate component. This study utilizes a Feed-Forward Artificial Neural Network (FFANN) with back-propagation (BP) to predict the laminar burning velocity (LBV) of iso-octane/air mixtures. The ANN model was developed using a dataset of 6339 data points, including 3788 experimental data points from literature since 2004 and 2551 simulation data points from reduced kinetic reaction mechanism (RKM) CHEMKIN simulations. The grid search cross-validation (CV) method was employed to optimize the ANN hyperparameters. Implemented in Python using Keras, the ANN model addresses research gaps by forecasting LBV for hydrocarbons beyond n-heptane and modelling LBV under conditions reflective of actual engine operations. Unlike prior studies, we optimized various ML models, their complexity, size, and hyperparameters to achieve high prediction accuracy. We also integrated a hybrid model combining Particle Swarm Optimization (PSO) with Genetic Algorithms (GA) for hyperparameter optimization, ensuring efficient configuration of the ANN. The constructed ANN model was compared to other ML models, including generalized linear regression (GLR), support vector machine (SVM), random forest (RF), and XGBoost regression. For the testing set (20 % of the total dataset), the ANN model outperformed all other ML models and empirical correlations, achieving a coefficient of determination (R2) of 0.9903, root mean square error (RMSE) of 1.911, and mean absolute error (MAE) of 1.206. Optimizing the ANN model with PSO further enhanced prediction accuracy, achieving a correlation coefficient of 0.9973 and a reduced mean absolute error of 0.753. To evaluate the ANN model's predictive ability, a reduced mechanism from the Lawrence Livermore National Laboratory (LLNL) was used. Compared to the LLNL RKM, the ANN predicted values showed lower percentage deviation from experimental data. Additionally, computation cost comparisons revealed that while RKM simulations in CHEMKIN took 244.2 s per case, the PSO-optimized ANN model required only 900 s for 150 cases. A 16-term correlation for laminar burning velocity (LBV) was derived from ANN predictions, serving as a practical tool to predict LBV based on pressure, temperature, and equivalence ratio. Unlike existing literature correlations, this newly developed correlation is valid across a wide range of operating conditions, offering a fundamental database for real-time combustion applications.

Toxicity Prediction for Immune Thrombocytopenia Caused by Drugs Based on Logistic Regression with Feature Importance

Background: One of the problems in drug discovery that can be solved by artificial intelligence is toxicity prediction. In drug-induced immune thrombocytopenia, toxicity can arise in patients after five to ten days by significant bleeding caused by drugdependent antibodies. In clinical trials, when this condition occurs, all the drugs consumed by patients should be stopped, although sometimes this is not possible, especially for older patients who are dependent on their medication. Therefore, being able to predict toxicity in drug-induced immune thrombocytopenia is very important. Computational technologies, such as machine learning, can help predict toxicity better than empirical techniques owing to the lower cost and faster processing. Objective: Previous studies used the KNN method. However, the performance of these approaches needs to be enhanced. This study proposes a Logistic Regression to improve accuracy scores. Methods: In this study, we present a new model for drug-induced immune thrombocytopenia using a machine learning method. Our model extracts several features from the Simplified Molecular Input Line Entry System (SMILES). These features were fused and cleaned, and the important features were selected using the SelectKBest method. The model uses a Logistic Regression that is optimized and tuned by the Grid Search Cross Validation. Results: The highest accuracy occurred when using features from PADEL, CDK, RDKIT, MORDRED, BLUEDESC combinations, resulting in an accuracy of 80%. Conclusion: Our proposed model outperforms previous studies in accuracy categories. The information and source code is accessible online at Github: https://github.com/Osphanie/Thrombocytopenia

Machine Learning for Mapping and Forecasting Poverty in North Sumatera: A Data-Driven Approach

Discussing poverty is crucial because it affects many facets of society, including socioeconomic disparity, crime, and the inability to obtain high-quality education. One of the provinces with the highest poverty rate in Indonesia is North Sumatra. A strategy is required to gather accurate data to effectively reduce poverty. Poverty mapping and prediction were conducted in North Sumatra to get a precise spatial distribution of poverty, the operation of the poverty model, and forecasting using machine learning (ML). Poverty prediction was conducted using a random forest (RF) algorithm and poverty mapping was conducted using the K-Means algorithm. The poverty mapping showed a significant inertia value decline in the third and fourth clusters of the elbow graph. The third cluster (0.313) was superior to the fourth cluster (0.244) in the silhouette index. Thus, there were three poverty clusters - low, medium, and high - that were used in the model. The best model was created using the grid search cross-validation, while the best prediction results were created using the RF algorithm, with the following parameters: n-estimator = 50, max depth = 10, min samples split = 2, and min samples leaf = 1. The mean squared error (MSE) of the RF model's predictions was 0.002617, or satisfactory precision.

Optimizing Rain Prediction Model Using Random Forest and Grid Search Cross-Validation for Agriculture Sector

Agriculture, as a sector that is highly influenced by weather conditions, faces challenges due to increasingly unpredictable changes in weather patterns. The aim of this research is to create an optimal rainfall prediction model to help farmers create irrigation schedules, use fertilizer, and planting schedules, and protect plants from extreme weather events. The method used in this research to obtain the best rain prediction model is to use the random forest algorithm and the grid search cross-validation algorithm. Random Forest, known for its robustness and accuracy, emerged as a suitable algorithm for predicting rain. utilizing a substantial dataset from the West Nusa Tenggara Meteorology, Climatology, and Geophysics Agency covering the period 2000 to 2023. The data is then processed first to ensure its readiness for use. This process involves removing outlier data points, empty data entries, and unused features. After the preprocessing stage, the data underwent training using the Random Forest algorithm, resulting in an R-squared value of 0.1334. To obtain the optimal model, Grid Search Cross Validation is used. The results of this research obtained the best rain prediction model with an R-squared value of 0.0268. This model will be used to predict rain in the agricultural sector. This research concludes that we can get the best rain prediction model by combining Random Forest and Gird Search Cross-Validation. For further research, we can compare other rain prediction methods, add features, and combine datasets from a wider area.

Immunotherapy toxicity prediction in patients with melanoma using machine learning algorithms.

e21567 Background: Immune checkpoint inhibitor (ICI) related toxicity is common in melanoma patients, but identifying who will experience toxicity can be challenging. Precision medicine tools that accurately predict ICI toxicity could improve patient outcomes. This study aimed to use Machine Learning (ML) to predict ICI toxicity in patients with melanoma. Methods: 384 datasets were available for patients started on immunotherapy between 2014-2023 in a single, large regional cancer center in Kent, U.K. Raw data was preprocessed using a standard scaling function and one hot encoding, followed by SMOTE to balance the imbalanced classes. Six ML algorithms were developed using 80% of the training data, tested on 20% of validation data and used the Grid Search Cross-Validation technique for hyperparameter optimization. Shapley Additive Explanations (SHAP) explainable artificial intelligence was used to interpret the toxicity prediction model to improve the interpretation and transparency of the decision boundary. Results: Of the 384 patients, 112 patients (29%) had completely resected disease and then had adjuvant treatment while 272 (71%) were unresectable or had metastatic disease and had palliative treatment intent. In the metastatic setting, the commonest immunotherapy regimen was Pembrolizumab (155, 57%), followed by Ipilimumab/Nivolumab (85, 31%). The commonest regimen in the adjuvant setting was Pembrolizumab (86, 77%). 95 patients (25%) experienced ICI-related toxicity. The number of patients with Grades 1-4 toxicity was 2 ,4, 18 and 4 respectively, the remaining had unspecified toxicity grades. The commonest class of toxicity (CTCAE v5) was gastrointestinal (36, 38%), followed by endocrine (20, 21%) and skin (19, 20%). Linear Regression and Gaussian Naïve Bayes predicted toxicity with the most accuracy, 92% (Table 1). The model showed that increasing age, female gender and not receiving Nivolumab predicted toxicity. Regardless of the regimen or treatment intent, our ML model could also predict immunotherapy response with 90% accuracy. Conclusions: These ML algorithms used clinically available data to predict ICI toxicity accurately. Key predictors of toxicity included increasing age, female gender and not receiving Nivolumab in the setting of both adjuvant and palliative intent. Future work will aim to externally validate these models in other centers. We will also explore if models could be trained for use in patients treated with nivolumab in combination with new anti-LAG-3(relatlimab). [Table: see text]

SVM Optimization with Grid Search Cross Validation for Improving Accuracy of Schizophrenia Classification Based on EEG Signal

The advantage of the Support Vector Machine (SVM) is that it can solve classification and regression problems both linearly and non-linearly. SVM also has high accuracy and a relatively low error rate. However, SVM also has weaknesses, namely the difficulty of determining optimal parameter values, even though setting exact parameter values affects the accuracy of SVM classification. Therefore, to overcome the weaknesses of SVM, optimizing and finding optimal parameter values is necessary. The aim of this research is SVM optimization to find optimal parameter values using the Grid Search Cross-Validation method to increase accuracy in schizophrenia classification. Experiments show that optimization parameters always find a nearly optimal combination of parameters within a specific range. The results of this study show that the level of accuracy obtained by SVM with the grid search cross-validation method in the schizophrenia classification increased by 9.5% with the best parameters, namely C = 1000, gamma = scale, and kernel = RBF, the best parameters were applied to the SVM algorithm and obtained an accuracy of 99.75%, previously without optimizing the accuracy reached 90.25%. The optimal parameters of the SVM obtained by the grid search cross-validation method with a high degree of accuracy can be used as a model to overcome the classification of schizophrenia.

Utilizing Optimized Machine Learning Techniques to Predict the Compressive Strength of Concrete through Non-Destructive Testing Methodologies

Background:: Examining the concrete quality in its original location and optimizing machine learning models for precise forecasting of concrete compressive strength(fc) is crucial. Current research advocates the fine tuning of hyperparameters within machine learning methodologies in tandem with non-destructive testing techniques to forecast the compressive strength of concrete. Objective:: This study aimsto incorporate age as a crucial factor by utilizing data spanning from 3 days to 365 days. This approach enhances the study’s applicability for real-time forecasting purposes. Methods:: In the methodology of this current research, three machine learning (ML) models— specifically, Multi-Linear Regression (MLR), Decision Tree Regressor (DTR), and Random Forest Regressor (RFR)—are introduced within the context of age as a significant factor influencing measurements obtained from the Rebound Hammer (RN) and Ultra Sonic Pulse Velocity (UPV). These ML models were sequentially applied, followed by a meticulous process of hyperparameter finetuning conducted through grid search Cross-Validation (CV). To gain insights into the predictive results, the study also employed SHapley Additive exPlanations (SHAP) for interpretation purposes. Results:: The results of this study reveal the development of an empirical relationship using Multi- Linear Regression, which yielded an R2 value of 0.88. Furthermore, the evaluation showed that Random Forest Regression outperformed other models with an R2 value of 0.95 in the training and 0.92 in the testing datasets. These models hold promise for facilitating decisions about qualitative analyses based on UPV and Rebound Hammer measurements relative to the age of the concrete. Rigorous validation of the models was conducted through standard cross-validation techniques. Conclusion:: The research has created and validated hyper tunned machine learning models with the help of grid search cross-validation function, with Random Forest Regression being the most effective. These models can potentially guide decisions regarding qualitative analyses using UPV and Rebound Hammer measurements concerning concrete age. They provide a valuable tool for on-site assessments in construction and structural evaluations. The primary objective of the research is to introduce age as a significant feature. To achieve this, data ranging from 3 days to 365 days was integrated. This inclusion aims to enhance real-time decision-making in construction processes, facilitating actions like the prompt removal of formwork in high-speed construction projects.

Predictive modeling of multi-class diabetes mellitus using machine learning and filtering iraqi diabetes data dynamics.

Diabetes is a persistent metabolic disorder linked to elevated levels of blood glucose, commonly referred to as blood sugar. This condition can have detrimental effects on the heart, blood vessels, eyes, kidneys, and nerves as time passes. It is a chronic ailment that arises when the body fails to produce enough insulin or is unable to effectively use the insulin it produces. When diabetes is not properly managed, it often leads to hyperglycemia, a condition characterized by elevated blood sugar levels or impaired glucose tolerance. This can result in significant harm to various body systems, including the nerves and blood vessels. In this paper, we propose a multiclass diabetes mellitus detection and classification approach using an extremely imbalanced Laboratory of Medical City Hospital data dynamics. We also formulate a new dataset that is moderately imbalanced based on the Laboratory of Medical City Hospital data dynamics. To correctly identify the multiclass diabetes mellitus, we employ three machine learning classifiers namely support vector machine, logistic regression, and k-nearest neighbor. We also focus on dimensionality reduction (feature selection-filter, wrapper, and embedded method) to prune the unnecessary features and to scale up the classification performance. To optimize the classification performance of classifiers, we tune the model by hyperparameter optimization with 10-fold grid search cross-validation. In the case of the original extremely imbalanced dataset with 70:30 partition and support vector machine classifier, we achieved maximum accuracy of 0.964, precision of 0.968, recall of 0.964, F1-score of 0.962, Cohen kappa of 0.835, and AUC of 0.99 by using top 4 feature according to filter method. By using the top 9 features according to wrapper-based sequential feature selection, the k-nearest neighbor provides an accuracy of 0.935 and 1.0 for the other performance metrics. For our created moderately imbalanced dataset with an 80:20 partition, the SVM classifier achieves a maximum accuracy of 0.938, and 1.0 for other performance metrics. For the multiclass diabetes mellitus detection and classification, our experiments outperformed conducted research based on the Laboratory of Medical City Hospital data dynamics.

Predicting the hydraulic response of critical transport infrastructures during extreme flood events

Understanding the effects of extreme floods on critical infrastructures such as bridges is paramount for ensuring safety and resilient design in the face of climate change and extreme events. This study develops robust computational and predictive modeling tools for assessing the impacts of extreme floods on the hydraulic response and structural resilience of bridges. A computational fluid dynamic (CFD) model utilizing RANS equations and k-ω Shear Stress Transport (SST) for simulating supercritical flows is adopted to compute hydrodynamic pressures and the water levels on bridge piers of cylindrical and rectangular shapes during a flood event. The CFD model is validated based on the case study data obtained from the Haj Omran Bridge, built on the Khorramabad River in Iran. The numerical simulations consider hydrological conditions and exclude geotechnical parameters and abutment damages. The numerical results are evaluated based on well-established design guidelines. Machine learning techniques, including Extreme Gradient Boosting (XGBoost), Random Forest (RF), and Support Vector Regression (SVR), optimized with Grid Search Cross-Validation (GSCV), are adopted to enhance the accuracy of hydrodynamic pressure forecasting at bridge piers. The XGBoost model exhibits superior performance (R2 = 0.908, RMSE = 0.0279, and E = 3.41%) compared to the RF and SVR models. All the estimated pressure data by XGBoost falls within ±6 percent error lines, highlighting the model's robustness for out-of-range hydrodynamic pressure prediction. Additionally, an optimized Long Short-Term Memory (LSTM) model is adopted to effectively predict free surface flow profiles (i.e. flood depth) over the bridge (R2 = 0.937 and RMSE = 0.083), demonstrating its potential for practical applications of flood depth predictions over bridge infrastructures. The proposed methodological framework outlined in this study can facilitate modeling the impacts of extreme floods on bridges, enabling robust climate resilience assessment of critical infrastructures.

Survival Prediction of Children after Bone Marrow Transplant Using Machine Learning Algorithms

Bone marrow is the source of many blood-related diseases, such as blood cancers, and Bone Marrow Transplantation (BMT), also known as Hematopoietic Stem Cell Transplantation (HSCT), is a life-saving surgical procedure. However, this treatment is associated with a high risk of mortality. Predicting survival after BMT is therefore essential for effective and accurate treatment. BMT is considered a treatment-related mortality due to several primary causes of death such as infections, toxicity, and Graft-versus-Host Disease (GvHD) that occur after treatment. In addition, several risk factors affect the success of BMT and long-term survival after treatment. Therefore, there is a need for a prediction system based on machine learning techniques that can predict whether the patient will survive after BMT or not, which will definitely help the physicians to make the right decisions before performing the surgery for the patient. In this paper, using a publicly available BMT dataset from the University of California, Irvine ML repository (UCI ML repository), different machine learning models were investigated to predict the survival status of children undergoing BMT treatment. In particular, Random Forest (RF), Bagging Classifier, Extreme Gradient Boost (XGBoost), Adaptive Boosting (AdaBoost), Decision Tree (DT), Gradient Boost (GB), and K-Nearest Neighbors (KNN) were trained on the given dataset. The dataset consists of 45 variables after applying a series of preprocessing steps and removing the multicollinearity features based on the correlation heat map. Then, a feature engineering and modelling step was applied to identify the most significant features, followed by the use of machine learning models to simplify the overall classification process. It’s important to note that the most important features obtained by DT and those obtained by GB were the most suitable for training the Bagging classifier and the KNN model, respectively. In addition to that, hyper-parameters optimization using Grid Search Cross-Validation (GSCV) was applied to both approaches to improve the accuracy of the survival prediction. RF, AdaBoost, GB, and Bagging techniques have achieved the best accuracy of 97.37%

High precision and fast classification of different dimensions of Baijiu using an OptGSCV quadratic optimization network combined with AS-LIBS

For the traditional Baijiu qualitative analysis problem, a high-precision fast classification method for different dimensional Baijiu based on AS-LIBS combined with Optimized Grid Search Cross-Validation (Opt-GSCV) is proposed.

Stock Price Time Series Data Forecasting Using the Light Gradient Boosting Machine (LightGBM) Model

In the world of stock investment, one of the things that commonly happens is stock price fluctuations or the ups and downs of stock prices. As a result of these fluctuations, many novice investors are afraid to play stocks. However, on the other hand, stocks are a type of investment that can be relied upon during disasters or economic turmoil, such as in 2019, namely the Covid-19 pandemic. For stock price fluctuations to be estimated by investors, it is necessary to carry out a forecasting activity. This study builds stock price forecasting using the Light Gradient Boosting Machine (LightGBM) algorithm, which has high accuracy and efficiency. To forecast stock price time series, the model used is the LightGBM ensemble. At the same time, they were optimizing the determination of hyperparameters using Grid Search Cross Validation (GSCV). This study will also compare the LGBM algorithm with other algorithms to see which model is optimal in forecasting price stock data. In this study, the test used the RMSE metric by comparing the original data (testing data) with the predicted results. The experimental results show that the LightGBM model can compete with and outperform boosting-based forecasting models like XGBoost, AdaBoost, and CatBoost. In comparing forecasting models, the same dataset is used so that the results are accurate, and the comparisons are equivalent. In future research, paying attention to the data during pre-processing is necessary because it has many outliers. In addition, it is necessary to include exogenous variables and external variables, which are determined to involve many parties.

Stock Price Time Series Data Forecasting Using the Light Gradient Boosting Machine (LightGBM) Model

In the world of stock investment, one of the things that commonly happens is stock price fluctuations or the ups and downs of stock prices. As a result of these fluctuations, many novice investors are afraid to play stocks. However, on the other hand, stocks are a type of investment that can be relied upon during disasters or economic turmoil, such as in 2019, namely the Covid-19 pandemic. For stock price fluctuations to be estimated by investors, it is necessary to carry out a forecasting activity. This study builds stock price forecasting using the Light Gradient Boosting Machine (LightGBM) algorithm, which has high accuracy and efficiency. To forecast stock price time series, the model used is the LightGBM ensemble. At the same time, they were optimizing the determination of hyperparameters using Grid Search Cross Validation (GSCV). This study will also compare the LGBM algorithm with other algorithms to see which model is optimal in forecasting price stock data. In this study, the test used the RMSE metric by comparing the original data (testing data) with the predicted results. The experimental results show that the LightGBM model can compete with and outperform boosting-based forecasting models like XGBoost, AdaBoost, and CatBoost. In comparing forecasting models, the same dataset is used so that the results are accurate, and the comparisons are equivalent. In future research, paying attention to the data during pre-processing is necessary because it has many outliers. In addition, it is necessary to include exogenous variables and external variables, which are determined to involve many parties.

Prediction of Biodiesel Yield Employing Machine Learning: Interpretability Analysis via Shapley Additive Explanations

Bioenergy is a sustainable alternative to conventional energy sources. However, production is limited by the complexities of the process and is also time consuming. Recent advancements in artificial intelligence and machine learning offer promising opportunities for streamlining bioenergy conversion processes. This paper aimed to develop a generic model for predicting biodiesel yield percentages from various biomass derived feedstocks through transesterification reactions. The biodiesel yield data and relevant features and properties of the feedstocks are collected from open literature sources. This work mainly focuses on establishing a generic model framework for biodiesel yield prediction. This involves data preprocessing techniques, machine learning model selection, and hyperparameter tuning. The grid search cross-validation was employed to optimize the CatBoost regressor, resulting in a prediction model with a root mean squared error value of 4.288. Moreover, the study conducted SHapley Additive exPlanations analysis to gain insights into the influence of individual data points on the prediction model. This analysis provided valuable insights into the impact of different variables on biodiesel yield prediction. Overall, this research presents a comprehensive approach to predicting biodiesel yield using machine learning techniques and highlights the effectiveness of the whale optimization algorithm for model optimization. The findings contribute to advancing the understanding of the factors influencing biodiesel production and provide valuable insights for optimizing the transesterification process.

Identification of Shale Lithofacies from FMI Images and ECS Logs Using Machine Learning with GLCM Features

The identification of sedimentary structures in lithofacies is of great significance to the exploration and development of Paleogene shale in the Boxing Sag. However, due to the scale mismatch between the thickness of laminae and the vertical resolution of conventional wireline logs, the conventional lithofacies division method fails to realize the accurate classification of sedimentary structures and cannot meet the needs of reservoir research. Therefore, it is necessary to establish a lithofacies identification method with higher precision from advanced logs. In this paper, a method integrating the gray level co-occurrence matrix (GLCM) and random forest (RF) algorithms is proposed to classify shale lithofacies with different sedimentary structures based on formation micro-imager (FMI) imaging logging and elemental capture spectroscopy (ECS) logging. According to the characteristics of shale laminae on FMI images, GLCM, an image texture extraction tool, is utilized to obtain texture features reflecting sedimentary structures from FMI images. It is proven that GLCM can depict shale sedimentary structures efficiently and accurately, and four texture features (contrast, entropy, energy, and homogeneity) are sensitive to shale sedimentary structures. To accommodate the correlation between the four texture features, the random forest algorithm, which has been proven not to be affected by correlated input features, is selected for supervised lithofacies classification. To enhance the model’s ability to differentiate between argillaceous limestone and calcareous mudstone, the carbonate content and clay content calculated from the ECS logs are involved in the input features. Moreover, grid search cross-validation (CV) is implemented to optimize the hyperparameters of the model. The optimized model achieves favorable performance on training data, validation data, and test data, with average accuracies of 0.84, 0.79, and 0.76, respectively. This study also discusses the application of the classification model in lithofacies and production prediction.