K-nearest Neighbor Regression Research Articles

Comparative Analysis of Machine Learning Algorithms: KNN, SVM, Decision Tree and Logistic Regression for Efficiency and Performance

This paper presents a comparative study of machine learning models namely K-Nearest Neighbors (KNN), Support Vector Machine (SVM), Decision Tree, and Logistic Regression on two datasets: 20Newsgroups and Wine datasets. Based on basic accuracy, and precision, and recall of the models, F1 measures were assessed. When compared with other classifiers such as KNN and Decisions Trees, SVM and Logistic regression gave better results especially in the case of the 20Newsgroups dataset dominated by textual high dimensional data. KNN had poor recall results and Decision Tree was moderate. In the Wine dataset, since the structure of data is comparatively less complex in our context then all the models yielded almost similar results with accuracy and precision factors very close to 1.0 which of course manifested that the choice of the model does not affect much on simple data. These results stress the importance of the choice of the appropriate model for tasks with a certain level of data complexity; detailed models show the greatest efficiency at the accomplishment of complicated tasks, though at the same time, they are not required for simple, structured data.

Establishing Optimal Machine Learning Models for Monitoring Water Quality in Vietnam’s Upper Ma River

This study aims to establish the optimal regression model for predicting total suspended solids (TSS) and Turbidity based on in situ data and spectral regions of Sentinel-2 images. Various machine learning models were evaluated, including Multilayer Perceptron Regression (MLPR), Random Forest Regression (RFR), AdaBoost Regression (ABR), Multiple Linear Regression (MLR), and K-Nearest Neighbors Regression (KNNR). These models were applied to different band combinations of spectral regions: visible (VIS), near-infrared (NIR), shortwave-infrared (SWIR), VIS+NIR (VNIR), and VIS+NIR+SWIR (VNIR+SWIR). The study results revealed that the MLR model, while not the best performer during training (R2 = 0.89 for TSS and R2 = 0.66 for turbidity), did not exhibit overfitting, with corresponding R² values in testing being 0.80 and 0.42, respectively. Variable selection for MLR models identified optimal spectral bands: B3, B5, B6, B8, B11, and B12 for TSS, and B4, B8, B11, and B12 for Turbidity. The final no-intercept multiple linear regression models achieved R2 = 0.88 for TSS and R2 = 0.62 for turbidity. Performance metrics for TSS were superior, with lower MAE, MSE, and RMSE compared to Turbidity. This study underscores the efficacy of using MLR models with selected spectral bands for accurate and generalizable predictions of TSS and turbidity.

Daily Runoff Forecasting Using Novel Optimized Machine Learning Methods

Accurate runoff forecasting is crucial for effective water resource management, yet existing models often face challenges due to the complexity of hydrological systems. This study addresses these challenges by introducing a novel bio-inspired metaheuristic algorithm, Artificial Rabbits Optimization (ARO), integrated with various machine learning (ML) models for runoff forecasting in the Carson and Chehalis River basins. The ARO-ML models are rigorously evaluated, demonstrating their superior ability to enhance forecasting accuracy compared to widely used ML techniques, including gradient boosting (GB), multi-layer perceptron (MLP), and K-nearest neighbor regression (KNN). In the Carson River, the GB model achieves the highest forecasting accuracy, which is significantly improved by ARO, resulting in a 24.8% reduction in root mean square error (RMSE). The MLP model also benefits notably from ARO, with RMSE improvements of 4.8% and a substantial 48.9% reduction in mean absolute error (MAE). The ARO-optimized KNN model shows exceptional performance, surpassing the baseline KNN during testing. In the Chehalis River Basin, ARO integration leads to substantial improvements in both GB and MLP models across various performance metrics during training and testing. Crucially, the results indicate that in both river basins, rainfall in preceding days has the most significant influence on streamflow forecasts, followed by air temperature. This study advances hydrological forecasting by validating the efficacy of ARO-ML models, offering a robust framework for enhanced predictive accuracy and providing deeper insights into the key drivers of streamflow in diverse hydrological contexts.

Predicting Housing Prices Using Supervised Machine Learning Models

Abstract: Variations in housing prices exert a profound impact on economic policies and personal financial decisions. This study aims to delve into the factors that affect housing prices and construct a predictive model using machine learning techniques. Machine learning enables computers to acquire knowledge from data and make predictions or decisions. This study forcasts house prices by analyzing the characteristics of data from Seattle, Washington using machine learning multiple linear regression, polynomial regression, and K-nearest neighbors regression (KNN). The findings of this investigation demonstrate that the polynomial regression model is the most accurate in predicting housing prices and can capture nonlinear relationships in the data more effectively than multiple linear regression and K-nearest neighbors regression. The main factors affecting housing prices are interior living space and the construction and design of buildings. These insights hold potential for enhancing government policies, facilitating effective land use decision-making by planners, and enabling investors to make more informed choices.

Non-Destructive Detection of Tea Polyphenols in Fu Brick Tea Based on Hyperspectral Imaging and Improved PKO-SVR Method

Tea polyphenols (TPs) are a critical indicator for evaluating the quality of tea leaves and are esteemed for their beneficial effects. The non-destructive detection of this component is essential for enhancing precise control in tea production and improving product quality. This study developed an enhanced PKO-SVR (support vector regression based on the Pied Kingfisher Optimization Algorithm) model for rapidly and accurately detecting tea polyphenol content in Fu brick tea using hyperspectral reflectance data. During this experiment, chemical analysis determined the tea polyphenol content, while hyperspectral imaging captured the spectral data. Data preprocessing techniques were applied to reduce noise interference and improve the prediction model. Additionally, several other models, including K-nearest neighbor (KNN) regression, neural network regression (BP), support vector regression based on the sparrow algorithm (SSA-SVR), and support vector regression based on particle swarm optimization (PSO-SVR), were established for comparison. The experiment results demonstrated that the improved PKO-SVR model excelled in predicting the polyphenol content of Fu brick tea (R2 = 0.9152, RMSE = 0.5876, RPD = 3.4345 for the test set) and also exhibited a faster convergence rate. Therefore, the hyperspectral data combined with the PKO-SVR algorithm presented in this study proved effective for evaluating Fu brick tea’s polyphenol content.

Machine Learning Modelling for Soil Moisture Retrieval from Simulated NASA-ISRO SAR (NISAR) L-Band Data

Soil moisture is a critical factor that supports plant growth, improves crop yields, and reduces erosion. Therefore, obtaining accurate and timely information about soil moisture across large regions is crucial. Remote sensing techniques, such as microwave remote sensing, have emerged as powerful tools for monitoring and mapping soil moisture. Synthetic aperture radar (SAR) is beneficial for estimating soil moisture at both global and local levels. This study aimed to assess soil moisture and dielectric constant retrieval over agricultural land using machine learning (ML) algorithms and decomposition techniques. Three polarimetric decomposition models were used to extract features from simulated NASA-ISRO SAR (NISAR) L-Band radar images. Machine learning techniques such as random forest regression, decision tree regression, stochastic gradient descent (SGD), XGBoost, K-nearest neighbors (KNN) regression, neural network regression, and multilinear regression were used to retrieve soil moisture from three different crop fields: wheat, soybean, and corn. The study found that the random forest regression technique produced the most precise soil moisture estimations for soybean fields, with an R2 of 0.89 and RMSE of 0.050 without considering vegetation effects and an R2 of 0.92 and RMSE of 0.042 considering vegetation effects. The results for real dielectric constant retrieval for the soybean field were an R2 of 0.89 and RMSE of 6.79 without considering vegetation effects and an R2 of 0.89 and RMSE of 6.78 with considering vegetation effects. These findings suggest that machine learning algorithms and decomposition techniques, along with a semi-empirical technique like Water Cloud Model (WCM), can be effective tools for estimating soil moisture and dielectric constant values precisely. The methodology applied in the current research contributes essential insights that could benefit upcoming missions, such as the Radar Observing System for Europe in L-band (ROSE-L) and the collaborative NASA-ISRO SAR (NISAR) mission, for future data analysis in soil moisture applications.

Computationally effective machine learning approach for modular thermal energy storage design

This research presents an innovative approach that integrates computational fluid dynamics (CFD) and machine learning (ML) for the design and optimization of thermal energy storage (TES) systems. Heat discharging parametric analyses conducted using CFD serve as the basis for training ML models, including linear regression, K-nearest neighbor (KNN) regression, gradient boost regression (GBR), XGBoost, LightGBM, and neural network (NN). NN emerges as the most suitable for predicting time-dependent variations of concrete and heat transfer fluid (HTF) temperatures. The trained ML models offer an efficient alternative to traditional CFD simulations, enabling the prediction of temperatures in concrete thermal energy storage (CTES) modules under varying inlet conditions, velocities, and time. Leveraging these ML models, the research demonstrates the design of modular CTES cascaded systems with multiple modules in series and parallel configurations, significantly reducing computational cost and time by over 99% compared to full-scale CFD simulations. For instance, in predicting 4-hour time-dependent thermal behavior, CFD takes 97 s per data point and 238,500 s for a single module, compared to ML models’ 16-20 ms per data point and around 290 s per module, indicating their efficiency and scalability in predicting thermal discharge, especially for modular CTES system design and optimization. ML models also demonstrate computational efficiency for designing CTES systems involving multiple modules, taking approximately 765 s - 1047 s for various CTES system configurations, indicating their effectiveness over CFD in predicting thermal discharge for modular CTES systems. The integration of CFD and ML provides a streamlined workflow for designing and optimizing CTES systems, reducing computational efforts, cost, and time. Moreover, this workflow can be updated with additional training data to implement it for unique modular designs with different conditions. Such a generalization of this ML-based approach makes it applicable to a wide range of thermal energy storage designs and geometries, offering a promising avenue for future research and development in the field of thermal energy storage.

Geotechnical and microstructural analysis of high-volume fly ash stabilized clayey soil and machine learning application

The weak soil stabilization using solid wastes is one of the most common solutions for improving geotechnical characteristics as well as for problematic waste dumping in landfills. The present experimental study aims to examine the effect of high-volume Class-F fly ash on the geotechnical and microstructural properties of clayey soil by adding them in ranges between 5 % and 50 %. The results show that as the amount of fly ash in clayey soil increases, properties like the specific gravity, plasticity index, permeability, optimum moisture content, maximum dry density and free swelling index improves. Moreover, these geotechnical properties were analyzed to develop machine learning models using three different algorithms, namely K-nearest neighbor regression, random forest, and support vector regression, for obtaining the optimum amount of fly ash contents in weak expansive soils. The predicted and experimental results found to be in close-relation for predicting the geotechnical behavior of modified clayey soil. Furthermore, the performance of the ML models degrades as the number of components reduces, with KNN regression consistently outperforming SVR and RF but suffering significantly with fewer components. The results of the testing set in the case of four components are MSE of 77, R² of 0.896, RMSE of 0.846, MAE of 0.327, and SEE of 0.858, indicating precise and consistent predictions. However, the prediction accuracy considering lesser components shows MSE as 262, R² as 0.648, MAE as 5.606, SEE as 16.707, and GPI as 1.056, confirming the elevated error rates. Overall, it has been concluded that combining comprehensive experimental work and machine learning techniques outperforms in enhancing geotechnical data processing, optimized waste contents in weak soils, improves sustainability in construction, saves resources, reduces the possibility of human mistakes, and increases reliability.

Surface quality evaluation through new optical imaging system-based objective speckle for additive manufactured titanium samples

Laser cladding is an effective additive manufacturing technology used for materials’ surface modification to enhance their surface and mechanical properties. Surface roughness is a crucial feature that affects the materials’ quality and lifespan. Additionally, it is a real indicator of hardness and wear resistance. Although the existing methods may precisely measure surface roughness, they require delicate adjustment, can damage surfaces, and have limited working distances. This study presents a novel optical imaging system to quantitatively estimate the quality modifications of additive manufacturing samples by measuring their surface roughness based on objective speckle and advanced multivariate analysis methods. The raw speckle patterns are generated from deposited layers on Ti6Al4V titanium alloys obtained at different laser processing parameters. The proposed analysis approach produces collections of local statistical matrices from which histogram features are extracted. Canonical correlation analysis (CCA) is then proposed to distinguish the most significant features. The correlation between the features (with and without applying CCA) and surface roughness is established by using two machine learning regression algorithms, nonlinear support vector regression (SVR), random forest regression (RF), and k-nearest neighbor regression (kNN). The results confirmed that combining RF and CCA provided a feasible regression model to estimate the surface roughness, with 0.998 for R2 in training samples and maximum values of 0.258, 0.484, and 4.593 %, respectively, for MAE, RMSE, and MAPE in test samples. This demonstrates that the proposed objective speckle imaging system is effective in estimating the quality modification of additive manufacturing samples by measuring their surface roughness.

Accelerating the design of multivariate Nb-Si based alloys with excellent strength and toughness matching through machine learning

The applications of Nb-Si-based alloys for new-generation engines are heavily influenced by their strength and toughness. Therefore, accurately and effectively predicting fracture toughness and compressive strength is crucial for accelerating the research and development of Nb-Si-based alloys. To achieve this, this work established a database based on Nb-Si-based alloy data fabricated by arc melting. It contains 259 samples with fracture toughness, of which 124 groups have compressive strength information. Machine learning methods were then employed to construct the prediction models between alloying elements, fracture toughness, and compressive strength. The result indicated that Random Forest (RF) and K-Nearest Neighbors (KNN) regression models were suitable for predicting Nb-Si-based alloys' fracture toughness and compressive strength, respectively, and the generalization ability was proved by the Nb-16Si-20Ti-xB4C (x= 0, 0.25, 0.50, 0.75, 1.0 at%) alloys fabricated in previous work. Therefore, the RF and KNN prediction models were used for the alloying design of five-element Nb-(16−20) Si-(20−24) Ti-(0−6) Al-(0−6) Cr alloys (at%) with compositions ranging from hypoeutectic to hypereutectic zones. Through these models and high-throughput optimization algorithms, Nb-16Si-24Ti-3Al-6Cr alloy with excellent strength and toughness matching was selected as the optimal material from 1225 candidate materials. Experimental results showed that the actual fracture toughness (11.9 MPa·m1/2) and compressive strength (2333.5 MPa) of Nb-16Si-24Ti-3Al-6Cr alloy matched the predicted values with less than 15 % errors.

Prediction of Steam Turbine Blade Erosion Using Computational Fluid Dynamics Simulation Data and Hierarchical Machine Learning

Abstract The information of the degree of blade erosion is vital for the efficient operation of steam turbines. However, it is nearly impossible to directly measure the degree of blade erosion during operation. Moreover, collecting sufficient data of eroded cases for predictive analysis is challenging. Therefore, this paper proposes a blade erosion prediction method using numerical simulation and machine learning. Pressure data of several blade erosion cases are collected from the numerical turbine simulation. The machine learning approach involves training on collected simulation data to predict the degree of erosion for the first-stage stator (1S) and the first-stage rotor blade (1R) from internal pressure data. The proposed erosion prediction model employs a two-step hierarchical approach. First, the proposed model predicts the 1S erosion degree using the k-nearest neighbor (k-NN) regression. Second, the proposed model estimates the 1R erosion degree with linear regression models. These models are tailored for each of the 1S erosion degrees, utilizing pressure data processed through fast Fourier transform (FFT). The evaluation shows that the proposed method achieves the prediction of the 1S erosion with a mean absolute error (MAE) of 0.000693 mm and the 1R erosion with an MAE of 0.458 mm. The evaluation results indicate that the proposed method can accurately capture the degree of turbine blade erosion from internal pressure data. As a result, the proposed method suggests that the erosion prediction method can be effectively used to determine the optimal timing for maintenance, repair, and overhaul (MRO).

Predict credit risk with XGBoost

The risk of credit loan exists when the bank issues a loan to the borrower, because the borrower has no way to repay the amount or defaults, which exposes the financial institution to the risk of loss. This causes financial institutions to suffer from effects that affect their creditworthiness, loss of capital and increased management and collection of loans. Factors of such risk include, but are not limited to, the creditworthiness of the borrower, the repayment ability of the borrower, and fluctuations in interest rates. With the development of economy, the credit loan risk of financial industry increases, and the harm is greater. After comparing KNN (K Nearest Neighbors), random forest and logistic regression using machine learning methods, we found that the model established by eXtreme Gradient Boosting method (XGBoost) can more accurately identify the risk of credit loans based on the characteristics of the borrower. Our research found that while the XGBoost model has better accuracy, there are also some areas that need improvement.

Seismic Response Prediction of Porcelain Transformer Bushing Using Hybrid Metaheuristic and Machine Learning Techniques: A Comparative Study

Although seismic response predictions are widely used for engineering structures, their applications in electrical equipment are rare. Overstressing at the bottom of the porcelain insulators during seismic events has made power transformer bushings in substations prone to failure. Thus, this paper proposed and compared six integrated machine learning (ML) models for seismic stress response predictions for porcelain transformer bushings using easily monitored acceleration responses. Metaheuristic algorithms such as particle swarm optimization were employed for architecture tuning. Prediction accuracies for stress response values and classifications were evaluated. Finally, shaking table tests and simulation analyses for a 1100 kV bushing were implemented to validate the accuracy of the six ML models. The results indicated that the proposed ML models can quickly forecast the maximum stress experienced by a porcelain bushing during earthquakes. Swarm intelligence evolutionary technologies could quickly and automatically aid in the retrofitting of architecture for the ML models. The K-nearest neighbor regression model had the best level of prediction accuracy among the six selected ML models for experimental and simulation validations. ML prediction models have clear benefits over frequently used seismic analytical techniques in terms of speed and accuracy for post-earthquake emergency relief in substations.

Random kernel k-nearest neighbors regression.

The k-nearest neighbors (KNN) regression method, known for its nonparametric nature, is highly valued for its simplicity and its effectiveness in handling complex structured data, particularly in big data contexts. However, this method is susceptible to overfitting and fit discontinuity, which present significant challenges. This paper introduces the random kernel k-nearest neighbors (RK-KNN) regression as a novel approach that is well-suited for big data applications. It integrates kernel smoothing with bootstrap sampling to enhance prediction accuracy and the robustness of the model. This method aggregates multiple predictions using random sampling from the training dataset and selects subsets of input variables for kernel KNN (K-KNN). A comprehensive evaluation of RK-KNN on 15 diverse datasets, employing various kernel functions including Gaussian and Epanechnikov, demonstrates its superior performance. When compared to standard KNN and the random KNN (R-KNN) models, it significantly reduces the root mean square error (RMSE) and mean absolute error, as well as improving R-squared values. The RK-KNN variant that employs a specific kernel function yielding the lowest RMSE will be benchmarked against state-of-the-art methods, including support vector regression, artificial neural networks, and random forests.

Predicting China’s Maize Yield Using Multi-Source Datasets and Machine Learning Algorithms

A timely and accurately predicted grain yield can ensure regional and global food security. The scientific community is gradually advancing the prediction of regional-scale maize yield. However, the combination of various datasets while predicting the regional-scale maize yield using simple and accurate methods is still relatively rare. Here, we have used multi-source datasets (climate dataset, satellite dataset, and soil dataset), lasso algorithm, and machine learning methods (random forest, support vector, extreme gradient boosting, BP neural network, long short-term memory network, and K-nearest neighbor regression) to predict China’s county-level maize yield. The use of multi-sourced datasets advanced the predicting accuracy of maize yield significantly compared to the single-sourced dataset. We found that the machine learning methods were superior to the lasso algorithm, while random forest, extreme gradient boosting, and support vector machine represented the most preferable methods for maize yield prediction in China (R2 ≥ 0.75, RMSE = 824–875 kg/ha, MAE = 626–651 kg/ha). The climate dataset contributed more to the prediction of maize yield, while the satellite dataset contributed to tracking the maize growth process. However, the methods’ accuracies and the dominant variables affecting maize growth varied with agricultural regions across different geographic locations. Our research serves as an important effort to examine the feasibility of multi-source datasets and machine learning techniques for regional-scale maize yield prediction. In addition, the methodology we have proposed here provides guidance for reliable yield prediction of different crops.

K-nearest neighbor based on exploratory data analysis of curriculum models of Chinese early childhood education

This research examines the unique Chinese approaches to implementing the Early Childhood Curriculum (ECC) in Shenzhen and Hong Kong, drawing on School-based Curriculum Development (SBCD) studies. A total of 200 administrators and teachers were interviewed in total, and transcripts from those interviews were examined, cross-checked, and assessed using document analysis and classroom observation. Through interviews that have been conducted by administrators and teachers analyzed by document analysis and classroom observation, the influence of Chinese culture on ECC implementation is explored using the Cultural-Historical Activity Theory (CHAT). An exploratory, inferential, and descriptive statistical approach evaluates the sociocultural mechanism of ECC in Chinese society. The proposed framework utilizes K-Nearest Neighbor (KNN) regression analysis to illustrate how social development leads to cultural fusion and conflicts. The overall sociocultural framework promotes cultural growth and inheritance in China's early childhood education settings.

Explainable deep learning for disease activity prediction in chronic inflammatory joint diseases

Analysing complex diseases such as chronic inflammatory joint diseases (CIJDs), where many factors influence the disease evolution over time, is a challenging task. CIJDs are rheumatic diseases that cause the immune system to attack healthy organs, mainly the joints. Different environmental, genetic and demographic factors affect disease development and progression. The Swiss Clinical Quality Management in Rheumatic Diseases (SCQM) Foundation maintains a national database of CIJDs documenting the disease management over time for 19’267 patients. We propose the Disease Activity Score Network (DAS-Net), an explainable multi-task learning model trained on patients’ data with different arthritis subtypes, transforming longitudinal patient journeys into comparable representations and predicting multiple disease activity scores. First, we built a modular model composed of feed-forward neural networks, long short-term memory networks and attention layers to process the heterogeneous patient histories and predict future disease activity. Second, we investigated the utility of the model’s computed patient representations (latent embeddings) to identify patients with similar disease progression. Third, we enhanced the explainability of our model by analysing the impact of different patient characteristics on disease progression and contrasted our model outcomes with medical expert knowledge. To this end, we explored multiple feature attribution methods including SHAP, attention attribution and feature weighting using case-based similarity. Our model outperforms temporal and non-temporal neural network, tree-based, and naive static baselines in predicting future disease activity scores. To identify similar patients, a k-nearest neighbours regression algorithm applied to the model’s computed latent representations outperforms baseline strategies that use raw input features representation.

Twin neural network improved k-nearest neighbor regression

Twin neural network improved k-nearest neighbor regression

Estimation of Chlorophyll Content in Apple Leaves Infected with Mosaic Disease by Combining Spectral and Textural Information Using Hyperspectral Images

Leaf chlorophyll content (LCC) is an important indicator of plant nutritional status and can be a guide for plant disease diagnosis. In this study, we took apple leaves infected with mosaic disease as a research object and extracted two types of information on spectral and textural features from hyperspectral images, with a view to realizing non-destructive detection of LCC. First, the collected hyperspectral images were preprocessed and spectral reflectance was extracted in the region of interest. Subsequently, we used the successive projections algorithm (SPA) to select the optimal wavelengths (OWs) and extracted eight basic textural features using the gray-level co-occurrence matrix (GLCM). In addition, composite spectral and textural metrics, including vegetation indices (VIs), normalized difference texture indices (NDTIs), difference texture indices (DTIs), and ratio texture indices (RTIs) were calculated. Third, we applied the maximal information coefficient (MIC) algorithm to select significant VIs and basic textures, as well as the tandem method was used to fuse the spectral and textural features. Finally, we employ support vector regression (SVR), backpropagation neural network (BPNN), and K-nearest neighbors regression (KNNR) methods to explore the efficacy of single and combined feature models for estimating LCC. The results showed that the VIs model (R2 = 0.8532, RMSE = 2.1444, RPD = 2.6179) and the NDTIs model (R2 = 0.7927, RMSE = 2.7453, RPD = 2.2032) achieved the best results among the single feature models for spectra and texture, respectively. However, textural features generally exhibit inferior regression performance compared to spectral features and are unsuitable for standalone applications. Combining textural and spectral information can potentially improve the single feature models. Specifically, when combining NDTIs with VIs as input parameters, three machine learning models outperform the best single feature model. Ultimately, SVR achieves the highest performance among the LCC regression models (R2 = 0.8665, RMSE = 1.8871, RPD = 2.7454). This study reveals that combining textural and spectral information improves the quantitative detection of LCC in apple leaves infected with mosaic disease, leading to higher estimation accuracy.

Advanced machine learning computations for estimation of hydrogen solubility in oil samples: Model comparisons and validation

For analyzing hydrogenation process for treatment of petroleum-based fuels, solubility of hydrogen in the feed should be well correlated. The main correlation factors are temperature and pressure which have a great effect on hydrogen solubility. This research paper presents the development of three models for predicting the solubility of hydrogen gas (H2) in diesel. Pressure and Temperature are the input parameters and solubility is single output. The models were fine-tuned using the Bat Algorithm (BA). The three models include Orthogonal Matching Pursuit Regression (OMP), K Nearest Neighbors Regression (KNN), and Tweedie Regression (TDR). The results of the study revealed that the OMP model achieved the highest level of accuracy, with an R2 score of 0.98, and the least RMSE and MAE error rates of 0.24 and 0.19, respectively. The KNN model also performed well with an R2 score of 0.92, an RMSE of 0.42, and an MAE of 0.37. The TDR model had the lowest accuracy compared to the other two models. These results imply that the OMP model is the most suitable one for predicting H2 solubility. The models can be used to enhance the efficiency of fuel production by providing accurate predictions of H2 solubility.