The goal of this work was to create and assess machine-learning models for estimating the risk of budget overruns in developed projects. Finding the best model for risk forecasting required evaluating the performance of several models. Using a dataset of 177 projects took into account variables like environmental risks employee skill level safety incidents and project complexity. In our experiments, we analyzed the application of different machine learning models to analyze the risk for the management decision policies of developed organizations. The performance of the chosen model Neural Network (MLP) was improved after applying the tuning process which increased the Test R2 from −0.37686 before tuning to 0.195637 after tuning. The Support Vector Machine (SVM), Ridge Regression, Lasso Regression, and Random Forest (Tuned) models did not improve, as seen when Test R2 is compared to the experiments. No changes in Test R2’s were observed on GBM and XGBoost, which retained same Test R2 across different tuning attempts. Stacking Regressor was used only during the hyperparameter tuning phase and brought a Test R2 of 0. 022219.Decision Tree was again the worst model among all throughout the experiments, with no signs of improvement in its Test R2; it was −1.4669 for Decision Tree in all experiments arranged on the basis of Gender. These results indicate that although, models such as the Neural Network (MLP) sees improvements due to hyperparameter tuning, there are minimal improvements for most models. This works does highlight some of the weaknesses in specific types of models, as well as identifies areas where additional work can be expected to deliver incremental benefits to the structured applied process of risk assessment in organizational policies.
Read full abstract