Deep Learning Algorithms for Addressing Overfitting and Biological Realism in Tree Taper and Volume Predictions

Abstract

This study addresses the challenges of overfitting and maintaining biological realism in Deep Learning Algorithms (DLAs), for predicting individual tree taper using stem diameters outside bark (DOB) and total tree volume (TTV). To this end, DLAs were trained using two different approaches: a “hyperparameter-optimized DLA,” which customizes specific hyperparameters such as learning rate and momentum rate, and a “regularization-optimized DLA,” which incorporates optimization techniques like early stopping with Root Mean Square Error (RMSE), L1 and L2 regularization, and dropout. Although obtaining the deterioration in predictive capabilities statistics from the taring dataset to the validation dataset by standard DLA with adaptive learning processes without customizing the hyperparameters and regularization parameters, the hyperparameter-optimized DLA with a momentum of 0.8, and a 7 # hidden layer for the TTV and regularization-optimized DLA with a dropout ratio of 0.000001, a 3 # hidden layer for the DOB demonstrated comparable predictive capabilities statistics across both training and validation datasets with generating biologically plausible predictions. Our results support that these hyperparameter-optimized and regularization-optimized DLAs, by improving the "black-box" nature of artificial intelligence, offer significant potential for enhanced interpretability and performance by improving the problem of overfitting and the violations biological realism in forest biometrics applications.