Prophet is one of the machine learning approximation methods that accommodate trends, seasonality, and holiday impacts in time series data. Generally, the performance of machine learning models can be improved by implementing hyperparameter tuning. This study investigates whether hyperparameter tuning can improve the model's performance. To show its effectiveness, the Prophet model constructed by parameter tuning is compared to the one with fixed parameter values (namely the default model) for both the original series and the Box-Cox transformed series in terms of mean absolute percentage error (MAPE). Based on the experimental results of the twenty-four daily electricity load time series in American Electric Power (AEP). This shows that parameter tuning successfully reduces the MAPE of the default model in the range of about 3-8% for training data. However, there is no guarantee for testing data. Although, in some cases, parameter tuning can reduce the MAPE value of the default model by up to 38%, in other cases, it actually increases the MAPE of the default model by almost 15%. The experiments on testing data also show that models built from transformed data do not necessarily produce more accurate forecast values than those built from the original data.
Read full abstract