Using the R-MAPE index as a resistant measure of forecast accuracy.

Abstract

The mean absolute percentage error (MAPE) is probably the most widely used goodness-of-fit measure. However, it does not meet the validity criterion due to the fact that the distribution of the absolute percentage errors is usually skewed to the right, with the presence of outlier values. In these cases, MAPE overstates the corresponding population parameter. In this study, we propose an alternative index, called Resistant MAPE or R-MAPE based on the calculation of the Huber M-estimator, which allows overcoming the aforementioned limitation. The results derived from the application of Artificial Neural Network (ANN) and Autoregressive Integrated Moving Average (ARIMA) models are used to forecast a time series. The arithmetic mean, MAPE, overstates the corresponding population parameter, unlike R-MAPE, on a set of error distributions with a statistically significant right skew, as well as outlier values. Our results suggest that R-MAPE represents a suitable alternative measure of forecast accuracy, due to the fact that it provides a valid assessment of forecast accuracy compared to MAPE.