Analysis of the relationship between LSTM network traffic flow prediction performance and statistical characteristics of standard and nonstandard data

Abstract

AbstractThe effectiveness of road traffic control systems can be increased with the help of a model that can accurately predict short‐term traffic flow. Therefore, the performance of the preferred approach to develop a prediction model should be evaluated with data sets with different statistical characteristics. Thus a correlation can be established between the statistical properties of the data set and the model performance. The determination of this relationship will assist experts in choosing the appropriate approach to develop a high‐performance short‐term traffic flow forecasting model. The main purpose of this study is to reveal the relationship between the long short‐term memory network (LSTM) approach's short‐term traffic flow prediction performance and the statistical properties of the data set used to develop the LSTM model. In order to reveal these relationships, two different traffic prediction models with LSTM and nonlinear autoregressive (NAR) approaches were created using different data sets, and statistical analyses were performed. In addition, these analyses were repeated for nonstandardized traffic data indicating unusual fluctuations in traffic flow. As a result of the analyses, LSTM and NAR model performances were found to be highly correlated with the kurtosis and skewness changes of the data sets used to train and test these models. On the other hand, it was found that the difference of mean and skewness values of training and test sets had a significant effect on model performance in the prediction of nonstandard traffic flow samples.