Short-Term Weather Forecast Skill of Artificial Neural Networks

Abstract

Abstract We evaluate the short-term weather forecast performance of three flavors of artificial neural networks (NNs): feed forward back propagation, radial basis function, and generalized regression. To prepare the application of the NNs to an operational setting, we tune NN hyperparameters using over two years of historical data. Five objective guidance products serve as predictors to the NNs: North American Mesoscale and Global Forecast System model output statistics (MOS) forecasts, the High-Resolution Rapid Refresh (HRRR) model, National Weather Service forecasts, and the National Blend of Models product. We independently test NN performance using 96 real-time forecasts of temperature, wind, and precipitation across 11 U.S. cities made during the WxChallenge, a weather forecasting competition. We demonstrate that all NNs significantly improve short-range weather forecasts relative to the traditional objective guidance aids used to train the networks. For example, 1-day maximum and minimum temperature forecast error is 20%–30% lower than MOS. However, NN improvement over multiple linear regression for short-term forecasts is not significant. We suggest this may be attributed to the small number of training samples, the operational nature of the experiment, and the short forecast lead times. Regardless, our results are consistent with previous work suggesting that applying NNs to model forecasts can have a positive impact on operational forecast skill and will become valuable tools when integrated into the forecast enterprise. Significance Statement We used approximately two years of historical weather data and objective forecasts for a number of cities to tune a series of artificial neural networks (NNs) to forecast 1-day values of maximum and minimum temperature, maximum sustained wind speed, and quantitative precipitation. We compare forecast error against common objective guidance and multiple linear regression. We found that the NNs exhibit about 25% lower error than common objective guidance for temperature forecasting and 50% lower error for wind speed. Our results suggest that NNs will be a valuable contributor to improving weather forecast skill when adopted into the existing forecast enterprise.