Evaluation of Probabilistic Forecasts of Extreme Cold Events in S2S Models

Abstract

The probabilistic prediction skill of the weekly forecasts of extreme cold events (ECE) is illustrated and measured in the form of the Brier Skill Score (BSS) and the area under Relative Operating Characteristics (ROC) curves based on the subseasonal-to-seasonal (S2S) prediction project database. The ROC scores show that six S2S models have the good potential predictability skill required for use in ECE probabilistic forecasts, and they were more useful than climatologic probabilistic models in creating forecasts of about 3–4 weeks in length. However, the BSS results show that the actual prediction skill of six models used in ECE probabilistic forecasts are different. The ECMWF model has a good performance, and its actual probabilistic prediction skill of ECE for forecasts of about 3–4 weeks in length was higher than those of climatology, which operates close to its potential predictability. The actual probabilistic prediction skill of the NCEP model for ECE was only about 2 weeks over the extra-tropics, and no skill was recorded over the tropics given its bad reliability, especially over the tropics. BoM, JMA, and CNRM models only have a 1-week actual prediction skill over the Northern Hemisphere extra-tropics, and they have no skill over the rest of the world’s land area. The CNR-ISAC model has a 1-week actual prediction skill over the extra-tropics and about 4 weeks over the tropics. There is still much room for improvement in the prediction ability of models used for ECE. MJO in tropical regions has an important influence on the probabilistic prediction skill of ECE required at middle and high latitudes. When there is an MJO in the initial conditions, the potential predictability and actual prediction skill of ECE probabilistic forecasts over North America in the 3rd week and over Europe in the 3rd–4th weeks are higher than those without MJO.