Abstract

Understanding the relationship between probabilistic and deterministic prediction skills is of important significance for the study of seasonal forecasting and verification. Based on the Brier skill score methodology, we have previously found a theoretical relationship between the probabilistic resolution skill and the deterministic correlation (i.e., anomaly correlation; AC) skill and a lack of necessary or consistent relationship between the probabilistic reliability skill and the deterministic skill in dynamical seasonal prediction. Here, we further theoretically investigate the relationship between the probabilistic relative operating characteristic (ROC) skill and the deterministic skill. The ROC measures the discrimination attribute of probabilistic forecast quality, another important attribute besides the resolution and reliability. With some simplified assumptions, we first derive theoretical expressions for the hit and false-alarm rates that are basic ingredients for the ROC curve, then demonstrate a sole dependence of the ROC curve on the AC, and finally analytically derive a relationship between the related ROC score and the AC. Such a theoretically derived ROC-AC relationship is further examined using dynamical models’ ensemble seasonal hindcasts, which is well verified. The finding here along with our previous findings implies that the discrimination and resolution attributes of probabilistic seasonal forecast skill are intrinsically equivalent to the corresponding deterministic skill, while the reliability appears to be the fundamental attribute of the probabilistic skill that differs from the deterministic skill, which constitutes an understanding of the fundamental similarities and difference between the two types of seasonal forecasting skills and predictability and can offer important implications for the study of seasonal forecasting and verification.

Highlights

  • Seasonal climate prediction aims at predicting the anomalous climate conditions in the one or several seasons and its accuracy is extremely important for decision making and risk management

  • The diagnostic analysis in Yang et al (2018) confirmed that no necessary relationship exists between the probabilistic reliability and deterministic correlation skills, indicating that the reliability is a fundamental aspect of probabilistic forecast skill that differs from the deterministic skill in dynamical seasonal climate prediction

  • We further demonstrate in this subsection that hit rate (HR) and false-alarm rate (FAR) for individual pth fundamentally depend on the anomaly correlation (AC) skill as well as x∕ y and m, the theoretical relative operating characteristic (ROC) curve, which reflects the “entirety” of HRs versus FARs when the pth sequentially takes all the possible values, depends only on the AC

Read more

Summary

Introduction

Seasonal climate prediction aims at predicting the anomalous climate conditions in the one or several seasons and its accuracy is extremely important for decision making and risk management. The diagnostic analysis in Yang et al (2018) confirmed that no necessary relationship exists between the probabilistic reliability and deterministic correlation skills, indicating that the reliability is a fundamental aspect of probabilistic forecast skill that differs from the deterministic skill in dynamical seasonal climate prediction. Considering that the ROC skill reflects the discrimination, another important attribute of probabilistic skill in addition to the resolution and reliability, it is interesting and necessary to perform an in-depth investigation of its relationship with the deterministic skill from the theoretical point of view. This is the purpose of this study.

Description of the ROC skill metrics for probabilistic forecasts
Theoretical expressions for the HR and the FAR
Sole dependence of the ROC curve on the AC
Theoretical relationship between the ROCS and the AC
Verifying the theoretical consideration with GCM seasonal forecasts
Summary and discussion
F AR sth as
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call