Seamless Forecasts Research Articles

Generating synthetic rainfall fields by R‐vine copulas applied to seamless probabilistic predictions

AbstractMany post‐processing methods improve forecasts at individual locations but remove their correlation structure. However, this information is essential for forecasting larger‐scale events, such as the total precipitation amount over areas like river catchments, which are relevant for weather warnings and flood predictions. We propose a method to reintroduce spatial correlation into a post‐processed forecast using an R‐vine copula fitted to historical observations. The method rearranges predictions at individual locations and ensures that they still exhibit the post‐processed marginal distributions. It works similarly to well‐known approaches, like the “Schaake shuffle” and “ensemble copula coupling.” However, compared to these methods, which rely on a ranking with no ties at each considered location in their source for spatial correlation, the copula serves as a measure of how well a given arrangement compares with the observed historical distribution. Therefore, no close relationship is required between the post‐processed marginal distributions and the spatial correlation source. This is advantageous for post‐processed seamless forecasts in two ways. First, meteorological parameters such as the precipitation amount, whose distribution has an atom at zero, have rankings with ties. Second, seamless forecasts represent an optimal combination of their input forecasts and may spatially shifted from them at scales larger than the areas considered herein, leading to non‐reasonable spatial correlation sources for the well‐known methods. Our results indicate that the calibration of the combination model carries over to the output of the proposed model, that is, the evaluation of area predictions shows a similar improvement in forecast quality as the predictions for individual locations. Additionally, the spatial correlation of the forecast is evaluated with the help of object‐based metrics, for which the proposed model also shows an improvement compared to both input forecasts.

Data-Driven Global Subseasonal Forecast for Intraseasonal Oscillation Components

As a challenge in the construction of a “seamless forecast” system, improving the prediction skills of subseasonal forecasts is a key issue for meteorologists. In view of the evolution characteristics of numerical models and deep-learning models for subseasonal forecasts, as forecast times increase, the prediction skill for high-frequency components will decrease, as the lead time is already far beyond the predictability. Meanwhile, intraseasonal low-frequency components are essential to the change in general circulation on subseasonal timescales. In this paper, the Global Subseasonal Forecast Model (GSFM v1.0) first extracted the intraseasonal oscillation (ISO) components of atmospheric signals and used an improved deep-learning model (SE-ResNet) to train and predict the ISO components of geopotential height at 500 hPa (Z500) and temperature at 850 hPa (T850). The results show that the 10–30 day prediction performance of the SE-ResNet model is better than that of the model trained directly with original data. Compared with other models/methods, this model has a good ability to depict the subseasonal evolution of the ISO components of Z500 and T850. In particular, although the prediction results from the Climate Forecast System Version 2 have better performance through 10 days, the SE-ResNet model is substantially superior to CFSv2 through 10–30 days, especially in the middle and high latitudes. The SE-ResNet model also has a better effect in predicting planetary waves with wavenumbers of 3–8. Thus, the application of data-driven subseasonal forecasts of atmospheric ISO components may shed light on improving the skill of seasonal forecasts.

IMPROVER: The New Probabilistic Postprocessing System at the Met Office

Abstract The Met Office in the United Kingdom has developed a completely new probabilistic postprocessing system called IMPROVER to operate on outputs from its operational numerical weather prediction (NWP) forecasts and precipitation nowcasts. The aim is to improve weather forecast information to the public and other stakeholders while better exploiting the current and future generations of underpinning kilometer-scale NWP ensembles. We wish to provide seamless forecasts from nowcasting to medium range, provide consistency between gridded and site-specific forecasts, and be able to verify every stage of the processing. The software is written in a modern modular framework that is easy to maintain, develop, and share. IMPROVER allows forecast information to be provided with greater spatial and temporal detail and a faster update frequency than previous postprocessing. Independent probabilistic processing chains are constructed for each meteorological variable consisting of a series of processing stages that operate on predefined grids and blend outputs from several NWP inputs to give a frequently updated, probabilistic forecast solution. Probabilistic information is produced as standard, with the option of extracting a most likely or yes–no outcome if required. Verification can be performed at all stages, although it is only currently switched on for the most significant stages when run in real time. IMPROVER has been producing real-time output since March 2021 and became operational in spring 2022.

Seamless streamflow forecasting at daily to monthly scales: MuTHRE lets you have your cake and eat it too

Abstract. Subseasonal streamflow forecasts inform a multitude of water management decisions, from early flood warning to reservoir operation. Seamless forecasts, i.e. forecasts that are reliable and sharp over a range of lead times (1–30 d) and aggregation timescales (e.g. daily to monthly) are of clear practical interest. However, existing forecast products are often non-seamless, i.e. developed and applied for a single timescale and lead time (e.g. 1 month ahead). If seamless forecasts are to be a viable replacement for existing non-seamless forecasts, it is important that they offer (at least) similar predictive performance at the timescale of the non-seamless forecast. This study compares forecasts from two probabilistic streamflow post-processing (QPP) models, namely the recently developed seamless daily Multi-Temporal Hydrological Residual Error (MuTHRE) model and the more traditional (non-seamless) monthly QPP model used in the Australian Bureau of Meteorology's dynamic forecasting system. Streamflow forecasts from both post-processing models are generated for 11 Australian catchments, using the GR4J hydrological model and pre-processed rainfall forecasts from the Australian Community Climate and Earth System Simulator – Seasonal (ACCESS-S) numerical weather prediction model. Evaluating monthly forecasts with key performance metrics (reliability, sharpness, bias, and continuous ranked probability score skill score), we find that the seamless MuTHRE model achieves essentially the same performance as the non-seamless monthly QPP model for the vast majority of metrics and temporal stratifications (months and years). As such, MuTHRE provides the capability of seamless daily streamflow forecasts with no loss of performance at the monthly scale – the modeller can proverbially “have their cake and eat it too”. This finding demonstrates that seamless forecasting technologies, such as the MuTHRE post-processing model, are not only viable but also a preferred choice for future research development and practical adoption in streamflow forecasting.

Statistical Postprocessing for Weather Forecasts: Review, Challenges, and Avenues in a Big Data World

AbstractStatistical postprocessing techniques are nowadays key components of the forecasting suites in many national meteorological services (NMS), with, for most of them, the objective of correcting the impact of different types of errors on the forecasts. The final aim is to provide optimal, automated, seamless forecasts for end users. Many techniques are now flourishing in the statistical, meteorological, climatological, hydrological, and engineering communities. The methods range in complexity from simple bias corrections to very sophisticated distribution-adjusting techniques that incorporate correlations among the prognostic variables. The paper is an attempt to summarize the main activities going on in this area from theoretical developments to operational applications, with a focus on the current challenges and potential avenues in the field. Among these challenges is the shift in NMS toward running ensemble numerical weather prediction (NWP) systems at the kilometer scale that produce very large datasets and require high-density high-quality observations, the necessity to preserve space–time correlation of high-dimensional corrected fields, the need to reduce the impact of model changes affecting the parameters of the corrections, the necessity for techniques to merge different types of forecasts and ensembles with different behaviors, and finally the ability to transfer research on statistical postprocessing to operations. Potential new avenues are also discussed.

Development of a Seamless Forecast for Solar Radiation Using ANAKLIM++

A novel approach for a blending between nowcasting and numerical weather prediction (NWP) for the surface incoming shortwave radiation (SIS) for a forecast horizon of 1–5 h is presented in this study. The blending is performed with a software tool called ANAKLIM++ (Adjustment of Assimilation Software for the Reanalysis of Climate Data) which was originally designed for the efficient assimilation of two-dimensional data sets using a variational approach. A nowcasting for SIS was already presented and validated in earlier publications as seamless solar radiation forecast (SESORA). For our blending, two NWP models, namely the ICON (Icosahedral Non-hydrostatic model) from the German weather Service (DWD) and the IFS (Integrated Forecasting System) from the European Centre for Medium-Range Weather Forecasts (ECMWF), were used. The weights for the input data for ANAKLIM++ vary for every single forecast time and pixel, depending on the error growth of the nowcasting. The results look promising, since the root mean square error (RMSE) and mean absolute error (MAE) of the blending are smaller than the error measures of the nowcasting or NWP models, respectively.

A Technique for Seamless Forecast Construction and Validation from Weather to Monthly Time Scales

Abstract Seamless prediction means bridging discrete short-term weather forecasts valid at a specific time and time-averaged forecasts at longer periods. Subseasonal predictions span this time range and must contend with this transition. Seamless forecasts and seamless validation methods go hand-in-hand. Time-averaged forecasts often feature a verification window that widens in time with growing forecast leads. Ideally, a smooth transition across daily to monthly time scales would provide true seamlessness—a generalized approach is presented here to accomplish this. We discuss prior attempts to achieve this transition with individual weighting functions before presenting the two-parameter Hill equation as a general weighting function to blend discrete and time-averaged forecasts, achieving seamlessness. The Hill equation can be tuned to specify the lead time at which the discrete forecast loses dominance to time-averaged forecasts, as well as the swiftness of the transition with lead time. For this application, discrete forecasts are defined at any lead time using a Kronecker delta weighting, and any time-averaged weighting approach can be used at longer leads. Time-averaged weighting functions whose averaging window widens with lead time are used. Example applications are shown for deterministic and ensemble forecasts and validation and a variety of validation metrics, along with sensitivities to parameter choices and a discussion of caveats. This technique aims to counterbalance the natural increase in uncertainty with forecast lead. It is not meant to construct forecasts with the highest skill, but to construct forecasts with the highest utility across time scales from weather to subseasonal in a single seamless product.

The benefit of seamless forecasts for hydrological predictions over Europe

Abstract. Two different systems provide long-range forecasts at ECMWF. On the sub-seasonal timescale, ECMWF issues an extended-range ensemble prediction system (ENS-ER) which runs a 46-day forecast integration issued twice weekly. On longer timescales, the current seasonal forecasting system (SYS4) produces a 7-month outlook starting from the first of each month. SYS4 uses an older model version and has lower spatial and temporal resolution than ENS-ER, which is issued with the current operational ensemble forecasting system. Given the substantial differences between the ENS-ER and the SYS4 configurations and the difficulties of creating a seamless integration, applications that rely on weather forcing as input such as the European Flood Awareness System (EFAS) often follow the route of the creation of two separate systems for different forecast horizons. This study evaluates the benefit of a seamless integration of the two systems for hydrological applications and shows that the seamless system outperforms SYS4 in terms of skill for the first 4 weeks, but both forecasts are biased. The benefit of the new seamless system when compared to the seasonal forecast can be attributed to (1) the use of a more recent model version in the sub-seasonal range (first 46 days) and (2) the much more frequent updates of the meteorological forecast.

Blending a probabilistic nowcasting method with a high‐resolution numerical weather prediction ensemble for convective precipitation forecasts

AbstractA seamless prediction of convective precipitation for a continuous range of lead times from 0–8 h requires the application of different approaches. Here, a nowcasting method and a high‐resolution numerical weather prediction ensemble are combined to provide probabilistic precipitation forecasts. For the nowcast, an existing deterministic extrapolation technique was modified by the local Lagrangian method to calculate the probability of exceeding a threshold value in radar reflectivity. Numerical forecasts were obtained from an experimental high‐resolution ensemble that provides 20 different deterministic forecasts of synthetic radar reflectivity. Probabilistic information was calculated by different approaches from the ensemble output. The probabilistic forecasts based on the ensemble were calibrated with the reliability diagram statistics method. The skill of the probabilistic nowcasts and forecasts was evaluated using three quality measures. Finally, a seamless probabilistic forecast was generated as an additive combination of nowcast and forecast, using a weighting function based on their relative skills. The skill of the seamless forecast was greater than or equal to that of the nowcast or ensemble forecast in all quality measures and at all lead times. Copyright © 2011 Royal Meteorological Society