Ensemble Model Output Statistics Research Articles

Multivariate post‐processing of probabilistic sub‐seasonal weather regime forecasts

AbstractReliable forecasts of quasi‐stationary, recurrent, and persistent large‐scale atmospheric circulation patterns—so‐called weather regimes—are crucial for various socio‐economic sectors, including energy, health, and agriculture. Despite steady progress, probabilistic weather regime predictions still exhibit biases in the exact timing and amplitude of weather regimes. This study thus aims at advancing probabilistic weather regime predictions in the North Atlantic–European region through ensemble post‐processing. Here, we focus on the representation of seven year‐round weather regimes in sub‐seasonal to seasonal reforecasts of the European Centre for Medium‐Range Weather Forecasts (ECMWF). The manifestation of each of the seven regimes can be expressed by a continuous weather regime index, representing the projection of the instantaneous 500‐hPa geopotential height anomalies (A) onto the respective mean regime pattern. We apply a two‐step ensemble post‐processing involving first univariate ensemble model output statistics and second ensemble copula coupling, which restores the multivariate dependence structure. Compared with current forecast calibration practices, which rely on correcting the field by the lead‐time‐dependent mean bias, our approach extends the forecast skill horizon for daily/instantaneous regime forecasts moderately by 1 day (from 13.5 to 14.5 days). Additionally, to our knowledge our study is the first to evaluate the multivariate aspects of forecast quality systematically for weather regime forecasts. Our method outperforms current practices in the multivariate aspect, as measured by the energy and variogram score. Still, our study shows that, even with advanced post‐processing, weather regime prediction becomes difficult beyond 14 days, which likely points towards intrinsic limits of predictability for daily/instantaneous regime forecasts. The proposed method can easily be applied to operational weather regime forecasts, offering a neat alternative for cost‐ and time‐efficient post‐processing of real‐time weather regime forecasts.

Time‐series‐based ensemble model output statistics for temperature forecasts postprocessing

AbstractThe uncertainty in numerical weather prediction models is nowadays quantified by the use of ensemble forecasts. Although these forecasts are continuously improved, they still suffer from systematic bias and dispersion errors. Statistical postprocessing methods, such as the ensemble model output statistics (EMOS), have been shown to substantially correct the forecasts. This work proposes an extension of EMOS in a time‐series framework. Besides taking account of seasonality and trend in the location and scale parameter of the predictive distribution, the autoregressive process in the mean forecast errors or the standardized forecast errors is considered. The models can be further extended by allowing generalized autoregressive conditional heteroscedasticity. Furthermore, it is outlined how to use these models for arbitrary forecast horizons. To illustrate the performance of the suggested EMOS models in time‐series fashion, we present a case study for the postprocessing of 2 m surface temperature forecasts using five different lead times and a set of observation stations in Germany. The results indicate that the time‐series EMOS extensions are able to significantly outperform the benchmark models EMOS and autoregressive EMOS (AR‐EMOS) in most of the lead time–station cases.

Deterministic Forecasting and Probabilistic Post‐Processing of Short‐Term Wind Speed Using Statistical Methods

AbstractThere is a great need for an accurate short‐term wind speed forecast, and statistical forecasts have gained increased popularity for their computational efficiency and satisfactory skill. However, there has been no systematic research to fully explore the capabilities of statistical approaches and evaluate the applicability of probabilistic information from statistical ensemble. This study first compares the skills of different statistical methods, based on linear regression, machine learning (ML), and deep learning (DL), using three strategies (i.e., direct, recursive, and multi‐output) against the three operational numerical models and their bias‐corrections, for short‐term wind speed forecast over Pearl River Estuary during 2018–2021. Inter‐comparison between statistical forecasts reveals the dominant superiority of direct strategy. On this basis, Random Forest (RF) and Support Vector Machines (SVM) perform best compared to other statistical forecasts and bias correction of numerical forecasts throughout 48 hr lead time, while the performance of methods with simplified (linear) or more complex (DL) model structures degrades significantly. Moreover, the top 10 forecasts are utilized to account for forecast uncertainties but present a substantial under‐dispersed prediction. Two traditional methods and three modern methods are implemented to perform probabilistic post‐processing. Modern methods based on ML or DL present worse skills, while traditional methods, particularly for ensemble model output statistics, show added value in discriminating binary events due to limited enhancements in calibration. Overall, RF and SVM using direct strategy are highly recommended for short‐term wind speed forecasts, and efforts are ongoing to address the issues of strong wind prediction and ensemble calibration.

Calibrated EMOS: applications to temperature and wind speed forecasting

Ensembles of meteorological quantities obtained from numerical models can be used for forecasting weather variables. Unfortunately, such ensembles are often biased and under-dispersed and therefore need to be post-processed. Ensemble model output statistics (EMOS) is a widely used post-processing technique to reduce bias and dispersion errors of numerical ensembles. In the EMOS approach, a full probabilistic prediction is given in the form of a predictive distribution with parameters depending on the ensemble forecast members. Parameters are then estimated and substituted, thus obtaining a so-called estimative predictive distribution. Nonetheless, estimative distributions may perform poorly in terms of the coverage probability of the corresponding quantiles. This work proposes the use of predictive distributions based on a bootstrap adjustment of estimative predictive distributions, in the context of EMOS models. These distributions are calibrated, which means that the corresponding quantiles provide exact coverage probabilities, in contrast to the estimative distributions. The introduction of the bootstrap calibrated procedure for EMOS is the innovative aspect of this study. The performance of the suggested calibrated EMOS is evaluated in two simulation studies, comparing the different predictive distributions by means of the log-score, the continuous ranked probability score, and the coverage of the corresponding predictive quantiles. The results of these simulation studies show that the proposed calibrated predictive distributions improve estimative solutions, both reducing the mean scores and producing quantiles with exact coverage levels. The good performance of the new calibrated EMOS is further stressed in two real data applications, one about maximum daily temperatures at sites located in the Veneto region (Italy) and the other one about wind speed forecasts at weather stations over Germany.

A comparison of two statistical postprocessing methods for heavy‐precipitation forecasts over India during the summer monsoon

AbstractAccurate ensemble forecasts of heavy precipitation in India are vital for many applications and essential for early warning of damaging flood events, especially during the monsoon season. In this study we investigate to what extent Quantile Mapping (QM) and Ensemble Model Output Statistics (EMOS) statistical postprocessing reduce errors in precipitation ensemble forecasts over India, in particular for heavy precipitation. Both methods are applied to day‐1 forecasts at 12‐km resolution from the 23‐member National Centre for Medium Range Weather Forecasting (NCMRWF) global ensemble prediction system (NEPS‐G). By construction, QM leads to distributions close to the observed ones, while EMOS optimizes the ensemble spread, and it is not a priori clear which is better suited for practical applications. The methods are therefore compared with respect to several key aspects of the forecasts: local distributions, ensemble spread, and skill for forecasting precipitation amounts and the exceedance of heavy precipitation thresholds. The evaluation includes rank histograms, Continuous Ranked Probability Skill Scores (CRPSS), Brier Skill Scores (BSS), reliability diagrams, and receiver operating characteristic. EMOS performs best not only with respect to correcting under‐ or overdispersive ensembles, but also in terms of forecast skill for precipitation amounts and heavy precipitation events, with positive CRPSS and BSS in most regions (both up to about 0.4 in some areas), while QM in many regions performs worse than the raw forecast. QM performs best with respect to the overall local precipitation distributions. Which aspects of the forecasts are most relevant depends to some extent on how the forecasts are used. If the main criteria are the correction of under‐ or overdispersion, forecast reliability, match between the forecasted distribution for individual days and observations (CRPSS), and the skill in forecasting heavy‐precipitation events (BSS), then EMOS is the better choice for postprocessing NEPS‐G forecasts for short lead times.

Technical note: Accurate, reliable, and high-resolution air quality predictions by improving the Copernicus Atmosphere Monitoring Service using a novel statistical post-processing method

Abstract. Starting from the regional air quality forecasts produced by the Copernicus Atmosphere Monitoring Service (CAMS), we propose a novel post-processing approach to improve and downscale results on a finer scale. Our approach is based on the combination of ensemble model output statistics (EMOS) with a spatio-temporal interpolation process performed through the stochastic partial differential equation–integrated nested laplace approximation (SPDE-INLA). Our interpolation approach includes several spatial and spatio-temporal predictors, including meteorological variables. A use case is provided that scales down the CAMS forecasts on the Italian peninsula. The calibration is focused on the concentrations of several air quality pollutants (PM10, PM2.5, NO2, and O3) at a daily resolution from a set of 750 monitoring sites, distributed throughout the Italian country. Our results show the key role that conditioning variables play in improving the forecast capabilities of ensemble predictions, thus allowing for a net improvement in the calibration with respect to ordinary EMOS strategies. From a deterministic point of view, the performance of the predictive model shows a significant improvement in the performance of the raw ensemble forecast, with an almost-zero bias, significantly reduced root mean square errors, and correlations that are almost always higher than 0.9 for each pollutant; moreover, the post-processing approach is able to significantly improve the prediction of exceedances, even for very low thresholds, such as those recently recommended by the World Health Organisation. This is particularly significant if a forecasting approach is used to predict air quality conditions and plan adequate human health protection measures, even for low alert thresholds. From a probabilistic point of view, the quality of the forecast was verified in terms of reliability and credible intervals. After post-processing, the predictive probability density functions were sharp and much better calibrated than the raw ensemble forecast. Finally, we present some additional results based on a set of gridded (4 km × 4 km) maps covering the entire Italian country for the detection of areas where pollution peaks occur (exceedances of the current and/or proposed regulatory thresholds).

Land Subsidence Model Inversion with the Estimation of Both Model Parameter Uncertainty and Predictive Uncertainty Using an Evolutionary-Based Data Assimilation (EDA) and Ensemble Model Output Statistics (EMOS)

The nonlinearity nature of land subsidence and limited observations cause premature convergence in typical data assimilation methods, leading to both underestimation and miscalculation of uncertainty in model parameters and prediction. This study focuses on a promising approach, the combination of evolutionary-based data assimilation (EDA) and ensemble model output statistics (EMOS), to investigate its performance in land subsidence modeling using EDA with a smoothing approach for parameter uncertainty quantification and EMOS for predictive uncertainty quantification. The methodology was tested on a one-dimensional subsidence model in Kawajima (Japan). The results confirmed the EDA’s robust capability: Model diversity was maintained even after 1000 assimilation cycles on the same dataset, and the obtained parameter distributions were consistent with the soil types. The ensemble predictions were converted to Gaussian predictions with EMOS using past observations statistically. The Gaussian predictions outperformed the ensemble predictions in predictive performance because EMOS compensated for the over/under-dispersive prediction spread and the short-term bias, a potential weakness for the smoothing approach. This case study demonstrates that combining EDA and EMOS contributes to groundwater management for land subsidence control, considering both the model parameter uncertainty and the predictive uncertainty.

Study of early flood warning based on postprocessed predicted precipitation and Xinanjiang model

Precipitation is the most common cause of flood. Accurate precipitation prediction is therefore important for flood forecasting and can be a key factor that increases lead time and the accuracy of early flood warning. In this study, the reforecast precipitation of the global ensemble forecast system (GEFS) was postprocessed using CSG EMOS (censored and shifted gamma distribution-based ensemble model output statistics) method to improve its reliability, and then used as the forcing data for Xinanjiang model to increase the lead time of flood forecasts in order to provide a more effective early flood warning based on an empirically water level–discharge curve at Wangjiaba section, Huaihe River basin, China. Three scenarios were set to demonstrate the importance of precipitation prediction in flood forecasting. The results showed that predicted precipitation became more reliable after postprocessing and this improvement increased as lead time expanded. It is also demonstrated that the postprocessed predicted precipitation brings the improvement for flood forecasting, then leads to the gain of early flood warning. However, this improvement becomes less significant by the increase of lead time and fades away when lead time reaches 7 d. In addition, the results of flood forecast and early warning in predicted precipitation scenario were not as good as those in observed precipitation scenario, indicating that substitution of predicted rainfall for observation requires further refinement in future.

Conditional Ensemble Model Output Statistics for Postprocessing of Ensemble Precipitation Forecasting

Abstract Forecasts produced by EPSs provide the potential state of the future atmosphere and quantify uncertainty. However, the raw ensemble forecasts from a single EPS are typically characterized by underdispersive predictions, especially for precipitation that follows a right-skewed gamma distribution. In this study, censored and shifted gamma distribution ensemble model output statistics (CSG-EMOS) is performed as one of the state-of-the-art methods for probabilistic precipitation postprocessing across China. Ensemble forecasts from multiple EPSs, including the European Centre for Medium-Range Weather Forecasts, the National Centers for Environmental Prediction, and the Met Office, are collected as raw ensembles. A conditional CSG EMOS (Cond-CSG-EMOS) model is further proposed to calibrate the ensemble forecasts for heavy-precipitation events, where the standard CSG-EMOS is insufficient. The precipitation samples from the training period are divided into two categories, light- and heavy-precipitation events, according to a given precipitation threshold and prior ensemble forecast. Then individual models are, respectively, optimized for adequate parameter estimation. The results demonstrate that the Cond-CSG-EMOS is superior to the raw EPSs and the standard CSG-EMOS, especially for the calibration of heavy-precipitation events. The spatial distribution of forecast skills shows that the Cond-CSG-EMOS outperforms the others over most of the study region, particularly in North and Central China. A sensitivity testing on the precipitation threshold shows that a higher threshold leads to better outcomes for the regions that have more heavy-precipitation events, i.e., South China. Our results indicate that the proposed Cond-CSG-EMOS model is a promising approach for the statistical postprocessing of ensemble precipitation forecasts. Significance Statement Heavy-precipitation events are of highly socioeconomic relevance. But it remains a great challenge to obtain high-quality probabilistic quantitative precipitation forecasting (PQPF) from the operational ensemble prediction systems (EPSs). Statistical postprocessing is commonly used to calibrate the systematic errors of the raw EPSs forecasts. However, the non-Gaussian nature of precipitation and the imbalance between the size of light- and heavy-precipitation samples add to the challenge. This study proposes a conditional postprocessing method to improve PQPF of heavy precipitation by performing calibration separately for light and heavy precipitation, in contrast to some previous studies. Our results indicate that the conditional model mitigates the underestimation of heavy precipitation, as well as with a better calibration for the light- and moderate-precipitation.

Combining quantiles of calibrated solar forecasts from ensemble numerical weather prediction

This work is concerned with optimally combining quantiles of several post-processed versions of ensemble solar forecasts, which is new in this field. Numerical weather prediction (NWP) serves grid integration of solar energy by issuing dynamical ensemble irradiance forecasts. However, these ensemble members often suffer from under-dispersion, which motivates statistical calibration via quantile regression (QR) or ensemble model output statistics (EMOS). Given the numerous variants of QR and EMOS, it is generally unclear which variant offers the best performance under what situation, which further motivates combining quantile forecasts. A framework for combining solar forecasts in the form of quantiles is proposed, and a constrained quantile regression averaging scheme is used to exemplify the framework. Using the strictly proper pinball loss, ensemble irradiance forecasts from the European Centre for Medium-Range Weather Forecasts (ECMWF) Ensemble Prediction System are first post-processed using five QR variants and five EMOS variants, and then combined through a linear program. It is found that combining quantiles is an effective strategy that can further improve the calibrated ECMWF forecasts across all locations herein considered.

Comparison of multivariate post‐processing methods using global ECMWF ensemble forecasts

AbstractAn influential step in weather forecasting was the introduction of ensemble forecasts in operational use owing to their capability to account for the uncertainties in the future state of the atmosphere. However, ensemble weather forecasts are often underdispersive and might also contain bias, which calls for some form of post‐processing. A popular approach to calibration is the ensemble model output statistics approach resulting in a full predictive distribution for a given weather variable. However, this form of univariate post‐processing may ignore the prevailing spatial and/or temporal correlation structures among different dimensions. Since many applications call for spatially and/or temporally coherent forecasts, multivariate post‐processing aims to capture these possibly lost dependencies. We compare the forecast skill of different non‐parametric multivariate approaches to modeling temporal dependence of ensemble weather forecasts with different forecast horizons. The focus is on two‐step methods, where, after univariate post‐processing, the ensemble model output statistics predictive distributions corresponding to different forecast horizons are combined to a multivariate calibrated prediction using an empirical copula. Based on global ensemble predictions of temperature, wind speed, and precipitation accumulation of the European Centre for Medium‐Range Weather Forecasts from January 2002 to March 2014, we investigate the forecast skill of different versions of ensemble copula coupling (ECC) and Schaake shuffle. In general, compared with the raw and independently calibrated forecasts, multivariate post‐processing substantially improves the forecast skill. Although even the simplest ECC approach with low computational cost provides a powerful benchmark method, recently proposed advanced extensions of the ECC and the Schaake shuffle are found to not provide any significant improvements over their basic counterparts.

Merging multisatellite precipitation products using stacking method and the censored-shifted gamma ensemble model output statistics in china's Beimiaoji basin

High-quality precipitation data are crucial for hydrological analyses, water resource management, and drought monitoring. Merging precipitation products from different sensors and algorithms provides more reliable spatial information and can obtain high-quality precipitation data. To obtain high-spatiotemporal-resolution precipitation, in this study, we proposed a method to merge multisource precipitation products by downscaling coarse resolution products(geographically weighted regression (GWR) algorithm) and then eliminating biases in individual datasets(stacking algorithm), and finally merging the bias-adjusted precipitation by weighted average(the ensemble model output statistics-censored, shifted gamma (EMOS-CSG) algorithm). The multisource precipitation products included the Tropical Rainfall Measuring Mission (TRMM) Multisatellite Precipitation 3B42 in Real-Time (TMPA-3B42RT), Climate Precipitation Center Morphing Technique (CMORPH), Global Satellite Mapping of Precipitation Near-Real-Time (GSMaP_NRT), and Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks (PERSIANN) products). The merging method was applied to the Beimiaoji basin from April to October in the 2016–2019 period. The precipitation observations at 38 gauges were spatially and randomly divided into two parts, 28 gauges were used for the training, while the other for the performance evaluations. The results showed that (1) the daily merged precipitation product had a better performance than the original satellite products in terms of the six considered statistical indexes, with the lowest root mean square error (RMSE) at 4.33 mm and the highest correlation coefficient (CC) at 0.64; (2) the utilized merging method not only increased the spatial resolution to 1 km but also captured more detailed precipitation distribution information; and (3) considering the influence of the gauge density, the performance of the merged product was still improving after the number of gauge stations exceeds 16, but the improvement was not significant.

Postprocessing of Ensemble Weather Forecast Using Decision Tree–Based Probabilistic Forecasting Methods

Abstract Producing an accurate and calibrated probabilistic forecast has high social and economic value. Systematic errors or biases in the ensemble weather forecast can be corrected by postprocessing models whose development is an urgent challenge. Traditionally, the bias correction is done by employing linear regression models that estimate the conditional probability distribution of the forecast. Although this model framework works well, it is restricted to a prespecified model form that often relies on a limited set of predictors only. Most machine learning (ML) methods can tackle these problems with a point prediction, but only a few of them can be applied effectively in a probabilistic manner. The tree-based ML techniques, namely, natural gradient boosting (NGB), quantile random forests (QRF), and distributional regression forests (DRF), are used to adjust hourly 2-m temperature ensemble prediction at lead times of 1–10 days. The ensemble model output statistics (EMOS) and its boosting version are used as benchmark models. The model forecast is based on the European Centre for Medium-Range Weather Forecasts (ECMWF) for the Czech Republic domain. Two training periods 2015–18 and 2018 only were used to learn the models, and their prediction skill was evaluated in 2019. The results show that the QRF and NGB methods provide the best performance for 1–2-day forecasts, while the EMOS method outperforms other methods for 8–10-day forecasts. Key components to improving short-term forecasting are additional atmospheric/surface state predictors and the 4-yr training sample size. Significance Statement Machine learning methods have great potential and are beginning to be widely applied in meteorology in recent years. A new technique called natural gradient boosting (NGB) has been released and used in this paper to refine the probabilistic forecast of surface temperature. It was found that the NGB has better prediction skills than the traditional ensemble model output statistics in forecasting 1 and 2 days in advance. The NGB has similar prediction skills with lower computational demands compared to other advanced machine learning methods such as the quantile random forests. We showed a path to employ the NGB method in this task, which can be followed for refining other and more challenging meteorological variables such as wind speed or precipitation.

Novel strategies of Ensemble Model Output Statistics (EMOS) for calibrating wind speed/power forecasts

The issue of the accuracy of wind speed/power forecasts is becoming more and more important as wind power production continues to increase year after year. Having accurate forecasts for the energy market clashes with intrinsic difficulties of wind forecasts due to, e.g., the coarse resolution of Numerical Weather Prediction models. Here, we propose a novel Ensemble Model Output Statistics (EMOS) which accounts for nonlinear relationships between predictands and both predictors and other weather observables used as conditioning variables. The strategy is computationally cheap and easy-to-implement with respect to other more complex strategies dealing with nonlinear regressions. Our novel strategy is assessed in a systematic way to quantify its added value with respect to ordinary, linear, EMOS strategies. Wind speed/power forecasts over Italy from the Ensemble Prediction System (EPS) in use at the European Centre for Medium-Range Weather Forecasts (ECMWF) are considered for this purpose. The calibrations are based on the use of past wind speed measurements collected by 69 SYNOP stations over Italy in the years 2018 and 2019. Our results show the key role played by conditioning variables to disentangle the model error (wind/power) thus allowing a net improvement of the calibration with respect to ordinary EMOS strategies.

Deep-learning-based post-processing for probabilistic precipitation forecasting

Ensemble prediction systems (EPSs) serve as a popular technique to provide probabilistic precipitation prediction in short- and medium-range forecasting. However, numerical models still suffer from imperfect configurations associated with data assimilation and physical parameterization, which can lead to systemic bias. Even state-of-the-art models often fail to provide high-quality precipitation forecasting, especially for extreme events. In this study, two deep-learning-based models—a shallow neural network (NN) and a deep NN with convolutional layers (CNN)—were used as alternative post-processing approaches to further improve the probabilistic forecasting of precipitation over China with 1–7 lead days. A popular conventional method—the censored and shifted gamma distribution-based ensemble model output statistics (CSG EMOS)—was used as the baseline. Re-forecasts run using a frozen EPS—Global Ensemble Forecast System version 12—were collected as the raw ensembles spanning from 2000 to 2019. The re-forecast data were generated once per day and consisted of one control run and four perturbed members. We used the calendar year 2018 as the validation period and 2019 as the testing period, and the remaining 18 years of data were used for training. According to the results, in terms of the continuous ranked probability score (CRPS) and the Brier score, the CNN model significantly outperforms the shallow NN model, as well as the CSG EMOS approach and the raw ensemble, especially for heavy or extreme precipitation events (those exceeding 50 mm/day). A remarkable degradation was seen when reducing the size of training samples from 18 years of data to two years. The spatial distribution of the CRPS shows that the stations in central China were better calibrated than those in other regions. With a lead time of 1 day, the CNN model was found to be superior to the other models (in terms of the CRPS) at 74.5% of the study stations. These results indicate that deep NNs can serve as a promising approach to the statistical post-processing of probabilistic precipitation forecasting.

Probabilistic load forecasting using post-processed weather ensemble predictions

Probabilistic forecasting of electricity demand (load) facilitates the efficient management and operations of energy systems. Weather is a key determinant of load. However, modelling load using weather is challenging because the relationship cannot be assumed to be linear. Although numerous studies have focussed on load forecasting, the literature on using the uncertainty in weather while estimating the load probability distribution is scarce. In this study, we model load for Great Britain using weather ensemble predictions, for lead times from one to six days ahead. A weather ensemble comprises a range of plausible future scenarios for a weather variable. It has been shown that the ensembles from weather models tend to be biased and underdispersed, which requires that the ensembles are post-processed. Surprisingly, the post-processing of weather ensembles has not yet been employed for probabilistic load forecasting. We post-process ensembles based on: (1) ensemble model output statistics: to correct for bias and dispersion errors by calibrating the ensembles, and (2) ensemble copula coupling: to ensure that ensembles remain physically consistent scenarios after calibration. The proposed approach compares favourably to the case when no weather information, raw weather ensembles or post-processed ensembles without ensemble copula coupling are used during the load modelling.

Calibrating the CAMS European multi-model air quality forecasts for regional air pollution monitoring

The CAMS air quality multi-model forecasts have been assessed and calibrated for PM10, PM2.5, O3, NO2, and CO against observations collected by the Regional Monitoring Network of the Liguria region (northwestern Italy) in the years 2019 and 2020. The calibration strategy used in the present work has its roots in the well-established Ensemble Model Output Statistics (EMOS) through which a raw ensemble forecast can be accurately transformed into a predictive probability density function, with a simultaneous correction of biases and dispersion errors. The strategy also provides a calibrated forecast of model uncertainties. As a result of our analysis, the key role of pollutant real-time observations to be ingested in the calibration strategy clearly emerge especially in the shorter look-ahead forecast hours. Our dynamic calibration strategy turns out to be superior with respect to its analogous where real-time data are not taken into account. The best calibration strategy we have identified makes the CAMS multi-model forecast system more reliable than other raw air quality models running at higher spatial resolution which exploit more detailed information from inventory emission. We expect positive impacts of our research for identifying and set up reliable and economic air pollution early warning systems.

Calibration of subseasonal sea‐ice forecasts using ensemble model output statistics and observational uncertainty

AbstractIn response to a growing demand for improved sea‐ice forecast guidance at shorter timescales and higher spatial resolutions, this study investigates the predictive skill of daily subseasonal sea‐ice forecasts from two state‐of‐the‐art prediction systems: SEAS5 from the European Centre for Medium‐Range Weather Forecasts (ECMWF) and the Global Ensemble Prediction System (GEPS) of Environment and Climate Change Canada (ECCC). Based on hindcast records from 1998–2017, we find that probabilistic forecasts of sea‐ice concentration (SIC) throughout the marginal ice zone of the Canadian Arctic in June and November are no more skillful than simple benchmark forecasts based on climatology and damped persistence. At short lead times, the lack of skill arises from overconfident ensemble spread and errors in forecast initial conditions. At longer lead times, the development of model drift also plays a role. To improve the forecasts, we develop the nonhomogeneous censored Gaussian regression for SIC (NCGR‐sic) calibration procedure, which uses the forecast ensemble mean and ensemble standard deviation (both locally and from neighboring locations) as predictors in an ensemble model output statistics framework. Importantly, NCGR‐sic incorporates observational uncertainty directly during model parameter fitting, leading to enhanced calibration. NCGR‐sic improves the spatial probability score by , on average, half of which we infer results from the removal of climatological bias and half from the improvement of forecast uncertainty. Calibrated forecasts from SEAS5 (GEPS) exceed the skill of climatology throughout the marginal ice zone over at least the first 33 (26) days in June and the first 32 (15) days in November. Generally, better skill occurs outside the Canadian Archipelago and for low‐ to mid‐range SIC compared with high SIC. While calibrated forecasts also outperform damped persistence after the first 3–10 days, we postulate that initial condition inconsistencies must be resolved in order to obtain skill at shorter timescales. Finally, the robustness of NCGR‐sic is demonstrated by effectively improving an operational forecast from June 2020.

Evaluating the impact of post-processing medium-range ensemble streamflow forecasts from the European Flood Awareness System

Abstract. Streamflow forecasts provide vital information to aid emergency response preparedness and disaster risk reduction. Medium-range forecasts are created by forcing a hydrological model with output from numerical weather prediction systems. Uncertainties are unavoidably introduced throughout the system and can reduce the skill of the streamflow forecasts. Post-processing is a method used to quantify and reduce the overall uncertainties in order to improve the usefulness of the forecasts. The post-processing method that is used within the operational European Flood Awareness System is based on the model conditional processor and the ensemble model output statistics method. Using 2 years of reforecasts with daily timesteps, this method is evaluated for 522 stations across Europe. Post-processing was found to increase the skill of the forecasts at the majority of stations in terms of both the accuracy of the forecast median and the reliability of the forecast probability distribution. This improvement is seen at all lead times (up to 15 d) but is largest at short lead times. The greatest improvement was seen in low-lying, large catchments with long response times, whereas for catchments at high elevation and with very short response times the forecasts often failed to capture the magnitude of peak flows. Additionally, the quality and length of the observational time series used in the offline calibration of the method were found to be important. This evaluation of the post-processing method, and specifically the new information provided on characteristics that affect the performance of the method, will aid end users in making more informed decisions. It also highlights the potential issues that may be encountered when developing new post-processing methods.

Evaluating ensemble post‐processing for wind power forecasts

AbstractCapturing the uncertainty in probabilistic wind power forecasts is challenging, especially when uncertain input variables, such as the weather, play a role. Since ensemble weather predictions aim to capture the uncertainty in the weather system, they can be used to propagate this uncertainty through to subsequent wind power forecasting models. However, as weather ensemble systems are known to be biassed and underdispersed, meteorologists post‐process the ensembles. This post‐processing can successfully correct the biasses in the weather variables but has not been evaluated thoroughly in the context of subsequent forecasts, such as wind power generation forecasts. The present paper evaluates multiple strategies for applying ensemble post‐processing to probabilistic wind power forecasts. We use Ensemble Model Output Statistics (EMOS) as the post‐processing method and evaluate four possible strategies: only using the raw ensembles without post‐processing, a one‐step strategy where only the weather ensembles are post‐processed, a one‐step strategy where we only post‐process the power ensembles and a two‐step strategy where we post‐process both the weather and power ensembles. Results show that post‐processing the final wind power ensemble improves forecast performance regarding both calibration and sharpness whilst only post‐processing the weather ensembles does not necessarily lead to increased forecast performance.