Warn-on-Forecast Research Articles

Evaluation of an experimental Warn‐on‐Forecast 3DVAR analysis and forecast system on quasi‐real‐time short‐term forecasts of high‐impact weather events

AbstractThe purpose of this study is to demonstrate the capability of an experimental, weather‐adaptive, high‐resolution, deterministic Warn‐on‐Forecast (WoF) analysis and forecast system (WoF3DVAR‐AFS) for predicting high‐impact severe weather events that occurred during the Hazardous Weather Testbed 2019 Spring Forecast Experiments. WoF3DVAR‐AFS uses a three‐dimensional variational (3DVAR) method as its core data assimilation system and the Advanced Research Version of the Weather Research and Forecasting (WRF‐ARW) model as its forward model. Surface measurements provided in meteorological aviation reports and the Oklahoma Mesonet, Doppler radar data, and spaceborne total lightning observations provided by the Geostationary Lightning Mapper are assimilated at 15‐min frequency over a target domain determined by the “Day 1” Convective Outlook product from the Storm Prediction Center. The chief goal of this system is to complement probabilistic forecasts generated by ensemble analysis and forecast systems, such as the experimental Warn‐on‐Forecast System (WoFS) with a higher‐resolution deterministic member to aid forecasters' decision‐making. We performed both qualitative and quantitative evaluations on 0–6 hr forecasts launched hourly from 1900 to 0300 UTC the next day for each of the 12 cases. Aggregated subjective forecast evaluation metrics from each individual case, as well as detailed comparison against available verification datasets, suggest that the forecasts are generally skillful in terms of composite reflectivity fields, quantitative precipitation forecasts, and the strength and location of rotation tracks and damaging winds. This study presents initial efforts to assess the performance of WoF3DVAR‐AFS and provides possible directions for further improvements, including the development of a weather‐adaptive, dual‐resolution analysis and forecast system hybrid with an ensemble system, such as the experimental Warn‐on‐Forecast system.

Using Machine Learning to Generate Storm-Scale Probabilistic Guidance of Severe Weather Hazards in the Warn-on-Forecast System

AbstractA primary goal of the National Oceanic and Atmospheric Administration Warn-on-Forecast (WoF) project is to provide rapidly updating probabilistic guidance to human forecasters for short-term (e.g., 0–3 h) severe weather forecasts. Postprocessing is required to maximize the usefulness of probabilistic guidance from an ensemble of convection-allowing model forecasts. Machine learning (ML) models have become popular methods for postprocessing severe weather guidance since they can leverage numerous variables to discover useful patterns in complex datasets. In this study, we develop and evaluate a series of ML models to produce calibrated, probabilistic severe weather guidance from WoF System (WoFS) output. Our dataset includes WoFS ensemble forecasts available every 5 min out to 150 min of lead time from the 2017–19 NOAA Hazardous Weather Testbed Spring Forecasting Experiments (81 dates). Using a novel ensemble storm-track identification method, we extracted three sets of predictors from the WoFS forecasts: intrastorm state variables, near-storm environment variables, and morphological attributes of the ensemble storm tracks. We then trained random forests, gradient-boosted trees, and logistic regression algorithms to predict which WoFS 30-min ensemble storm tracks will overlap a tornado, severe hail, and/or severe wind report. To provide rigorous baselines against which to evaluate the skill of the ML models, we extracted the ensemble probabilities of hazard-relevant WoFS variables exceeding tuned thresholds from each ensemble storm track. The three ML algorithms discriminated well for all three hazards and produced more reliable probabilities than the baseline predictions. Overall, the results suggest that ML-based postprocessing of dynamical ensemble output can improve short-term, storm-scale severe weather probabilistic guidance.

The Impact of Assimilating Satellite-Derived Layered Precipitable Water, Cloud Water Path, and Radar Data on Short-Range Thunderstorm Forecasts

AbstractWith the launch of GOES-16 in November 2016, effective utilization of its data in convective-scale numerical weather prediction (NWP) has the potential to improve high-impact weather (HIWeather) forecasts. In this study, the impact of satellite-derived layered precipitable water (LPW) and cloud water path (CWP) in addition to NEXRAD observations on short-term convective-scale NWP forecasts are examined using three severe weather cases that occurred in May 2017. In each case, satellite-derived CWP and LPW products and radar observations are assimilated into the Advanced Research Weather Research and Forecasting (WRF-ARW) Model using the NSSL hybrid Warn-on-Forecast (WoF) analysis and forecast system. The system includes two components: the GSI-EnKF system and a deterministic 3DEnVAR system. This study examines deterministic 0–6-h forecasts launched from the hybrid 3DEnVAR analyses for the three severe weather events. Three types of experiments are conducted and compared: (i) the control experiment (CTRL) without assimilating any data, (ii) the radar experiment (RAD) with the assimilation of radar and surface observations, and (iii) the satellite experiment (RADSAT) with the assimilation of all observations including surface-, radar-, and satellite-derived CWP and LPW. The results show that assimilating additional GOES products improves short-range forecasts by providing more accurate initial conditions, especially for moisture and temperature variables.

The Coupling of NSSL Warn-on-Forecast and FLASH Systems for Probabilistic Flash Flood Prediction

AbstractThe goal of the National Oceanic and Atmospheric Administration’s (NOAA) Warn-on-Forecast (WoF) program is to provide frequently updating, probabilistic model guidance that will enable National Weather Service (NWS) forecasters to produce more continuous communication of hazardous weather threats (e.g., heavy rainfall, flash floods, damaging wind, large hail, and tornadoes) between the watch and warning temporal and spatial scales. To evaluate the application of this WoF concept for probabilistic short-term flash flood prediction, the 0–3-h rainfall forecasts from NOAA National Severe Storms Laboratory’s (NSSL) experimental WoF System (WoFS) were integrated as the forcing to the NWS operational hydrologic modeling core within the Flooded Locations and Simulated Hydrographs (FLASH) system. Initial assessment of the potential impacts of probabilistic short-term flash flood forecasts from this coupled atmosphere–hydrology (WoFS-FLASH) modeling system were evaluated in the 2018 Hydrometeorology Testbed Multi-Radar Multi-Sensor Hydrology experiment held in Norman, Oklahoma. During the 3-week experiment period, a total of nine NWS forecasters analyzed three retrospective flash flood events in archive mode. This study will describe specifically what information participants extracted from the WoFS-FLASH products during these three archived events, and how this type of information is expected to impact operational decision-making processes. Overall feedback from the testbed participants’ evaluations show promise for the coupled NSSL WoFS-FLASH system probabilistic flash flood model guidance to enable earlier assessment and detection of flash flood threats and to advance the current warning lead time for these events.

Test of a Weather-Adaptive Dual-Resolution Hybrid Warn-on-Forecast Analysis and Forecast System for Several Severe Weather Events

Abstract A real-time, weather adaptive, dual-resolution, hybrid Warn-on-Forecast (WoF) analysis and forecast system using the WRF-ARW forecast model has been developed and implemented. The system includes two components, an ensemble analysis and forecast component, and a deterministic hybrid three-dimensional ensemble–variational (3DEnVAR) analysis and forecast component. The goal of the system is to provide on-demand, ensemble-based, and physically consistent gridded analysis and forecast products to forecasters for making warning decisions. Both components, the WRF-DART system with 36 ensemble members and the hybrid 3DEnVAR system, assimilate radar data, satellite-retrieved cloud water path, and surface observations at 15-min intervals with dual-resolution capability. In the current hybrid configuration, one-way coupling of the two analysis systems is performed: ensemble covariances derived from the WRF-DART system are incorporated into the hybrid 3DEnVAR system with each data assimilation (DA) cycle. This study examines deterministic, 3-h forecasts launched from the hybrid 3DEnVAR analyses every 30 min for three severe weather events in 2017. The performance of the deterministic component is evaluated for four configurations: dual-resolution coupling, single-resolution coupling, forecasts initialized using a cloud analysis for reflectivity assimilation, and forecasts initialized from the WRF-DART ensemble mean. Quantitative and subjective evaluation of composite reflectivity and updraft helicity (UH) swath forecasts for the three events indicate that the dual-resolution strategy without the cloud analysis performs best among the four configurations and provides the most realistic prediction of reflectivity patterns and UH tracks.

Forecasting High-Impact Weather in Landfalling Tropical Cyclones Using a Warn-on-Forecast System

AbstractLandfalling tropical cyclones (TCs) are among the greatest natural threats to life and property in the United States, since they can produce multiple hazards associated with convective storms over a wide region. Of these hazards, tornadoes within TC rainbands pose a particularly difficult forecast problem owing to their rapid evolution and their frequent occurrence coincident with additional hazards, such as flash flooding and damaging winds. During the 2017 Atlantic hurricane season, Hurricanes Harvey and Irma impacted the continental United States, causing significant loss of life and billions of dollars in property damage. Application of the Warn-on-Forecast (WoF) concept of short-term, probabilistic guidance of convective hazards (Stensrud et al. 2009, 2013), including the potential for tornadoes within TCs, offers the ability to provide forecasters with valuable tools for prioritizing the relative risk from multiple convective threats and effectively communicating them to the public.

Application of the Warn‐on‐Forecast system for flash‐flood‐producing heavy convective rainfall events

AbstractThe vision of the National Oceanic and Atmospheric Administration's (NOAA) Warn‐on‐Forecast (WoF) research and development project is to provide very short‐term probabilistic model guidance products that will aid the ability of National Weather Service forecasters to issue probabilistic warnings of severe convective hazards with higher accuracy and longer lead times. The experimental Warn‐on‐Forecast System (WoFS), which is under development, is a frequently cycled, regional, convective‐scale, on‐demand, ensemble data assimilation and prediction system. The system assimilates thunderstorm observations to forecast the life cycle and associated hazards of individual convective storms. Most of the initial research effort, since the beginning of the WoF project in 2009, has been focused on tornadic events, which constitute one of the most violent and difficult to predict weather threats. However, the system emerging from this project has significant potential to help with prediction of other hazards as well: in particular, flash‐flood‐producing, convectively driven intense rainfall events. This study focuses on the application of WoFS in 0–6‐hr probabilistic rainfall forecasts of several flash‐flood‐producing heavy rainfall events during the spring and summer of 2015 and 2016. Results indicate that WoFS successfully initializes the convective storms in the ensemble. Visual inspections and probabilistic verification metrics show that WoFS predicts the intense rainfall that often leads to flash flooding at the correct location with higher accuracy in areal coverage and amount during the 0–3 hr forecast period than during the later 3–6 hr period. Overall results indicate that the frequently updated 0–6‐hr ensemble forecast from the WoFS has the potential to highlight areas where intense rainfall can result in flash flooding and increase near‐term situational awareness of flash flood threats.

Comparison of Cloud Microphysics Schemes in a Warn-on-Forecast System Using Synthetic Satellite Objects

AbstractForecasts of high-impact weather conditions using convection-allowing numerical weather prediction models have been found to be highly sensitive to the selection of cloud microphysics scheme used within the system. The Warn-on-Forecast (WoF) project has developed a rapid-cycling, convection-allowing, data assimilation and forecasting system known as the NSSL Experimental WoF System for ensembles (NEWS-e), which is designed to utilize advanced cloud microphysics schemes. NEWS-e currently (2017–18) uses the double-moment NSSL variable density scheme (NVD), which has been shown to generate realistic representations of convective precipitation within the system. However, very little verification on nonprecipitating cloud features has been performed with this system. During the 2017 Hazardous Weather Testbed (HWT) experiment, an overestimation of the areal coverage of convectively generated cirrus clouds was observed. Changing the cloud microphysics scheme to Thompson generated more accurate cloud fields. This research undertook the task of improving the cloud analysis generated by NVD while maintaining its skill for other variables such as reflectivity. Adjustments to cloud condensation nuclei (CCN), fall speed, and collection efficiencies were made and tested over a set of six severe weather cases occurring during May 2017. This research uses an object-based verification approach in which objects of cold infrared brightness temperatures, high cloud-top pressures, and cloud water path are generated from model output and compared against GOES-13 observations. Results show that the modified NVD scheme generated much more skillful forecasts of cloud objects than the original formulation without having a negative impact on the skill of simulated composite reflectivity forecasts.

Correcting Storm Displacement Errors in Ensembles Using the Feature Alignment Technique (FAT)

Abstract A goal of Warn-on-Forecast (WoF) is to develop forecasting systems that produce accurate analyses and forecasts of severe weather to be utilized in operational warning settings. Recent WoF-related studies have indicated the need to alleviate storm displacement errors in both analyses and forecasts. A potential solution to reduce these errors is the feature alignment technique (FAT), which mitigates displacement errors between observations and model fields while satisfying constraints. This study merges the FAT with a local ensemble transform Kalman filter (LETKF) and uses observing system simulation experiments (OSSEs) to vet the FAT as a potential alleviator of forecast errors arising from storm displacement errors. An idealized truth run of a supercell on a 250-m grid is used to generate pseudoradar observations, which are assimilated onto a 2-km grid using a 50-member ensemble to produce analyses and forecasts of the supercell. The FAT uses composite reflectivity to generate a 2D field of displacement vectors that is used to align the model variables with the observations prior to each analysis cycle. The FAT is tested by displacing the initial model background fields from the observations or modifying the environmental wind profile to create a storm motion bias in the forecast cycles. The FAT–LETKF performance is evaluated and compared to that of the LETKF alone. The FAT substantially reduces errors in storm intensity, location, and structure during data assimilation and subsequent forecasts. These supercell OSSEs provide the foundation for future experiments with real data and more complex events.

Advancing from Convection-Allowing NWP to Warn-on-Forecast: Evidence of Progress

Abstract The Warn-on-Forecast (WoF) program, driven by advanced data assimilation and ensemble design of numerical weather prediction (NWP) systems, seeks to advance 0–3-h NWP to aid National Weather Service warnings for thunderstorm-induced hazards. An early prototype of the WoF prediction system is the National Severe Storms Laboratory (NSSL) Experimental WoF System for ensembles (NEWSe), which comprises 36 ensemble members with varied initial conditions and parameterization suites. In the present study, real-time 3-h quantitative precipitation forecasts (QPFs) during spring 2016 from NEWSe members are compared against those from two real-time deterministic systems: the operational High Resolution Rapid Refresh (HRRR, version 1) and an upgraded, experimental configuration of the HRRR. All three model systems were run at 3-km horizontal grid spacing and differ in initialization, particularly in the radar data assimilation methods. It is the impact of this difference that is evaluated herein using both traditional and scale-aware verification schemes. NEWSe, evaluated deterministically for each member, shows marked improvement over the two HRRR versions for 0–3-h QPFs, especially at higher thresholds and smaller spatial scales. This improvement diminishes with forecast lead time. The experimental HRRR model, which became operational as HRRR version 2 in August 2016, also provides added skill over HRRR version 1.

Storm-Scale Data Assimilation and Ensemble Forecasting with the NSSL Experimental Warn-on-Forecast System. Part II: Combined Radar and Satellite Data Experiments

Abstract This research represents the second part of a two-part series describing the development of a prototype ensemble data assimilation system for the Warn-on-Forecast (WoF) project known as the NSSL Experimental WoF System for ensembles (NEWS-e). Part I describes the NEWS-e design and results from radar reflectivity and radial velocity data assimilation for six severe weather events occurring during 2013 and 2014. Part II describes the impact of assimilating satellite liquid and ice water path (LWP and IWP, respectively) retrievals from the GOES Imager along with the radar observations. Assimilating LWP and IWP observations may improve thermodynamic conditions at the surface over the storm-scale domain through better analysis of cloud coverage in the model compared to radar-only experiments. These improvements sometimes corresponded to an improved analysis of supercell storms leading to better forecasts of low-level vorticity. This positive impact was most evident for events where convection is not ongoing at the beginning of the radar and satellite data assimilation period. For more complex cases containing significant amounts of ongoing convection, only assimilating clear-sky satellite retrievals in place of clear-air reflectivity resulted in spurious regions of light precipitation compared to the radar-only experiments. The analyzed tornadic storms in these experiments are sometimes too weak and quickly diminished in intensity in the forecasts. The lessons learned as part of these experiments should lead to improved iterations of the NEWS-e system, building on the modestly successful results described here.

Storm-Scale Data Assimilation and Ensemble Forecasting with the NSSL Experimental Warn-on-Forecast System. Part I: Radar Data Experiments

AbstractThis first part of a two-part study on storm-scale radar and satellite data assimilation provides an overview of a multicase study conducted as part of the NOAA Warn-on-Forecast (WoF) project. The NSSL Experimental WoF System for ensembles (NEWS-e) is used to produce storm-scale analyses and forecasts of six diverse severe weather events from spring 2013 and 2014. In this study, only Doppler reflectivity and radial velocity observations (and, when available, surface mesonet data) are assimilated into a 36-member, storm-scale ensemble using an ensemble Kalman filter (EnKF) approach. A series of 1-h ensemble forecasts are then initialized from storm-scale analyses during the 1-h period preceding the onset of storm reports. Of particular interest is the ability of these 0–1-h ensemble forecasts to reproduce the low-level rotational characteristics of supercell thunderstorms, as well as other convective hazards. For the tornado-producing thunderstorms considered in this study, ensemble probabilistic forecasts of low-level rotation generally indicated a rotating thunderstorm approximately 30 min before the time of first observed tornado. Displacement errors (often to the north of tornado-affected areas) associated with vorticity swaths were greatest in those forecasts launched 30–60 min before the time of first tornado. Similar forecasts were produced for a tornadic mesovortex along the leading edge of a bow echo and, again, highlighted a well-defined vorticity swath as much as 30 min prior to the first tornado.

Storm-Scale Data Assimilation and Ensemble Forecasts for the 27 April 2011 Severe Weather Outbreak in Alabama

Abstract As part of NOAA’s Warn-on-Forecast (WoF) initiative, a multiscale ensemble-based assimilation and prediction system is developed using the WRF-ARW model and DART assimilation software. To evaluate the capabilities of the system, retrospective short-range probabilistic storm-scale (convection allowing) ensemble analyses and forecasts are produced for the 27 April 2011 Alabama severe weather outbreak. Results indicate that the storm-scale ensembles are able to analyze the observed storms with strong low-level rotation at approximately the correct locations and to retain the supercell structures during the 0–1-h forecasts with reasonable accuracy. The system predicts the low-level mesocyclones of significant isolated tornadic supercells that align well with the locations of radar-derived rotation. For cases with multiple interacting storms in close proximity, the system tends to produce more variability in mesocyclone forecasts from one initialization time to the next until the observations show the dominance of one of the cells. The short-range ensemble probabilistic forecasts obtained from this continuous 5-min storm-scale 6-h-long update system demonstrate the potential of a frequently updated, high-resolution NWP system that could be used to extend severe weather warning lead times. This study also demonstrates the challenges associated with developing a WoF-type system. The results motivate future work to reduce model errors associated with storm motion and spurious cells, and to design storm-scale ensembles that better represent typical 1-h forecast errors.

Sensitivity of Idealized Supercell Simulations to Horizontal Grid Spacing: Implications for Warn-on-Forecast

Abstract The Warn-on-Forecast (WoF) program aims to deploy real-time, convection-allowing, ensemble data assimilation and prediction systems to improve short-term forecasts of tornadoes, flooding, lightning, damaging wind, and large hail. Until convection-resolving (horizontal grid spacing Δx < 100 m) systems become available, however, resolution errors will limit the accuracy of ensemble model output. Improved understanding of grid spacing dependence of simulated convection is therefore needed to properly calibrate and interpret ensemble output, and to optimize trade-offs between model resolution and other computationally constrained parameters like ensemble size and forecast lead time. Toward this end, the authors examine grid spacing sensitivities of simulated supercells over Δx of 333 m–4 km. Storm environment and physics parameterization are varied among the simulations. The results suggest that 4-km grid spacing is too coarse to reliably simulate supercells, occasionally leading to premature storm demise, whereas 3-km simulations more often capture operationally important features, including low-level rotation tracks. Further decreasing Δx to 1 km enables useful forecasts of rapid changes in low-level rotation intensity, though significant errors remain (e.g., in timing). Grid spacing dependencies vary substantially among the experiments, suggesting that accurate calibration of ensemble output requires better understanding of how storm characteristics, environment, and parameterization schemes modulate grid spacing sensitivity. Much of the sensitivity arises from poorly resolving small-scale processes that impact larger (well resolved) scales. Repeating some of the 333-m simulations with coarsened initial conditions reveals that supercell forecasts can substantially benefit from reduced grid spacing even when limited observational density precludes finescale initialization.

Assessing Ensemble Forecasts of Low-Level Supercell Rotation within an OSSE Framework

Abstract Under the envisioned warn-on-forecast (WoF) paradigm, ensemble model guidance will play an increasingly critical role in the tornado warning process. While computational constraints will likely preclude explicit tornado prediction in initial WoF systems, real-time forecasts of low-level mesocyclone-scale rotation appear achievable within the next decade. Given that low-level mesocyclones are significantly more likely than higher-based mesocyclones to be tornadic, intensity and trajectory forecasts of low-level supercell rotation could provide valuable guidance to tornado warning and nowcasting operations. The efficacy of such forecasts is explored using three simulated supercells having weak, moderate, or strong low-level rotation. The results suggest early WoF systems may provide useful probabilistic 30–60-min forecasts of low-level supercell rotation, even in cases of large radar–storm distances and/or narrow cross-beam angles. Given the idealized nature of the experiments, however, they are best viewed as providing an upper-limit estimate of the accuracy of early WoF systems.

A Real-Time Weather-Adaptive 3DVAR Analysis System for Severe Weather Detections and Warnings

Abstract A real-time, weather-adaptive three-dimensional variational data assimilation (3DVAR) system has been adapted for the NOAA Warn-on-Forecast (WoF) project to incorporate all available radar observations within a moveable analysis domain. The key features of the system include 1) incorporating radar observations from multiple Weather Surveillance Radars-1988 Doppler (WSR-88Ds) with NCEP forecast products as a background state, 2) the ability to automatically detect and analyze severe local hazardous weather events at 1-km horizontal resolution every 5 min in real time based on the current weather situation, and 3) the identification of strong circulation patterns embedded in thunderstorms. Although still in the early development stage, the system performed very well within the NOAA's Hazardous Weather Testbed (HWT) Experimental Warning Program during preliminary testing in spring 2010 when many severe weather events were successfully detected and analyzed. This study represents a first step in the assessment of this type of 3DVAR analysis for use in severe weather warnings. The eventual goal of this real-time 3DVAR system is to help meteorologists better track severe weather events and eventually provide better warning information to the public, ultimately saving lives and reducing property damage.