Developmental Testbed Center Research Articles

Common Community Physics Package: Fostering Collaborative Development in Physical Parameterizations and Suites

Abstract The Common Community Physics Package (CCPP) is a state-of-the-art infrastructure designed to facilitate community-wide development of atmospheric physics parameterizations, support their interoperability among different modeling centers, and enable the transition of research to operations in NWP and climate modeling. The CCPP consists of two elements: the Physics (a repository of parameterizations) and the Framework (an infrastructure for interfacing the parameterizations with host models). The CCPP is a community resource: Its latest release has 23 primary parameterizations, which can be organized into six supported suites. It is distributed with a single-column model to facilitate physics development and experimentation. The Developmental Testbed Center provides support to users and developers. A key aspect of the CCPP is its interoperability, that is, its ability to be used by multiple host models. This enables synergistic collaboration among groups dispersed over various institutions and working on various models. In this article, we provide an overview of the CCPP and how it is being used in two leading modeling systems. The CCPP is part of the Unified Forecast System (UFS), is included in the NOAA operational Hurricane Analysis and Forecast System (HAFS) version 1, and is slated for use in all upcoming NOAA global and limited-area UFS applications for operations. Similarly, the CCPP has been integrated into the Navy Environmental Prediction System Using a Nonhydrostatic Engine (NEPTUNE) model and is undergoing testing for the upcoming transition to operations. These experiences make physics interoperability a reality and open the doors for much broader collaborative efforts on ESM development.

Lifetime Performance of the Operational Hurricane Weather Research and Forecasting Model (HWRF) for North Atlantic Tropical Cyclones

Abstract The Hurricane Weather Research and Forecasting Model (HWRF) was the flagship hurricane model at NOAA’s National Centers for Environmental Prediction for 16 years and a state-of-the-art tool for tropical cyclone (TC) intensity prediction at the National Weather Service and across the globe. HWRF was a joint development between NOAA research and operations, specifically the Environmental Modeling Center and the Atlantic Oceanographic and Meteorological Laboratory. Significant support also came from the National Hurricane Center, Developmental Testbed Center, University Corporation for Atmospheric Research, universities, cooperative institutes, and the TC community. In the North Atlantic basin, where most improvement efforts focused, HWRF intensity forecast errors decreased by 45%–50% at many lead times between 2007 and 2022. These large improvements resulted from increases in horizontal and vertical resolution, as well as advances in model physics and data assimilation. HWRF intensity forecasts performed particularly well over the Gulf of Mexico in recent years, providing useful guidance for a large number of impactful landfalling hurricanes. Such advances were made possible not only by significant gains in computing but also through substantial investment from the Hurricane Forecast Improvement Program.

Application of Severe Weather Nowcasting to Case Studies in Air Traffic Management

Effective and time-efficient aircraft assistance and guidance in severe weather environments remains a challenge for air traffic control. Air navigation service providers around the globe could greatly benefit from specific and adapted meteorological information for the controller position, helping to reduce the increased workload induced by adverse weather. The present work proposes a radar-based nowcasting algorithm providing compact meteorological information on convective weather near airports for introduction into the algorithms intended to assist in air-traffic management. The use of vertically integrated liquid density enables extremely rapid identification and short-term prediction of convective regions that should not be traversed by aircraft, which is an essential requirement for use in tactical controller support systems. The proposed tracking and nowcasting method facilitates the anticipation of the meteorological situation around an airport. Nowcasts of centroid locations of various approaching thunderstorms were compared with corresponding radar data, and centroid distances between nowcasted and observed storms were computed. The results were analyzed with Method for the Object-Based Evaluation from the Model Evaluation tools software (MET-10.0.1, Developmental Testbed Center, Boulder, CO, US) and later integrated into an assistance arrival manager software, showing the potential of this approach for automatic air traffic assistance in adverse weather scenarios.

The Common Community Physics Package (CCPP) Framework v6

Abstract. The Common Community Physics Package (CCPP) is a collection of physical atmospheric parameterizations for use in Earth system models and a framework that couples the physics to a host model's dynamical core. A primary goal for this effort is to facilitate research and development of physical parameterizations and experimentation with physics–dynamics coupling methods while simultaneously offering capabilities for use in numerical weather prediction (NWP) operations. The CCPP Framework supports configurations ranging from process studies to operational NWP as it enables host models to assemble the parameterizations in flexible suites. Framework capabilities include variability in scheme call order; ability to group parameterizations for calls in different parts of the host model, allowing intervening computation or coupling to additional components; options to call some parameterizations more often than others; and automatic variable transformations. The CCPP Framework was developed by the Developmental Testbed Center and is distributed with a single-column model that can be used to test innovations and to conduct hierarchical studies in which physics and dynamics are decoupled. It is also an integral part of the Unified Forecast System, a community-based, coupled, comprehensive Earth modeling system designed to support research and be the source system for the NOAA's operational NWP applications. Finally, the CCPP Framework is under various stages of adoption by a number of other models in the wider community.

The Model Evaluation Tools (MET): More than a Decade of Community-Supported Forecast Verification

AbstractForecast verification and evaluation is a critical aspect of forecast development and improvement, day-to-day forecasting, and the interpretation and application of forecasts. In recent decades, the verification field has rapidly matured, and many new approaches have been developed. However, until recently, a stable set of modern tools to undertake this important component of forecasting has not been available. The Model Evaluation Tools (MET) was conceived and implemented to fill this gap. MET (https://dtcenter.org/community-code/model-evaluation-tools-met) was developed by the National Center for Atmospheric Research (NCAR), the National Oceanic and Atmospheric Administration (NOAA), and the U.S. Air Force (USAF) and is supported via the Developmental Testbed Center (DTC) and collaborations with operational and research organizations. MET incorporates traditional verification methods, as well as modern verification capabilities developed over the last two decades. MET stands apart from other verification packages due to its inclusion of innovative spatial methods, statistical inference tools, and a wide range of approaches to address the needs of individual users, coupled with strong community engagement and support. In addition, MET is freely available, which ensures that consistent modern verification capabilities can be applied by researchers and operational forecasting practitioners, enabling the use of consistent and scientifically meaningful methods by all users. This article describes MET and the expansion of MET to an umbrella package (METplus) that includes a database and display system and Python wrappers to facilitate the wide use of MET. Examples of MET applications illustrate some of the many ways that the package can be used to evaluate forecasts in a meaningful way.

Evaluation of the Grell–Freitas Convective Scheme in the Hurricane Weather Research and Forecasting (HWRF) Model

Abstract The Developmental Testbed Center (DTC) tested two convective parameterization schemes in the Hurricane Weather Research and Forecasting (HWRF) Model and compared them in terms of performance of forecasting tropical cyclones (TCs). Several TC forecasts were conducted with the scale-aware Simplified Arakawa Schubert (SAS) and Grell–Freitas (GF) convective schemes over the Atlantic basin. For this sample of over 100 cases, the storm track and intensity forecasts were superior for the GF scheme compared to SAS. A case study showed improved storm structure for GF when compared with radar observations. The GF run had increased inflow in the boundary layer, which resulted in higher angular momentum. An angular momentum budget analysis shows that the difference in the contribution of the eddy transport to the total angular momentum tendency is small between the two forecasts. The main difference is in the mean transport term, especially in the boundary layer. The temperature tendencies indicate higher contribution from the microphysics and cumulus heating above the boundary layer in the GF run. A temperature budget analysis indicated that both the temperature advection and diabatic heating were the dominant terms and they were larger near the storm center in the GF run than in the SAS run. The above results support the superior performance of the GF scheme for TC intensity forecast.

Mesoscale Model Evaluation Testbed (MMET): A Resource for Transitioning NWP Innovations from Research to Operations (R2O)

Abstract A wide range of numerical weather prediction (NWP) innovations are under development in the research community that have the potential to positively impact operational models. The Developmental Testbed Center (DTC) helps facilitate the transition of these innovations from research to operations (R2O). With the large number of innovations available in the research community, it is critical to clearly define a testing protocol to streamline the R2O process. The DTC has defined such a process that relies on shared responsibilities of the researchers, the DTC, and operational centers to test promising new NWP advancements. As part of the first stage of this process, the DTC instituted the mesoscale model evaluation testbed (MMET), which established a common testing framework to assist the research community in demonstrating the merits of developments. The ability to compare performance across innovations for critical cases provides a mechanism for selecting the most promising capabilities for further testing. If the researcher demonstrates improved results using MMET, then the innovation may be considered for the second stage of comprehensive testing and evaluation (T&E) prior to entering the final stage of preimplementation T&E. MMET provides initialization and observation datasets for several case studies and multiday periods. In addition, the DTC provides baseline results for select operational configurations that use the Advanced Research version of Weather Research and Forecasting Model (ARW) or the National Oceanic and Atmospheric Administration (NOAA) Environmental Modeling System Nonhydrostatic Multiscale Model on the B grid (NEMS-NMMB). These baselines can be used for testing sensitivities to different model versions or configurations in order to improve forecast performance.

Bridging Research to Operations Transitions: Status and Plans of Community GSI

Abstract With a goal of improving operational numerical weather prediction (NWP), the Developmental Testbed Center (DTC) has been working with operational centers, including, among others, the National Centers for Environmental Prediction (NCEP), National Oceanic and Atmospheric Administration (NOAA), National Aeronautics and Space Administration (NASA), and the U.S. Air Force, to support numerical models/systems and their research, perform objective testing and evaluation of NWP methods, and facilitate research-to-operations transitions. This article introduces the first attempt of the DTC in the data assimilation area to help achieve this goal. Since 2009, the DTC, NCEP’s Environmental Modeling Center (EMC), and other developers have made significant progress in transitioning the operational Gridpoint Statistical Interpolation (GSI) data assimilation system into a community-based code management framework. Currently, GSI is provided to the public with user support and is open for contributions from internal developers as well as the broader research community, following the same code transition procedures. This article introduces measures and steps taken during this community GSI effort followed by discussions of encountered challenges and issues. The purpose of this article is to promote contributions from the research community to operational data assimilation capabilities and, furthermore, to seek potential solutions to stimulate such a transition and, eventually, improve the NWP capabilities in the United States.

Community Support and Transition of Research to Operations for the Hurricane Weather Research and Forecasting Model

Abstract The Hurricane Weather Research and Forecasting Model (HWRF) is an operational model used to provide numerical guidance in support of tropical cyclone forecasting at the National Hurricane Center. HWRF is a complex multicomponent system, consisting of the Weather Research and Forecasting (WRF) atmospheric model coupled to the Princeton Ocean Model for Tropical Cyclones (POM-TC), a sophisticated initialization package including a data assimilation system and a set of postprocessing and vortex tracking tools. HWRF’s development is centralized at the Environmental Modeling Center of NOAA’s National Weather Service, but it incorporates contributions from a variety of scientists spread out over several governmental laboratories and academic institutions. This distributed development scenario poses significant challenges: a large number of scientists need to learn how to use the model, operational and research codes need to stay synchronized to avoid divergence, and promising new capabilities need to be tested for operational consideration. This article describes how the Developmental Testbed Center has engaged in the HWRF developmental cycle in the last three years and the services it provides to the community in using and developing HWRF.

Sensitivity of hurricane forecasts to cumulus parameterizations in the HWRF model

AbstractThe Developmental Testbed Center used the Hurricane Weather Research and Forecasting (HWRF) system to test the sensitivity of tropical cyclone track and intensity forecasts to different convective schemes. A control configuration that employed the HWRF Simplified Arakawa Scheme (SAS) was compared with the Kain‐Fritsch and Tiedtke schemes, as well as with a newer implementation of the SAS. A comprehensive test for Atlantic and Eastern North Pacific storms shows that the SAS scheme produces the best track forecasts. Even though the convective parameterization was absent in the inner 3 km nest, the intensity forecasts are sensitive to the choice of cumulus scheme on the outer grids. The impact of convective‐scale heating on the environmental flow accumulates in time since the hurricane vortex is cycled in the HWRF model initialization. This study shows that, for a given forecast, the sensitivity to cumulus parameterization combines the influence of physics and initial conditions.

Beyond the Basics: Evaluating Model-Based Precipitation Forecasts Using Traditional, Spatial, and Object-Based Methods

Abstract While traditional verification methods are commonly used to assess numerical model quantitative precipitation forecasts (QPFs) using a grid-to-grid approach, they generally offer little diagnostic information or reasoning behind the computed statistic. On the other hand, advanced spatial verification techniques, such as neighborhood and object-based methods, can provide more meaningful insight into differences between forecast and observed features in terms of skill with spatial scale, coverage area, displacement, orientation, and intensity. To demonstrate the utility of applying advanced verification techniques to mid- and coarse-resolution models, the Developmental Testbed Center (DTC) applied several traditional metrics and spatial verification techniques to QPFs provided by the Global Forecast System (GFS) and operational North American Mesoscale Model (NAM). Along with frequency bias and Gilbert skill score (GSS) adjusted for bias, both the fractions skill score (FSS) and Method for Object-Based Diagnostic Evaluation (MODE) were utilized for this study with careful consideration given to how these methods were applied and how the results were interpreted. By illustrating the types of forecast attributes appropriate to assess with the spatial verification techniques, this paper provides examples of how to obtain advanced diagnostic information to help identify what aspects of the forecast are or are not performing well.

The Emergence of Weather-Related Test Beds Linking Research and Forecasting Operations

Test beds have emerged as a critical mechanism linking weather research with forecasting operations. The U.S. Weather Research Program (USWRP) was formed in the 1990s to help identify key gaps in research related to major weather prediction problems and the role of observations and numerical models. This planning effort ultimately revealed the need for greater capacity and new approaches to improve the connectivity between the research and forecasting enterprise. Out of this developed the seeds for what is now termed “test beds.” While many individual projects, and even more broadly the NOAA/National Weather Service (NWS) Modernization, were successful in advancing weather prediction services, it was recognized that specific forecast problems warranted a more focused and elevated level of effort. The USWRP helped develop these concepts with science teams and provided seed funding for several of the test beds described. Based on the varying NOAA mission requirements for forecasting, differences in the organizational structure and methods used to provide those services, and differences in the state of the science related to those forecast challenges, test beds have taken on differing characteristics, strategies, and priorities. Current test bed efforts described have all emerged between 2000 and 2011 and focus on hurricanes (Joint Hurricane Testbed), precipitation (Hydrometeorology Testbed), satellite data assimilation (Joint Center for Satellite Data Assimilation), severe weather (Hazardous Weather Testbed), satellite data support for severe weather prediction (Short-Term Prediction Research and Transition Center), mesoscale modeling (Developmental Testbed Center), climate forecast products (Climate Testbed), testing and evaluation of satellite capabilities [Geostationary Operational Environmental Satellite-R Series (GOES-R) Proving Ground], aviation applications (Aviation Weather Testbed), and observing system experiments (OSSE Testbed).

A quantitative evaluation of the high resolution HARMONIE model for critical weather phenomena

Abstract. The high resolution non-hydrostatic Harmonie model (Seity et al., 2012) seems capable of delivering high quality precipitation forecasts. The quality with respect to the European radar composite is assessed using the Model Evaluation Tool, as distributed by the NCAR DTC (Developmental Testbed Center, 2012), and compared to that of the reference run of Hirlam (Unden et al., 2002), the current operational NWP model at KNMI. Both neighbourhood and object-based verification methods are compared for a week with several high intensity precipitation events in July 2010. It is found that Hirlam scores very well in most metrics, and that in spite of the higher resolution the added value of the Harmonie model is sometimes hard to quantify. However, higher precipitation intensities are better represented in the Harmonie model with its higher resolution. Object-based methods do not yet yield a sharp distinction between the different models, as it proves difficult to construct a meaningful and distinguishing metric with a solid physical basis for the many settings that can be varied.

Establishing Closer Collaboration to Improve Model Physics for Short-Range Forecasts

AffiliAtions: Wolff—research applications laboratory, national Center for atmospheric research, and developmental testbed Center, boulder, Colorado; ferrier—national Centers for Environmental prediction/Environmental modeling Center, Camp springs, maryland; maSS—University of Washington, seattle, Washington Corresponding Author: Jamie K. Wolff, ral, nCar, p.o. box 3000, boulder, Co 80307-3000 E-mail: jwolff@ucar.edu

An HWRF-based ensemble assessment of the land surface feedback on the post-landfall intensification of Tropical Storm Fay (2008)

While tropical cyclones (TCs) usually decay after landfall, Tropical Storm Fay (2008) initially developed a storm central eye over South Florida by anomalous intensi- fication overland. Unique to the Florida peninsula are Lake Okeechobee and the Ever- glades, which may have provided a surface feedback as the TC tracked near these features around the time of peak intensity. Analysis is done with the use of an ensemble model- based approach with the Developmental Testbed Center (DTC) version of the Hurricane WRF (HWRF) model using an outer domain and a storm-centered moving nest with 27- and 9-km grid spacing, respectively. Choice of land surface parameterization and small- scale surface features may influence TC structure, dictate the rate of TC decay, and even the anomalous intensification after landfall in model experiments. Results indicate that the HWRF model track and intensity forecasts are sensitive to three features in the model framework: land surface parameterization, initial boundary conditions, and the choice of planetary boundary layer (PBL) scheme. Land surface parameterizations such as the Geophysical Fluid Dynamics Laboratory (GFDL) Slab and Noah land surface models (LSMs) dominate the changes in storm track, while initial conditions and PBL schemes cause the largest changes in the TC intensity overland. Land surface heterogeneity in

Improving Numerical Weather Predictions of Summertime Precipitation over the Southeastern United States through a High-Resolution Initialization of the Surface State

Abstract It is hypothesized that high-resolution, accurate representations of surface properties such as soil moisture and sea surface temperature are necessary to improve simulations of summertime pulse-type convective precipitation in high-resolution models. This paper presents model verification results of a case study period from June to August 2008 over the southeastern United States using the Weather Research and Forecasting numerical weather prediction model. Experimental simulations initialized with high-resolution land surface fields from the National Aeronautics and Space Administration’s (NASA) Land Information System (LIS) and sea surface temperatures (SSTs) derived from the Moderate Resolution Imaging Spectroradiometer (MODIS) are compared to a set of control simulations initialized with interpolated fields from the National Centers for Environmental Prediction’s (NCEP) 12-km North American Mesoscale model. The LIS land surface and MODIS SSTs provide a more detailed surface initialization at a resolution comparable to the 4-km model grid spacing. Soil moisture from the LIS spinup run is shown to respond better to the extreme rainfall of Tropical Storm Fay in August 2008 over the Florida peninsula. The LIS has slightly lower errors and higher anomaly correlations in the top soil layer but exhibits a stronger dry bias in the root zone. The model sensitivity to the alternative surface initial conditions is examined for a sample case, showing that the LIS–MODIS data substantially impact surface and boundary layer properties. The Developmental Testbed Center’s Meteorological Evaluation Tools package is employed to produce verification statistics, including traditional gridded precipitation verification and output statistics from the Method for Object-Based Diagnostic Evaluation (MODE) tool. The LIS–MODIS initialization is found to produce small improvements in the skill scores of 1-h accumulated precipitation during the forecast hours of the peak diurnal convective cycle. Because there is very little union in time and space between the forecast and observed precipitation systems, results from the MODE object verification are examined to relax the stringency of traditional gridpoint precipitation verification. The MODE results indicate that the LIS–MODIS-initialized model runs increase the 10 mm h−1 matched object areas (“hits”) while simultaneously decreasing the unmatched object areas (“misses” plus “false alarms”) during most of the peak convective forecast hours, with statistically significant improvements of up to 5%. Simulated 1-h precipitation objects in the LIS–MODIS runs more closely resemble the observed objects, particularly at higher accumulation thresholds. Despite the small improvements, however, the overall low verification scores indicate that much uncertainty still exists in simulating the processes responsible for airmass-type convective precipitation systems in convection-allowing models.

The Developmental Testbed Center and its Winter Forecasting Experiment

The Weather Research and Forecasting (WRF) Developmental Testbed Center (DTC) was formed to promote exchanges between the development and operational communities in the field of Numerical Weather Prediction (NWP). The WRF DTC serves to accelerate the transfer of NWP technology from research to operations and to support a subset of the current WRF operational configurations to the general community. This article describes the mission and recent activities of the WRF DTC, including a detailed discussion about one of its recent projects, the WRF DTC Winter Forecasting Experiment (DWFE). DWFE was planned and executed by the WRF DTC in collaboration with forecasters and model developers. The real-time phase of the experiment took place in the winter of 2004/05, with two dynamic cores of the WRF model being run once per day out to 48 h. The models were configured with 5-km grid spacing over the entire continental United States to ascertain the value of high-resolution numerical guidance for winter weather predi...