Radiation Transfer Model Intercomparison Research Articles

The fourth radiation transfer model intercomparison (RAMI‐IV): Proficiency testing of canopy reflectance models with ISO‐13528

The radiation transfer model intercomparison (RAMI) activity aims at assessing the reliability of physics‐based radiative transfer (RT) models under controlled experimental conditions. RAMI focuses on computer simulation models that mimic the interactions of radiation with plant canopies. These models are increasingly used in the development of satellite retrieval algorithms for terrestrial essential climate variables (ECVs). Rather than applying ad hoc performance metrics, RAMI‐IV makes use of existing ISO standards to enhance the rigor of its protocols evaluating the quality of RT models. ISO‐13528 was developed “to determine the performance of individual laboratories for specific tests or measurements.” More specifically, it aims to guarantee that measurement results fall within specified tolerance criteria from a known reference. Of particular interest to RAMI is that ISO‐13528 provides guidelines for comparisons where the true value of the target quantity is unknown. In those cases, “truth” must be replaced by a reliable “conventional reference value” to enable absolute performance tests. This contribution will show, for the first time, how the ISO‐13528 standard developed by the chemical and physical measurement communities can be applied to proficiency testing of computer simulation models. Step by step, the pre‐screening of data, the identification of reference solutions, and the choice of proficiency statistics will be discussed and illustrated with simulation results from the RAMI‐IV “abstract canopy” scenarios. Detailed performance statistics of the participating RT models will be provided and the role of the accuracy of the reference solutions as well as the choice of the tolerance criteria will be highlighted.

The NIMO Monte Carlo model for box-air-mass factor and radiance calculations

A new fully spherical multiple scattering Monte Carlo radiative transfer model named NIMO (NIWA Monte Carlo model) is presented. The ray tracing algorithm is described in detail along with the treatment of scattering and absorption, and the simulation of backward adjoint trajectories. The primary application of NIMO is the calculation of box-air-mass factors (box-AMFs), which are used to convert slant column densities (SCDs) of trace gases, derived from UV–visible multiple axis Differential Optical Absorption Spectroscopy (MAX-DOAS) measurements, into vertical column densities (VCDs). Box-AMFs are also employed as weighting functions for optimal estimation retrievals of vertical trace gas profiles from SCDs. Monte Carlo models are well suited to AMF calculations at high solar zenith angles (SZA) and at low viewing elevation angles where multiple scattering is important. Additionally, the object-oriented structure of NIMO makes it easily extensible to new applications by plugging in objects for new absorbing or scattering species. Box-AMFs and radiances, calculated for various wavelengths, SZAs, viewing elevation and azimuth angles and aerosol scenarios, are compared with results from nine other models using a set of exercises from a recent radiative transfer model intercomparison. NIMO results for these simulations are well within the range of variability of the other models.

RAMI4PILPS: An intercomparison of formulations for the partitioning of solar radiation in land surface models

[1] Remotely sensed, multiannual data sets of shortwave radiative surface fluxes are now available for assimilation into land surface schemes (LSSs) of climate and/or numerical weather prediction models. The RAMI4PILPS suite of virtual experiments assesses the accuracy and consistency of the radiative transfer formulations that provide the magnitudes of absorbed, reflected, and transmitted shortwave radiative fluxes in LSSs. RAMI4PILPS evaluates models under perfectly controlled experimental conditions in order to eliminate uncertainties arising from an incomplete or erroneous knowledge of the structural, spectral and illumination related canopy characteristics typical for model comparison with in situ observations. More specifically, the shortwave radiation is separated into a visible and near-infrared spectral region, and the quality of the simulated radiative fluxes is evaluated by direct comparison with a 3-D Monte Carlo reference model identified during the third phase of the Radiation transfer Model Intercomparison (RAMI) exercise. The RAMI4PILPS setup thus allows to focus in particular on the numerical accuracy of shortwave radiative transfer formulations and to pinpoint to areas where future model improvements should concentrate. The impact of increasing degrees of structural and spectral subgrid variability on the simulated fluxes is documented and the relevance of any thus emerging biases with respect to gross primary production estimates and shortwave radiative forcings due to snow and fire events are investigated.

Comparison of methods for measuring gap size distribution and canopy nonrandomness at Järvselja RAMI (RAdiation transfer Model Intercomparison) test sites

Methods for analyzing foliage nonrandomness by means of the TRAC instrument, digital hemispheric photography, and a gap fraction model are assessed at two RAMI (RAdiation transfer Model Intercomparison) mature stands in Järvselja, Estonia. The six different methods involve calculation of the canopy element clumping index, at scales coarser than that of a shoot. The major aim was to define the merits and limitations of the various methods. We conclude the gap size distribution and beyond-shoot clumping is very stable across the stands for the solar zenith angle range from 30° to 60°. Estimates based on the gap size distribution and the combination of gap size and logarithm methods performed the best while compared with an independent gap fraction model. We clarify the effect of the assumed leaf inclination angle distribution on gap size distribution and differences between estimates of beyond-shoot clumping. We show that the modified, gap-size distribution based method of Chen and Cihlar can provide reliable beyond-shoot clumping estimates without any a priori assumptions about the total gap fraction, segment length or the leaf inclination angle distribution. We also illustrate the changes in element clumping with measurement height. The compiled data extend the original parameter dataset to be used in the next phase of RAMI for different benchmark tests and reflectance modeling experiments, and contribute toward systematic validation efforts of radiative transfer models, operational algorithms, and field instruments, as promoted by the Committee on Earth Observation Satellites (CEOS).

Reflectance spectra of RAMI forest stands in Estonia: Simulations and measurements

Simulated reflectance spectra of three mature hemiboreal forests are compared to top-of-canopy reflectance factor from helicopter measurements in the spectral range of 400–1050 nm. Most of the input parameters of the forest reflectance model FRT used in the simulations have been measured in situ. The same data were used in the fourth phase of the Radiation Transfer Model Intercomparison (RAMI). The reasons of the discrepancies between simulated and measured spectra are analyzed.

Radiative forcing by long‐lived greenhouse gases: Calculations with the AER radiative transfer models

A primary component of the observed recent climate change is the radiative forcing from increased concentrations of long‐lived greenhouse gases (LLGHGs). Effective simulation of anthropogenic climate change by general circulation models (GCMs) is strongly dependent on the accurate representation of radiative processes associated with water vapor, ozone, and LLGHGs. In the context of the increasing application of the Atmospheric and Environmental Research, Inc. (AER), radiation models within the GCM community, their capability to calculate longwave and shortwave radiative forcing for clear sky scenarios previously examined by the radiative transfer model intercomparison project (RTMIP) is presented. Forcing calculations with the AER line‐by‐line (LBL) models are very consistent with the RTMIP line‐by‐line results in the longwave and shortwave. The AER broadband models, in all but one case, calculate longwave forcings within a range of −0.20 to 0.23 W m−2 of LBL calculations and shortwave forcings within a range of −0.16 to 0.38 W m−2 of LBL results. These models also perform well at the surface, which RTMIP identified as a level at which GCM radiation models have particular difficulty reproducing LBL fluxes. Heating profile perturbations calculated by the broadband models generally reproduce high‐resolution calculations within a few hundredths K d−1 in the troposphere and within 0.15 K d−1 in the peak stratospheric heating near 1 hPa. In most cases, the AER broadband models provide radiative forcing results that are in closer agreement with high‐resolution calculations than the GCM radiation codes examined by RTMIP, which supports the application of the AER models to climate change research.

The RAMI On-line Model Checker (ROMC): A web-based benchmarking facility for canopy reflectance models

The exploitation of global Earth Observation data hinges increasingly on physically-based radiative transfer (RT) models. These models simulate the interactions of solar radiation within a given medium (e.g., clouds, plant canopies) and are used to generate look-up-tables that are embedded into quantitative retrieval algorithms, such as those delivering the operational surface products for MODIS, MISR and MERIS. An assessment of the quality of canopy RT models thus appears essential if accurate and reliable information is to be derived from them. Until recently such an undertaking was a time consuming and labour intensive process that was made even more challenging by the general lack of absolute reference standards. Several years of benchmarking activities in the frame of the RAdiation transfer Model Intercomparison (RAMI) exercise have now led to the development of the RAMI On-line Model Checker (ROMC). The ROMC is a web-based tool allowing model developers and users to autonomously assess the performance of canopy RT models ( http://romc.jrc.ec.europa.eu/). Access to the ROMC is free and enables users to obtain both statistical and graphical indications as to the performance of their canopy RT model. In addition to providing an overall indication of the skill of a given model to correctly match the reference data, the ROMC allows also for interactive comparison/evaluations of different model versions/submissions of a given user. All ROMC graphs can be downloaded in PostScript format and come with a reference number for easy usage in presentations and publications. It is hoped that the ROMC will prove useful for the RT modeling community as a whole, not only by providing a convenient means to evaluate models outside the triennial phases of RAMI but also to attract participation in future RAMI activities.

Third Radiation Transfer Model Intercomparison (RAMI) exercise: Documenting progress in canopy reflectance models

The Radiation Transfer Model Intercomparison (RAMI) initiative benchmarks canopy reflectance models under well‐controlled experimental conditions. Launched for the first time in 1999, this triennial community exercise encourages the systematic evaluation of canopy reflectance models on a voluntary basis. The first phase of RAMI focused on documenting the spread among radiative transfer (RT) simulations over a small set of primarily 1‐D canopies. The second phase expanded the scope to include structurally complex 3‐D plant architectures with and without background topography. Here sometimes significant discrepancies were noted which effectively prevented the definition of a reliable “surrogate truth,” over heterogeneous vegetation canopies, against which other RT models could then be compared. The present paper documents the outcome of the third phase of RAMI, highlighting both the significant progress that has been made in terms of model agreement since RAMI‐2 and the capability of/need for RT models to accurately reproduce local estimates of radiative quantities under conditions that are reminiscent of in situ measurements. Our assessment of the self‐consistency and the relative and absolute performance of 3‐D Monte Carlo models in RAMI‐3 supports their usage in the generation of a “surrogate truth” for all RAMI test cases. This development then leads (1) to the presentation of the “RAMI Online Model Checker” (ROMC), an open‐access web‐based interface to evaluate RT models automatically, and (2) to a reassessment of the role, scope, and opportunities of the RAMI project in the future.

Radiative forcing by well‐mixed greenhouse gases: Estimates from climate models in the Intergovernmental Panel on Climate Change (IPCC) Fourth Assessment Report (AR4)

The radiative effects from increased concentrations of well‐mixed greenhouse gases (WMGHGs) represent the most significant and best understood anthropogenic forcing of the climate system. The most comprehensive tools for simulating past and future climates influenced by WMGHGs are fully coupled atmosphere‐ocean general circulation models (AOGCMs). Because of the importance of WMGHGs as forcing agents it is essential that AOGCMs compute the radiative forcing by these gases as accurately as possible. We present the results of a radiative transfer model intercomparison between the forcings computed by the radiative parameterizations of AOGCMs and by benchmark line‐by‐line (LBL) codes. The comparison is focused on forcing by CO2, CH4, N2O, CFC‐11, CFC‐12, and the increased H2O expected in warmer climates. The models included in the intercomparison include several LBL codes and most of the global models submitted to the Intergovernmental Panel on Climate Change (IPCC) Fourth Assessment Report (AR4). In general, the LBL models are in excellent agreement with each other. However, in many cases, there are substantial discrepancies among the AOGCMs and between the AOGCMs and LBL codes. In some cases this is because the AOGCMs neglect particular absorbers, in particular the near‐infrared effects of CH4 and N2O, while in others it is due to the methods for modeling the radiative processes. The biases in the AOGCM forcings are generally largest at the surface level. We quantify these differences and discuss the implications for interpreting variations in forcing and response across the multimodel ensemble of AOGCM simulations assembled for the IPCC AR4.

Radiation Transfer Model Intercomparison (RAMI) exercise: Results from the second phase

The Radiation Transfer Model Intercomparison (RAMI) initiative is a community‐driven exercise to benchmark the models of radiation transfer (RT) used to represent the reflectance of terrestrial surfaces. Systematic model intercomparisons started in 1999 as a self‐organized, open‐access, voluntary activity of the RT modeling community. The results of the first phase were published by Pinty et al. [2001]. The present paper describes the benchmarking protocol and the results achieved during the second phase, which took place during 2002. This second phase included two major components: The first one included a rerun of all direct‐mode tests proposed during the first phase, to accommodate the evaluation of models that have been upgraded since, and the participation of new models into the entire exercise. The second component was designed to probe the performance of three‐dimensional models in complex heterogeneous environments, which closely mimic the observations of actual space instruments operating at various spatial resolutions over forest canopy systems. Phases 1 and 2 of RAMI both confirm not only that a majority of the radiation transfer models participating in RAMI are in good agreement between themselves for relatively simple radiation transfer problems but also that these models exhibit significant discrepancies when considering more complex but nevertheless realistic geophysical scenarios. Specific recommendations are provided to guide the future of this benchmarking program (Phase 3 and beyond).

Radiation transfer model intercomparison (RAMI) exercise

The community involved in modeling radiation transfer over terrestrial surfaces designed and implemented the first phase of a radiation transfer model intercomparison (RAMI) exercise. This paper discusses the rationale and motivation for this endeavor, presents the intercomparison protocol as well as the evaluation procedures, and describes the principal results. Participants were asked to simulate the transfer of radiation for a variety of precisely defined terrestrial environments and illumination conditions. These were abstractions of typical terrestrial systems and included both homogeneous and heterogeneous scenes. The differences between the results generated by eight different models, including both one‐dimensional and three‐dimensional approaches, were then documented and analyzed. RAMI proposed a protocol to quantitatively assess the consequences of the model discrepancies with respect to application, such as those motivating the development of physically based inversion procedures. This first phase of model intercomparison has already proved useful in assessing the ability of the modeling community to generate similar radiation fields despite the large panoply of models that were tested. A detailed analysis of the results also permitted to identify apparent “outliers” and their main deficiencies. Future undertakings in this intercomparison framework must be oriented toward an expansion of RAMI into other and more complex geophysical systems as well as the focusing on actual inverse problems.