Intercomparison Exercise Research Articles

Importance of the quality management of aerobiological monitoring networks: The case study of Madrid Region in Spain

Interest in biological air quality monitoring is rising, and updated public information is increasingly demanded by stakeholders in the case of airborne pollen, which requires maintaining high standards of data quality. The number of aerobiological stations worldwide is continuously growing, and quality management is becoming more complex with the increase in the scale of aerobiological networks. Quality control exercises are crucial for maintaining the quality of the data used in the pollen monitoring routine over time. In this study we show the results of an intercomparison test among technicians in the Madrid Region Palynological Network in central Spain in order to identify potential sources of error during the pollen analysis. The findings of this intercomparison exercise indicated very high-quality pollen data based on two different proficiency tests: i) the technicians' analysis of common samples with the light microscopes used in the routine pollen analysis; and ii) the analysis of common samples with all technicians using the same light microscope. A few specific remarkable errors were detected (i.e., those whose Absolute Error > |10| and Relative Error > |20 %|), such as confusion by four participants between Quercus vs. Acer and Quercus vs. Platanus pollen. Since the pollen analysis routine requires very experienced professionals, we believe it is essential to provide adequate training programmes for pollen analysis and the specific identification of these problematic pollen types. High-quality environmental data is crucial for sharing with regional, national and continental networks to ensure applicability, reproducibility and integration in large-scale studies.

Experimental design for the Marine Ice Sheet–Ocean Model Intercomparison Project – phase 2 (MISOMIP2)

Abstract. The Marine Ice Sheet–Ocean Model Intercomparison Project – phase 2 (MISOMIP2) is a natural progression of previous and ongoing model intercomparison exercises that have focused on the simulation of ice-sheet and ocean processes in Antarctica. The previous exercises motivate the move towards realistic configurations, as well as more diverse model parameters and resolutions. The main objective of MISOMIP2 is to investigate the performance of existing ocean and coupled ice-sheet–ocean models in a range of Antarctic environments through comparisons to observational data. We will assess the status of ice-sheet–ocean modelling as a community and identify common characteristics of models that are best able to capture observed features. As models are highly tuned based on present-day data, we will also compare their sensitivity to prescribed abrupt atmospheric perturbations leading to either very warm or slightly warmer ocean conditions compared to the present day. The approach of MISOMIP2 is to welcome contributions of models as they are, including global and regional configurations, but we request standardized variables and common grids for the outputs. We target the analysis at two specific regions, the Amundsen Sea and the Weddell Sea, since they describe two different ocean environments and have been relatively well observed compared to other areas of Antarctica. An observational “MIPkit” synthesizing existing ocean and ice-sheet observations for a common period is provided to evaluate ocean and ice-sheet models in these two regions.

International intercomparison and quality assessment of passive and active 222Rn measuring devices in the Asia-Pacific region

Intercomparison exercise is an integral part of the quality assurance programmes in 222Rn measurements using active and passive devices. Ensuring the accuracy of data generated through measurements necessitates periodic performance checks. To achieve harmonization of methods, quantify biases and errors in measurements, and identify the reasons for discrepancies, there is a pressing need for periodic intercomparison exercises. To address this need of numerous laboratories, particularly in the Asia-Pacific region, a calibration facility for 222Rn measuring devices has been established at the Centre for Advanced Research in Environmental Radioactivity (CARER), Mangalore University, India. An international intercomparison exercise for the 222Rn measuring devices was conducted at this facility in the year 2022 with the participation of 10 laboratories from six countries. A total of 354 devices (comprising of both active and passive detectors) were subjected to intercomparison measurements by exposing them to three concentration levels: (5.97 ± 0.29) × 103 Bq m−3, (0.70 ± 0.09) × 103 Bq m−3 and (2.02 ± 0.20) × 103 Bq m−3 in separate experiments and the exposure durations were 7 days, 15 days, and 10 days respectively. The performance of each laboratory was evaluated following the criterion adopted by the International Atomic Energy Agency (IAEA) in its worldwide proficiency test programmes. This exercise brought out the fact that some of the laboratories need to improve their measurement practices to produce reliable data.

Study of the Chemical Recovery and Selectivity against U in the Radiochemical Separation of Th with Tri-n-butyl Phosphate by Varying the Proportion of Xylene and HCl Concentration.

Thorium is a radionuclide used in various environmental studies such as dating, sediment movement, soil-plant transfer studies, and contamination of waste from the natural fuel cycle. The liquid-liquid extraction method using tri-n-butyl phosphate (TBP) allows for the separation of Th from the accompanying actinides. However, the separation of Th and U present in the same sample is not trivial. This separation is influenced by the starting acid (HCl or HNO3), the concentration of TBP in an organic solvent, and the concentration of the acid used for re-extracting Th, which is typically HCl. Therefore, it is necessary to study these factors to ensure that the method has sufficient chemical yield and selectivity in complex matrices. This study presents a systematic investigation of the aforementioned parameters, making the necessary variations to select an optimal method for the radiochemical separation of Th. The ideal conditions were obtained using 4 M HCl as the acid prior to extraction, a 1:4 solution of TBP in xylene, and 4 M HCl as the re-extracting agent. The accuracy and precision were studied in four intercomparison exercises conducted in quadruplicate, using the parameters Enumbers, RB(%), and RSD(%) for 232Th and 230Th. The sensitivity of the method was experimentally studied and the limit of detection (LoD) was determined according to ISO 11929:2005. Additionally, the linearity of the method showed that the experimental and theoretical activity concentrations of 232Th and 230Th had slopes of 1 with an intercept close to 0.

Atmospheric Dispersion Software Intercomparison Exercise and Sensitivity of Results

Atmospheric Dispersion Software Intercomparison Exercise and Sensitivity of Results

Distinct sources of uncertainty in simulations of the ocean biological carbon pump at different depths

Model uncertainty in simulating the biological carbon pump was quantified and partitioned using 14 models from the Coupled Model Intercomparison Project Phase 6. Uncertainty increases with depth. On the global scale, uncertainty in carbon export dominates above 900 m and uncertainty in transfer efficiency below. Reducing model uncertainty in carbon export and transfer efficiency offers similar benefits for understanding century-scale carbon sequestration and climate. These models produce three different qualitative patterns in transfer efficiency: one where it is globally homogenous and two opposite latitudinal patterns due to different model structures and parameters. The exponent b of the Martin curve, which has long been used to compare different representations of transfer efficiency, is shown here to underestimate uncertainty in transfer efficiency. This highlights the importance of using vertical profiles of carbon flux rather than the single exponent b in model validation and intercomparison exercises.

Full mission evaluation of EnMAP water leaving reflectance products using three atmospheric correction processors.

This study presents what we believe is the first extensive assessment of the water reflectance products from the German hyperspectral Environmental Mapping and Analysis Program (EnMAP). We evaluate EnMAP's standard normalized water leaving reflectance [ρW]N over 17 water sites in the first two years of the mission. The EnMAP [ρW]N standard product is generated by a dedicated water atmospheric correction (AC) called the Modular Inversion Program (MIP). The quality of the [ρW]N retrievals was assessed using in situ hyperspectral measurements and Aerosol Robotic Network - Ocean Colour (AERONET-OC) multispectral measurements. The results showed very good agreement between in situ hyperspectral match-ups and EnMAP [ρW]N, with an underestimation of EnMAP of -17.37% (bias, β) and an error (ϵ) of 23.75% at 418 - 797 nm. Two other AC processors were also investigated: the polynomial based algorithm applied to MERIS (Polymer) and the atmospheric correction for OLI lite (Acolite). The intercomparison exercise between the three AC methods applied to EnMAP data using the hyperspectral match-up dataset showed better statistical metrics for MIP (ϵ=23%,β=-17.37%) compared to Polymer (ϵ=42.20%,β=-2.43%) and Acolite (ϵ=97%,β=97%). The superior performance of MIP was further confirmed by the validation results obtained with the multispectral match-up dataset; MIP retrievals show good agreement with in situ measurements at the majority of study sites. Conversely, Polymer and Acolite retrievals tended to overestimate, especially in clearer waters as the Lampedusa study site.

Comparing net zero pathways across the Atlantic A model inter-comparison exercise between the Energy Modeling Forum 37 and the European Climate and Energy Modeling Forum

Europe and North America account for 32 % of current carbon emissions. Due to distinct legacy systems, energy infrastructure, socioeconomic development, and energy resource endowment, both regions have different policy and technological pathways to reach net zero by the mid-century. Against this background, our paper examines the results from the net zero emission scenarios for Europe and North America that emerged from the collaboration of the European and American Energy Modeling Forums. In our analysis, we perform an inter-comparison of various integrated assessments and bottom-up energy system models. A clear qualitative consensus emerges on five main points. First, Europe and the United States reach net zero targets with electrification, demand-side reductions, and carbon capture and sequestration technologies. Second, the use of carbon capture and sequestration is more predominant in the United States due to a steeper decarbonization schedule. Third, the buildings sector is the easiest to electrify in both regions. Fourth, the industrial sector is the hardest to electrify in the United States and transportation in Europe.Fifth, in both regions, the transition in the energy mix is driven by the substitution of coal and natural gas with solar and wind, but to a different extent.

Radiation Research Society Journal-based Historical Review of the Use of Biomarkers for Radiation Dose and Injury Assessment: Acute Health Effects Predictions.

A multiple-parameter based approach using radiation-induced clinical signs and symptoms, hematology changes, cytogenetic chromosomal aberrations, and molecular biomarkers changes after radiation exposure is used for biodosimetry-based dose assessment. In the current article, relevant milestones from Radiation Research are documented that forms the basis of the current consensus approach for diagnostics after radiation exposure. For example, in 1962 the use of cytogenetic chromosomal aberration using the lymphocyte metaphase spread dicentric assay for biodosimetry applications was first published in Radiation Research. This assay is now complimented using other cytogenetic chromosomal aberration assays (i.e., chromosomal translocations, cytokinesis-blocked micronuclei, premature chromosome condensation, γ-H2AX foci, etc.). Changes in blood cell counts represent an early-phase biomarker for radiation exposures. Molecular biomarker changes have evolved to include panels of organ-specific plasma proteomic and blood-based gene expression biomarkers for radiation dose assessment. Maturation of these assays are shown by efforts for automated processing and scoring, development of point-of-care diagnostics devices, service laboratories inter-comparison exercises, and applications for dose and injury assessments in radiation accidents. An alternative and complementary approach has been advocated with the focus to de-emphasize "dose" and instead focus on predicting acute or delayed health effects. The same biomarkers used for dose estimation (e.g., lymphocyte counts) can be used to directly predict the later developing severity degree of acute health effects without performing dose estimation as an additional or intermediate step. This review illustrates contributing steps toward these developments published in Radiation Research.

Interlaboratory comparison exercises for organically-bound tritium in the development of reference materials of environmental samples

The complex behavior of tritium and the probability of increasing tritium concentrations released in the environment were the promotors for the research and development of laboratory methods that enable to accurately determine the various forms of tritium including organically-bound tritium (OBT) for public and regulatory assurance. The measurement of tritium is a key step for dose and risk assessment. The Cernavoda Nuclear Power Plant (NPP) in Romania improved preparation methods and tested environmental matrices for OBT analysis through intercomparison exercises. This paper describes the international Organically-Bound Tritium (OBT) intercomparison exercise, organized by the Cernavoda Nuclear Power Plant (NPP) in 2019–2020, using fruit sample (quince) from Cernavoda town. Evaluation of the results from the participating laboratories was performed using both robust analysis (Algorithm A) method described in the ISO 13528:2015 standard and ANOVA method. The results obtained are encouraging as an increased number of participating laboratories did not change the observed dispersion of the results for activity concentration level around 50 Bq/L of combustion water. The stability of the remaining sample will be checked in time to investigate its use as a reference material for OBT analysis at the environmental levels.

Using dispersion models at microscale to assess long-term air pollution in urban hot spots: A FAIRMODE joint intercomparison exercise for a case study in Antwerp

In the framework of the Forum for Air Quality Modelling in Europe (FAIRMODE), a modelling intercomparison exercise for computing NO2 long-term average concentrations in urban districts with a very high spatial resolution was carried out. This exercise was undertaken for a district of Antwerp (Belgium). Air quality data includes data recorded in air quality monitoring stations and 73 passive samplers deployed during one-month period in 2016. The modelling domain was 800 × 800 m2. Nine modelling teams participated in this exercise providing results from fifteen different modelling applications based on different kinds of model approaches (CFD – Computational Fluid Dynamics-, Lagrangian, Gaussian, and Artificial Intelligence). Some approaches consisted of models running the complete one-month period on an hourly basis, but most others used a scenario approach, which relies on simulations of scenarios representative of wind conditions combined with post-processing to retrieve a one-month average of NO2 concentrations.The objective of this study is to evaluate what type of modelling system is better suited to get a good estimate of long-term averages in complex urban districts. This is very important for air quality assessment under the European ambient air quality directives. The time evolution of NO2 hourly concentrations during a day of relative high pollution was rather well estimated by all models. Relative to high resolution spatial distribution of one-month NO2 averaged concentrations, Gaussian models were not able to give detailed information, unless they include building data and street-canyon parameterizations. The models that account for complex urban geometries (i.e. CFD, Lagrangian, and AI models) appear to provide better estimates of the spatial distribution of one-month NO2 averages concentrations in the urban canopy. Approaches based on steady CFD-RANS (Reynolds Averaged Navier Stokes) model simulations of meteorological scenarios seem to provide good results with similar quality to those obtained with an unsteady one-month period CFD-RANS simulations.

Development of an accreditation process for analytical methods to measure microplastics in drinking water for regulatory monitoring

Development of a laboratory accreditation program to ensure competency of laboratories performing analytical measurements is a key step in adopting new analytical measurement methods for regulatory decision-making. Here, we describe California's three-part accreditation process for spectroscopically measuring microplastics in drinking water, and show how data from a multi-laboratory method comparison study informed development of accreditation programs for the resulting methods, which can inform analogous future work for other analytes. The first part is periodic performance evaluation (PE) samples, in which laboratories are provided blind samples of known composition to quantify within acceptable performance limits. The second is inspection, or audit, assessing whether the laboratory has the proper equipment to conduct the work and whether it is correctly employing proper procedures. The third is implementation of a quality management system providing documentation that protocols demonstrated during inspection are continuously maintained. These fell into three broad categories: instrument maintenance; laboratory cleanliness, especially important for microplastics and one that must be accompanied by a blanks measurement and correction process; and training so samples are being processed by qualified analysts. An intercomparison exercise among 22 laboratories was necessary to determine what parameter permutations were important for PE samples, and expected accuracy from competent laboratories. The recommended PE sample composition was two size categories (20-50um and 500um-1mm), two polymer types, and two morphologies (fibers and non-fibers). Discussions among intercomparison exercise participants were key in determining the factors that most contributed to laboratory variability, and the focus for both on-site inspections and quality management systems.

Globally consistent estimates of high-resolution Antarctic ice mass balance and spatially resolved glacial isostatic adjustment

Abstract. A detailed understanding of how the Antarctic ice sheet (AIS) responds to a warming climate is needed because it will most likely increase the rate of global mean sea level rise. Time-variable satellite gravimetry, realized by the Gravity Recovery and Climate Experiment (GRACE) and Gravity Recovery and Climate Experiment Follow-On (GRACE-FO) missions, is directly sensitive to AIS mass changes. However, gravimetric mass balances are subject to two major limitations. First, the usual correction of the glacial isostatic adjustment (GIA) effect by modelling results is a dominant source of uncertainty. Second, satellite gravimetry allows for a resolution of a few hundred kilometres only, which is insufficient to thoroughly explore causes of AIS imbalance. We have overcome both limitations by the first global inversion of data from GRACE and GRACE-FO, satellite altimetry (CryoSat-2), regional climate modelling (RACMO2), and firn densification modelling (IMAU-FDM). The inversion spatially resolves GIA in Antarctica independently from GIA modelling jointly with changes of ice mass and firn air content at 50 km resolution. We find an AIS mass balance of −144 ± 27 Gt a−1 from January 2011 to December 2020. This estimate is the same, within uncertainties, as the statistical analysis of 23 different mass balances evaluated in the Ice sheet Mass Balance Inter-comparison Exercise (IMBIE; Otosaka et al., 2023b). The co-estimated GIA corresponds to an integrated mass effect of 86 ± 21 Gt a−1 over Antarctica, and it fits better with global navigation satellite system (GNSS) results than other GIA predictions. From propagating covariances to integrals, we find a correlation coefficient of −0.97 between the AIS mass balance and the GIA estimate. Sensitivity tests with alternative input data sets lead to results within assessed uncertainties.

Lessons on harmonization of scoring criteria for dicentric chromosome assay in South Korea

Purpose Networking with other biodosimetry laboratories is necessary to assess the radiation exposure of many individuals in large-scale radiological accidents. The Korea biodosimetry network, K-BioDos, prepared harmonized scoring guidelines for dicentric chromosome assay to obtain homogeneous results within the network and investigated the efficiency of the guidelines. Materials and methods Three laboratories in K-BioDos harmonized the scoring guidelines for dicentric chromosome assay. The results of scoring dicentric chromosomes using the harmonized scoring guidelines were compared with the laboratories’ results using their own methods. Feedback was collected from the scorers following the three intercomparison exercises in 3 consecutive years. Results K-BioDos members showed comparable capacity to score dicentrics in the three exercises. However, the results of the K-BioDos guidelines showed no significant improvement over those of the scorers’ own methods. According to the scorers, our harmonized guidelines led to more rejected metaphases and ultimately decreased the number of scorable metaphases compared with their own methods. Moreover, the scoring time was sometimes longer with the K-BioDos protocol because some scorers were not yet familiar with the guidelines, though most scorers reported that the time decreased or was unchanged. These challenges may cause low adherence to the guidelines. Most scorers expressed willingness to use the guidelines to select scorable metaphases or identify dicentrics for other biodosimetry works, whereas one did not want to use it due to the difference from their calibration curves. Conclusions We identified potential resistance to following the harmonized guidelines and received requests for more detailed methods. Our findings suggest that the harmonized criteria should be continually updated, and education and training should be provided for all scorers. These changes could allow members within the biodosimetry network to successfully collaborate and support each other in large-scale radiological accidents.

The Use of Z-scores in External Performance Evaluation of Inter-comparison Exercises

The Use of Z-scores in External Performance Evaluation of Inter-comparison Exercises

226Ra activity concentration determined directly from the 186 keV photopeak using gamma spectrometry and a neural network

Determining 226Ra activity concentration directly from the 186 keV photopeak using gamma spectrometry avoids the 21-day waiting time required for indirect calculation from 214Pb or 214Bi. Calculation methods using the 186 keV photopeak, suppressing the 235U interference, are satisfactory but do not allow the analyst to correct for possible biases due to the calculation. This paper therefore examines the use of an alternative method based on a neural network that allows enrichment and monitoring of the solution to the problem, taking into account the concentrations of reference activities or those obtained from 214Pb in the samples analysed. The 226Ra counts at the 186 keV peak were determined by fitting two Gaussian functions whose figure of merit was minimised using the Levenberg–Marquardt algorithm. The results obtained were validated and fed into the neural network, using 70% for training and 30% for testing. Network learning was estimated using samples of comparative exercises, which were analysed and then used to train the network. The possibility of increasing the number of values used to train the network was also investigated using interpolation of linear and quadratic splines. The accuracy and precision of the 226Ra activity concentrations obtained by the neural network, as determined by Student's pair-wise t-test and Fisher's F-test, in samples from different intercomparison exercises were statistically comparable (p > 0.05) at 60% and 73%, respectively. Finally, the percentage of acceptability of the 226Ra activity concentrations with respect to the usual criteria of intercomparison exercises (En ≤ ±1 and D% ≤ ±20%) was 55%, which is comparable to the 60% obtained by the numerical algorithm developed in a previous study.

Intercomparison exercise on difficult to measure alpha radionuclides in spent ion exchange resin

In radiochemical analysis of decommissioning waste, reference materials are not commercially available and consequently intercomparison exercises are needed for method validations. This paper reports the results from an intercomparison exercise focusing on analyses of α-emitter radionuclides in spent ion exchange resin. The exercise and statistical analysis of the submitted results were carried out based on ISO 13528 standard according to which the assigned values were calculated from the participant’s results and the performances were assessed using z-scores, which showed excellent performance for all 241Am analyses, good performance for 238Pu analyses, tolerable performance for 239,240Pu analyses, and questionable 243,244Cm analyses.

Radiometric assessment of OLCI, VIIRS, and MODIS using fiducial reference measurements along the Atlantic Meridional Transect

High quality independent ground measurements that are traceable to metrology standards, with a full uncertainty budget, are required for validation over the lifetime of ocean-colour satellite missions. In this paper, we used radiometric Fiducial Reference Measurements (FRM) collected during four Atlantic Meridional Transect (AMT) field campaigns from 2016 to 2019 to assess the performance of radiometric products from the Ocean and Land Colour Instrument (OLCI) aboard Sentinel-3A (S-3A) and 3B (S‐3B), the Moderate Resolution Imaging Spectroradiometer instrument aboard Aqua (MODIS-Aqua), and the Visible Infrared Imaging Radiometer Suite instrument aboard Suomi NPP and NOAA-20 (Suomi-VIIRS and NOAA-20 VIIRS). The AMT provides one of the few sampling platforms that make high-quality in situ radiometric measurements in oligotrophic, low chlorophyll-a oceanic waters for ocean colour satellite validation. In situ data were acquired and processed following established FRM protocols, calibrated to metrology standards, referenced to inter-comparison exercises and with a full uncertainty budget. From these we selected an uncertainty threshold, which we used as part of a matchup procedure that takes into account the temporal and spatial variability of both the in situ and satellite data. Three atmospheric correction models were compared for S-3A and S‐3B OLCI radiometric products; the standard OLCI IPF-OL-2, POLYMER and NASA SeaDAS l2gen. Based on the round-robin comparison, POLYMER provided the best performance in the retrieval of water-leaving radiances. The analysis showed that Suomi-VIIRS and MODIS-Aqua performed better than NOAA-20 VIIRS, and comparably with S‐3B OLCI standard products. The S-3A OLCI standard product outperformed the NASA products. The S-3A OLCI and S‐3B OLCI instruments were also compared during their tandem phase, which showed that S‐3B OLCI radiances were systematically higher than S-3A OLCI across the spectrum.

Evaluation of Environmental Tritium Activity Levels and the Impact on the Public Health Around the Cernavoda Nuclear Power Plant after 25 Years of Operation

The Cernavoda Nuclear Power Plant (NPP), the only CANDU (CANada Deuterium Uranium) technology in Europe, is located in the southeast of Romania at the confluence of the Danube River and the Danube–Black Sea Channel, about 60 km from the Black Sea (Constanta County) and about 160 km from Bucharest. The Cernavoda NPP has two operating units of 700 MW(electric) and produces about 20% of the electric power of Romania (Unit 1 since December 1996 and Unit 2 since November 2007). The Environmental Control Laboratory (ECL) of the Cernavoda NPP, located in Cernavoda town 2 km from the Cernavoda NPP, is part of the Radiation Protection Department and is equipped with performant analyzing systems to determine the natural and artificial radionuclide levels in the environmental samples within a 30-km area around the Cernavoda NPP. The Environmental Radioactivity Monitoring Program for the Cernavoda NPP started in 1996, and all necessary activities are performed in the ECL, which has a quality assurance program according to the appropriate international standards and is participating in many intercomparison exercises and proficiency tests to validate the analyzing methods and to demonstrate the effectiveness of the environmental program, as a mandatory condition in the certification of the ECL and the reauthorization process of the Cernavoda NPP by the Romanian regulatory body, National Commission for Nuclear Activities Control. The annual report contains all the results for the environmental radioactivity monitoring and effluent monitoring; the results of the monitoring program are annually compared with the results of the Preoperational Environmental Monitoring Program performed between 1984 and 1994. This paperwork presents the evaluation of tritium activity levels in environmental samples around the Cernavoda NPP and the impact on the public health after 25 years of operation (1996 to 2021).

Sampling, characterization, method validation, and lessons learned in analysis of highly activated stainless steel from reactor decommissioning

Characterisation of activated reactor components is a multifaceted effort, which include both experimental work and activation calculations which together form a comprehensive characterisation approach. However, both the experimental work and activation calculations have their constraints and uncertainties. This work presents the characterisation of a highly activated stainless steel pipe including sampling planning, sampling, sub-sampling, elemental and radionuclide analyses, and activation calculations. 55Fe, 63Ni and 60Co analyses were carried out in a trilateral intercomparison exercise and the results were compared with activation calculations. The results showed excellent alignment between experimental and activation calculation results.