Round Robin Test Research Articles

Measurement of sound reflection and sound insulation of installed noise barriers using the SOPRANOISE quick method

This paper presents the preliminary results of a study on the new possibilities emerging from the analysis of measurements on installed noise barriers following the quick method designed in the frame of the SOPRANOISE project. Measurements of sound reflection and sound insulation were done in laboratory on a full-scale acoustic barrier and on an acoustic barrier installed along the Brennero motorway in northern Italy. The measurements were carried out using the SOPRANOISE quick system device, designed and engineered to provide a fast and lightweight version of the Adrienne method (i.e., EN 1793-5 and EN 1793-6), and then checked by applying the standardized Adrienne method, using instrumentation and procedures validated during the round-robin test performed in the frame of the QUIESST project. The preliminary results of the measurements are presented.

International Round-Robin Test of Critical Current of Superconducting Cable Sample

International Round-Robin Test of Critical Current of Superconducting Cable Sample

Benchmarking whole exome sequencing in the German network for personalized medicine

IntroductionWhole Exome Sequencing (WES) has emerged as an efficient tool in clinical cancer diagnostics to broaden the scope from panel-based diagnostics to screening of all genes and enabling robust determination of complex biomarkers in a single analysis. MethodsTo assess concordance, six formalin-fixed paraffin-embedded (FFPE) tissue specimens and four commercial reference standards were analyzed by WES as matched tumor-normal DNA at 21 NGS centers in Germany, each employing local wet-lab and bioinformatics. Somatic and germline variants, copy-number alterations (CNAs), and complex biomarkers were investigated. Somatic variant calling was performed in 494 diagnostically relevant cancer genes. The raw data were collected and re-analyzed with a central bioinformatic pipeline to separate wet- and dry-lab variability. ResultsThe mean positive percentage agreement (PPA) of somatic variant calling was 76 % while the positive predictive value (PPV) was 89 % in relation to a consensus list of variants found by at least five centers. Variant filtering was identified as the main cause for divergent variant calls. Adjusting filter criteria and re-analysis increased the PPA to 88 % for all and 97 % for the clinically relevant variants. CNA calls were concordant for 82 % of genomic regions. Homologous recombination deficiency (HRD), tumor mutational burden (TMB), and microsatellite instability (MSI) status were concordant for 94 %, 93 %, and 93 % of calls, respectively. Variability of CNAs and complex biomarkers did not decrease considerably after harmonization of the bioinformatic processing and was hence attributed mainly to wet-lab differences. ConclusionContinuous optimization of bioinformatic workflows and participating in round robin tests are recommended.

International inter-laboratory comparison of solar heat gain coefficient of building-integrated photovoltaic modules results of tests with or without power generation and tests with PV cell coverage ratios

The solar heat gain coefficient is one of the important indicators to evaluate the performance of the building envelope components. In a BIPV module, secondary heat transfer to the indoors is reduced, compared to conventional glazing, due to the shielding effect of the PV cells and energy conversion by power generation. There is a difference in SHGC between power-generating (MPP) and effectively open-circuit (OC) states. In this paper, in order to prepare a calorimetric SHGC evaluation methodology for BIPV modules, we documented the current status of the experimental calorimetric test methods and test apparatus adopted by test laboratories in four different countries and identified the differences. Differences between the test laboratories were found in to the applied test methods, solar simulator types, spectral distributions, DC or AC power supplies for the solar simulator, irradiation inhomogeneity on the light-receiving surface of the test sample, temperature conditions between the test chamber and the metering box, and surface heat transfer coefficients. Especially, the round-robin test results obtained in an interlaboratory comparison clarified that the differences in the characteristics of the Calorimetic Hot Box and the Heat Flux Metering methodologies with a cooled plate, the differences in irradiation inhomogeneity on the light-receiving surface of the test sample and differences in surface heat transfer coefficients significantly affect the SHGC evaluation for BIPV modules. In addition, for the SHGC test in the MPP state, it was confirmed that an absolute SHGC reduction effect of 0.02 to 0.04 was obtained for a PV laminate with 81 % cell coverage, for all SHGC test methods and test apparatus. Pe characterises the effect of converting part of the sunlight absorbed by the PV cell into electric power and extracting it from the BIPV module, reducing the heat re-radiated indoors compared to the OC state. Due to this mechanism, the reduction effect Pe always occurs during power generation, regardless of the type of PV cell technology and whether the PV cells are opaque or transparent. In addition, the decrease in SHGC for a given glazing configuration was found to be proportional to the increase in PV cell coverage ratio. SHGC tests with four different cell coverage ratios confirmed that the relationship between PV cell coverage ratio and SHGC is linear to a high degree of accuracy when no electric power is extracted (OC state), provided that the incident radiation is spatially homogeneous. The results obtained will be useful when proposing a calorimetric SHGC evaluation methodology for international standardization, as they document the differences due to a range of test facilities and testing conditions, differences caused by power generation and extraction, and the effect of varying PV cell coverage ratios. The insights gained were valuable in identifying which aspects of test methodology and boundary conditions must be specified with particular attention to detail when calorimetric testing standards are extended to explicitly address the SHGC determination of BIPV modules.

Peer-to-peer validation of Ki-67 scoring in a pathology quality circle as a tool to assess interobserver variability: are we better than we thought?

Ki-67, a nuclear protein expressed in all stages of cellular proliferation, is a valuable tool to assess tumor proliferation and has been linked to more aggressive tumor behavior. However, interlaboratory staining heterogeneity and inter-observer variability challenge its reproducibility. Round Robin tests are a suitable tool to standardize and harmonize immunohistochemical and molecular analyses in histopathology. The study investigates the interrater and interlaboratory reproducibility of Ki-67-scoring using both manual and automated approaches. Unstained TMA slides comprising diverse tumor types (breast cancer, neuroendocrine tumors, lymphomas, and head and neck squamous cell carcinoma) were distributed to six pathology laboratories, each employing their routine staining protocols. Manual and automated scoring methods were applied, and interrater and interlaboratory agreement assessed using intraclass correlation coefficients (ICC). The results highlight good-to-excellent reliability overall, with automated scoring demonstrating higher consistency (ICC 0.955) than manual scoring (ICC 0.871). Results were more variable when looking at the individual entities. Reliability remained good for lymphomas (ICC 0.878) and breast cancer (ICC 0.784) and was poor in well-differentiated neuroendocrine tumors (ICC 0.354). This study clearly advocates standardized practices and training to ensure consistency in Ki-67-assessment, and it demonstrates that this can be achieved in a peer-to-peer approach in local quality-circles.

Sensitivity, robustness, and reproducibility of U-shaped delamination test for evaluation of candidate ultra-high molecular weight polyethylene materials for joint replacements.

The delamination of ultra-high molecular weight polyethylene (UHMWPE) in artificial joints is a major cause limiting the long-term clinical results of arthroplasty. However, the conventional test method using simple reciprocation to evaluate the delamination resistance of UHMWPE materials has insufficient detection sensitivity. To reproduce delamination, the unconformity contact must be maintained throughout the test so that the maximum stress is generated below the surface. Therefore, a test method that applies a U-shaped motion comprising two long-linear and one short linear sliding motion was developed. The sensitivity, robustness, and reproducibility of the U-shaped delamination test were investigated and compared with the traditional test method. The traditional test method could reproduce delamination only in materials that had degraded considerably, whereas the U-shaped delamination test could reproduce delamination in a wide range of materials, demonstrating its superior sensitivity. Additionally, using a higher load helped accelerate the test without affecting the test results. The optimal length of the short linear sliding motion was confirmed to be 1 mm. Finally, the inter-laboratory reproducibility of the U-shaped delamination test was confirmed using the round-robin test. The U-shaped delamination test demonstrates high sensitivity, robustness, and reproducibility and contributes to the selection and development of UHMWPE materials and artificial joints with a lower risk of delamination.

A novel noble-metal-free FeS2/Mn0.5Cd0.5S heterojunction for enhancing photocatalytic H2 production activity: Carrier separation, light absorption, active sites

BackgroundThe development of efficient and noble-metal-free photocatalysts is greatly essential for photocatalytic hydrogen production. However, the photocatalytic activity of a single photocatalyst is usually limited for various reasons. MethodsHerein, FeS2/Mn0.5Cd0.5S (FSMCS) heterojunctions were constructed by a simple solvent evaporation method. The morphological characterizations revealed a raspberry-like hollow microsphere structure for FeS2 and irregular granularity for Mn0.5Cd0.5S. Photoluminescence (PL) and electrochemical experiments indicated that the FSMCS composite effectively facilitated the separation of photogenerated electron-hole pairs. The UV–vis diffuse reflectance spectrum (DRS) showed that, in FSMCS composite, the visible light absorption range was effectively expanded to the full visible light. Significant findingsExcellent photocatalytic activity in FSMCS heterojunctions without loading noble metals because FeS2 could serve an active site for hydrogen production. The optimum FSMCS composite had excellent photocatalytic hydrogen production activity (6.1 mmol·g−1·h−1), which was 5.6 and 2.3 times higher than that of the pristine Mn0.5Cd0.5S (1.1 mmol·g−1·h−1) and Mn0.5Cd0.5S-1 %Pt (2.7 mmol·g−1·h−1). Meanwhile, in four round-robin tests, the activity of the 5FSMCS photocatalyst did not significantly decrease. This work proved that combining Mn0.5Cd0.5S and non-precious metal cocatalysts to construct heterojunctions is a promising strategy for photocatalytic hydrogen production.

A method for testing the gas-phase air cleaners using sensory assessments of air quality

Present standards prescribe chemical analyses for testing the performance of gas-phase air cleaners. As a part of IEA Annex 78, this study examined a prototype method for testing gas-phase air cleaners based on sensory evaluations of air quality. Four common gas-phase air cleaners were tested using the proposed method. The testing consisted of two phases: Phase 1 ensured that air cleaners had no negative effect on air quality, and Phase 2 provided a detailed characterisation of the removal efficiency of air cleaners. Air cleaners were tested in experimental rooms called field laboratories, and pollution sources comprised of building materials and humans. Thirty-one panellists were recruited. They rated the acceptability of air quality and odour intensity immediately upon entering the rooms and of the air extracted from them and presented in diffusers. Chemical measurements were made as well only in Phase 2. The operation of air cleaners reduced concentrations of VOCs regardless of the pollution source; the perceived air quality was only improved when the pollution source was building materials,supporting the necessity of inclusion of sensory ratings. The results also confirmed that comprehensive testing of air cleaners in Phase 2 should only be performed once it is documented that air cleaners positively reduce pollution exposures in Phase 1. The study followed methodologies proposed by the ISO 16000-44 standard, so the results validate and support this standard. The tests of different air cleaner configurations and the round-robin test are recommended to advance the methodology proposed and examined in the present study.

SPT approach for assessing mechanical properties of materials

The Round Robin Test of the Small Punch Test (SPT) method represents a critical step in establishing its reliability and applicability for assessing the mechanical properties of materials used in power plants. The mechanical properties of materials, such as strength and deformation characteristics, are of paramount importance in ensuring the structural integrity and safety of power generation facilities. The SPT method, a widely adopted in-situ testing technique, holds promise as a cost-effective means of evaluating these properties. However, its precision and consistency in different geological and operational contexts remain subjects of investigation. This study presents the results and findings from a comprehensive Round Robin Test aimed at rigorously assessing the SPT method's performance and suitability for characterizing materials within power plants. Multiple testing campaigns were conducted across diverse sites and material conditions, encompassing varying geological formations, moisture content, and temperature ranges. The objective was to evaluate the SPT method's repeatability, reproducibility, and accuracy in different operational environments.

Repeatability and reproducibility of physically consistent single sheet testing with H-coil

Measurements of magnetic losses of electric steel are usually performed by International Electrotechnical Commission standardized Epstein testers or Single Sheet Testers (SSTs). According to round robin tests, the corresponding levels of repeatability are of the order of 0.1%, and those of reproducibility are of the order of 1%. However, orders of absolute accuracy are unknown due to the applied “current method.” Here, we report corresponding tests for the so-called “physically consistent SST.” Consistency is achieved by a “giant” tangential field coil on a 50 cm long and 17 cm wide soft magnetic sample, using a thin amorphous yoke for magnetization. Tests were made in two labs with very different working conditions (sea levels of 200 and 1100 m, respectively), with very similarly built-up testers. Measurements were made for peak inductions between 1 and 1.9 T. For two distributed samples, the repeatability errors were lower than 0.3%, and the reproducibility errors were lower than 1%. This indicates that SSTs with an H-coil are not less reliable than current based ones. However, the absolute accuracy can be estimated to be much better, being close to 2%.

Simplified expressions of uncertainty for single number quantities in ISO 3382-3 (2022).

The ISO 3382-3 (2022) standard defines single number quantities (SNQs) characterizing the spatial decay of speech (D2S, LpAS4m, rC) and of its intelligibility (rD). The standard assesses the accuracy of the measurement using a unique uncertainty value for each SNQ, relying on a round-robin test performed in a single office. To make this assessment more accurate, analytical expressions have been established by applying the law of propagation of uncertainty. These expressions, although precise, are too complex to be included in the standard. This work consists of their simplification, relying on 95 measurements conducted in 36 companies in France and Germany. First, the terms associated with distance measurement uncertainties were found to be negligible. Second, the estimation of the uncertainties of A-weighted speech levels and Speech Transmission Index, based on the measurements made at the workstations constituting the 95 paths, enabled further simplifications. Finally, simplified expressions turn out to be as accurate as the original expressions, and the estimated uncertainties are comparable to those reported by Yadav et al. (2019). If a unique value of uncertainty is to be retained for each SNQ, this study suggests 0.6 dB for D2S and LpAS4m, 7% for rC, and 10% for rD.

Round‐robin test of all‐solid‐state battery with sulfide electrolyte assembly in coin‐type cell configuration

AbstractThe replacement of conventional lithium‐ion batteries with solid‐state batteries is currently under investigation by many players both from academia and industry. Sulfide‐based electrolytes are among the materials that are regarded as most promising, especially for application in the transport sector. The performance of anode, cathode, and solid electrolyte materials of this type of solid electrolyte is typically evaluated using manually assembled cells such as Swagelok cells, EL‐CELLs, and in‐house built pressure devices. Coin cells, however, are often disregarded. Though coin cells cannot accurately predict how a material will perform in an end‐use application battery cell format, they are easy to assemble and can provide reproducible data compared to the other cell types, which make them an interesting option for testing the materials under conditions more relevant for their envisioned application. The coin cell preparation method presented in this work has been evaluated interlaboratory for reproducibility and, in addition, can be modified depending on the optimization parameters of the solid electrolyte, cathode material, bilayer comprised on cathode and solid electrolyte, lithium metal anode, and cell in general. Besides, an interlab round‐robin test (RRT) is carried out between four laboratories, measuring defined electrochemical tests of sulfide solid‐state batteries in coin cell configuration. This RRT for the preparation of coin cell solid‐state batteries with sulfide solid electrolyte, lithium nickel manganese cobalt oxides cathode, and lithium metal anode is intended for academic researchers and provides guidelines of research in this field.

Measurement Method for Contact Wire Wear Based on Stereovision.

The contact wire wear is an important parameter to ensure the safety operation of electric railways. The contact wire may break if the wear is serious, which leads to transportation interruptions. This study proposes an optical measurement method of contact wire wear, using stereovision technology. The matching method of stereovision based on line-scan cameras is proposed. A lookup-table method is developed to exactly determine the image resolution caused by the contact wire being in different spatial positions. The wear width of the contact wire is extracted from catenaries' images, and the residual thickness of the contact wire is calculated. The method was verified by field tests. The round-robin tests of the residual thickness at the same location present excellent measurement repetitiveness. The maximum difference value between dynamic test results and ground measurement results is 0.13 mm. This research represents a potential way to implement condition-based maintenance for contact wire wear in the future in order to improve the maintenance efficiency and ensure the safety of catenary infrastructure.

Round Robin Test of Absorptance and Emittance of Particles for CSP

Precise knowledge of particle optical properties is crucial to the advancement and success of directly-irradiated particle receiver technologies. This work presents the results of a Round Robin Test (RRT) that was conducted between seven laboratories, where each participant measured the absorptance and emittance for a set of five different particle types. This research was performed within the framework of the SolarPACES Task III group, and the results helped establish a guideline for evaluating the optical properties of particles. The guideline was published on the SolarPACES Task III website in May 2022.

Precision of diamond turning sinusoidal structures as measurement standards used to assess topography fidelity

In optical surface metrology, it is crucial to assess the fidelity of the topography measuring signals. One parameter to quantify this is the small-scale fidelity limit T FIL defined in ISO 25 178-600:2019. To determine this parameter, sinusoidal structures are generated, where the wavelengths are modulated according to a discrete chirp series. The objects are produced by means of ultra-precision diamond face turning. Planar areas and regions with slopes below 4° could be produced with form deviations of ≲10 nm. An initial estimate of the cutting tool’s nose radius resulted in a deviation that caused the ridges of the structures to be too narrow by approximately 150 nm, while the trenches were too wide. At the bottom of narrow trenches, deviations are observed in the form of elevations with heights of about 20 to 100 nm. The measurement standard investigated in this study has also been used to characterise optical instruments in a round-robin test within the European project TracOptic, which requires precise knowledge of the geometry of all structures. The geometry of the topography, cosine structures superimposed with form deviations, was measured using the Met. LR-AFM metrological long-range atomic force microscope of the German National Metrology Institute.

In vitro bioaccessibility round robin testing for arsenic and lead in standard reference materials and soil samples.

In this study, we assessed the suitability of using a standard reference material (SRM) other than National Institute of Standards and Technology (NIST) 2710a or NIST 2711a in USEPA Method 1340 to determine arsenic (As) and lead (Pb) in vitro bioaccessibility (IVBA) and the capabilities of Canadian-based laboratories to perform the method. Five laboratories participated in an initial round robin study and analyzed NIST 2710a, NIST 2711a, BGS119, and Enviromat SS-2. Intra- and inter-laboratory variability were generally acceptable with percentage relative standard deviations (RSD) of less than 20%. The mean total As and Pb concentrations obtained for BGS119 (332 and 936 mg/kg, respectively) and the mean IVBA values (As = 14.3% and Pb = 78.1%) suggested it may be a suitable and acceptable SRM, whereas the concentration of As in Enviromat SS-2 as received (3.2 mg/kg) was deemed too low. Ten soil samples from sites with varying land use were analyzed in a follow-up round robin study using the modified IVBA method that included BGS119 as SRM. The concentrations of As and Pb in the IVBA extracts reported by the participating laboratories were comparable. The mean As IVBA values for the field-collected samples ranged from 0.1% to 56.4%; for Pb, they ranged from 7.0% to 121%. The lowest IVBA values were measured in mine site samples; the highest values were associated with smelter-affected soils. The low IVBA values correlated with high iron content. Intra- and interlaboratory reproducibility were acceptable (RSD < 30%). Based on the findings of the study, laboratories can use the modified method to provide reproducible and comparable As and Pb IVBA data. The use of BGS119 as an alternative SRM to assess contaminated sites in the province of British Columbia for regulatory purposes is recommended, as it is representative of As and Pb concentrations in contaminated soils in British Columbia. Integr Environ Assess Manag 2024;20:1486-1495. © 2024 The Authors. Integrated Environmental Assessment and Management published by Wiley Periodicals LLC on behalf of Society of Environmental Toxicology & Chemistry (SETAC).

Reliability of VOC emission chamber testing – A round-robin test with a parquet adhesive, a parquet lacquer, and a levelling compound/Zuverlässigkeit von VOC-Emissionskammerprüfungen – Ein Ringversuch mit einem Parkettklebstoff, einem Parkettlack und einer Verlaufsspachtelmasse

The Association for the Control of Emissions in Products for Flooring Installation, Adhesives and Building Materials (GEV) organised a round-robin test in 2023 with the purpose to update its list of recommended testing laboratories based on test results. 39 laboratories from 11 countries tested the VOC emissions of 3 test products, a parquet adhesive, a parquet lacquer, and a levelling compound. The GEV round- robin test 2023 showed a similar variation of the test results as had been observed in previous round-robin tests in 2017 and 2020. The variation of the test results confirms the limited significance of single test results. This is why GEV discloses VOC emissions only in terms of broad emissions classes. The performance of 22 laboratories was rated by GEV to be good. Currently, a list of recommended testing laboratories for GEV emissions testing comprises 18 laboratories from 6 countries. These laboratories met the performance requirements of GEV in the round-robin test and presented an accreditation of this testing protocol according to ISO/IEC 17025.

Reproducibility assessment of an emulator-type load-based testing methodology

Current testing procedures for the performance rating of air conditioners (ACs) and heat pumps are conducted while maintaining the valve opening and compressor speed at fixed values, thus providing measurements that are often not representative of the actual field operation of these systems. The proposed emulator-type load-based testing methodology makes it possible to reproducibly test different units under various environmental and load conditions while maintaining the native control of the system active. This study presents and discusses the results of round-robin tests at four different facilities to assess the reproducibility of the proposed testing methodology. A 10-kW R32 ceiling-type system is tested, and promising coherence of the results is found with coefficient of performance (COP) deviation within 3 % for all the examined conditions, including consistent cycling intervals and compressor speed modulation behaviors.

Potential and Limitations of Research Battery Cell Types for Electrochemical Data Acquisition

Developing new electrode materials or electrolytes for lithium-ion batteries requires reliable electrochemical testing thereof. In academic research, coin-type cells and small pouch-type cells are commonly being assembled for this purpose. In our study [1], using commercial highly homogeneous and robust LiNi0.33Mn0.33Co0.33O2 (NMC111) cathodes, graphite anodes and 1M LiPF6 in EC/DMC with 3% VC as the electrolyte, four experienced researchers from the Institute for Applied Materials at Karlsruhe Institute of Technology assembled a variety of coin cells within a round robin test. For different cell building parameters, the battery lifetimes systematically varied from a few hundred to well over 2000 cycles before a capacity retention of 80 % was reached. As a benchmark, the same electrodes and electrolyte were incorporated as single- and multi-layer electrode stacks into pouch-type cells and reach almost 4000 cycles with a rate of 1 C.Missplacing of electrodes and varying amount of electrolyte within a coin-cell were already addressed as performance influencing factors in the literature. In this study, one clear outcome with high impact on previously collected electrochemical data on coin cells, is that the steel grade of cell parts, as well as the in-housed total height of the electrode stack have dramatic influence on cell lifetime and the quality of the acquired electrochemical data. We present our best practice for coin cell manufacturing resulting from the round robin test. Further, it is shown that inappropriate testing conditions like poor cell contacting and cycler settings have additional impact on data collection. In this regard, we emphasize essential parameters for obtaining high quality data.Additionally, using the same electrodes, we show direct rate performance differences of calendered vs. uncalendered electrodes, as well as half vs. full-cell test results by means of rate capability and long-term cycling stability. While compression of anodes is less crucial for rate capability, substantial differences are measured in case of the cathodes, highlighting the importance of sufficient cathode densification. Moreover, for long-term capacity retention studies, it is demonstrated that electrode densification of both, cathode and anode is crucial for high long-term capacity retention.Our results are bridging the gap between lab research and industry-type battery cells. It is shown how key performance parameters can be projected from corresponding lab scale battery cell data, if certain important criteria are met vs. where the projections have their limits.[1] A. Smith, P. Stüble, L. Leuthner, A. Hofmann, F. Jeschull and L. Mereacre, Batteries & Supercaps 2023, e202300080. Figure 1

Representativity of ISO test track surface based on controlled pass-by measurements

Within the Polish-Norwegian research project ELANORE, a limited Round Robin Test has been performed on four ISO tracks in Northern Europe. The basic objective of the project is to improve the EU directive on labelling of tyres for noise and rolling resistance. This directive is based on the measurement procedures proscribed in the UNECE Reg.117. Measurements on 3 ISO tracks were performed in 2021 and presented at InterNoise 2022. This paper adds results from tests conducted on a fourth ISO track as well as on trafficked roads with different conventional pavements: 2 in Norway (MA11 and SMA16) and 3 in Poland (SMA8, SMA11 and EACC). On all ISO test tracks and road test sites the same car, test tyres and test equipment as well as the same personnel were used to minimize the measurement uncertainties. Measurements were done using the controlled pass-by (CPB) method for vehicle test speeds between 40 and 90 km/h, with 2 test conditions: according to Reg.117 and with so-called "light test conditions". The main conclusion is that the noise ranking of the tyres on both, the ISO tracks and conventional pavements do not correspond to the ranking based on the label values given by tyre manufacturers.