Difference In Bias Approach Research Articles

Commutability assessment of candidate reference materials for plasma renin activity measurement: current challenges.

This study aims to evaluate the commutability of external quality assessment (EQA) materials and candidate reference materials (RMs) for plasma renin activity (PRA) assay. Commutabilities of 16 candidate RMs were measured along with 40 clinical samples by the four different routine PRA assays, including three LC‒MS/MS assays and onechemiluminescence immunoassay. Sixteen candidate RMs included native/spiked human plasma pools (small-scale pools with <50 individuals) and current EQA materials (large-scale pools with >1,000 individuals). Difference inbias approach and linear regression with prediction interval approach were adopted to determine the commutability. Two-way variance analysis was used to estimate the effects of spiked and pool size on the commutability. Stability and homogeneity studies were performed. Precision and correlation performance of all assays was acceptable. In the difference in bias approach, thecommutability results were not satisfactory (noncommutability: 14/16) and significant sample-specific effects were detected in assay pairs using different incubation buffers. For the prediction interval approach, no commutability was observed in the spiked small-scale pools; EQA materials (4/9) had more satisfactory commutability among all assays than the small-scale pools (2/7); RMs of large-scale pools tend to have better commutability no matter spiked ornot. Commutable RMs were obtainable but challenging. Current EQA materials with relatively good commutability, stability, and homogeneity were appropriate RMs. Large-scale pools are tending to be commutable. Spiking in small-scale pools was not suggested to prepare RMs. MPs adopting a uniform incubation buffer would be preferable for further commutability research.

Exploration of suitable external quality assessment materials for serum C-peptide measurement.

To find suitable external quality assessment (EQA) materials for serum C-peptide, we evaluated the commutability of five types of processed materials. Seventy-four individual serum samples and 12 processed samples including three EQA samples currently in use, frozen human serum pools (FHSP), and three other kinds of processed samples were prepared by dissolving WHO International Standard Reagent for C-peptide (WHO ISR 13/146) in three different matrixes: 0.05 % bovine serum albumin, fetal bovine serum and human serum pools. Samples were analyzed using the isotope dilution liquid chromatography-tandem mass spectrometry (ID-LC-MS/MS) method and six widely used immunoassays. The commutabilities of processed materials were assessed according to the difference in bias approach recommended by the IFCC. And the short- and long-term stability of FHSP samples at different temperatures were also evaluated. Out of the five kinds of processed materials, FHSP samples were commutable on most assays. In contrast, the EQA materials currently in use were only commutable on a few immunoassays. Additionally, processed materials derived from WHO ISR 13/146 were found to be un-commutable on over half of immunoassays. The FHSP samples could be stably stored at 4 and-20 °C for at least 16days, and at-80 °C for at least 1 year, but at room temperature only for 12 h. With clarified commutability and stability information, the human serum pool samples along with the developed ID-LC-MS/MS method could be used in the EQA program to promote the comparability among laboratories for C-peptide measurement in China.

Assessing the commutability of candidate reference materials for the harmonization of neurofilament light measurements in blood.

Neurofilament light chain (NfL) concentration in blood is a biomarker of neuro-axonal injury in the nervous system and there now exist several assays with high enough sensitivity to measure NfL in serum and plasma. There is a need for harmonization with the goal of creating a certified reference material (CRM) for NfL and an early step in such an effort is to determine the best matrix for the CRM. This is done in a commutability study and here the results of the first one for NfL in blood is presented. Forty paired individual serum and plasma samples were analyzed for NfL on four different analytical platforms. Neat and differently spiked serum and plasma were evaluated for their suitability as a CRM using the difference in bias approach. The correlation between the different platforms with regards to measured NfL concentrations were very high (Spearman's ρ≥0.96). Samples spiked with cerebrospinal fluid (CSF) showed higher commutability compared to samples spiked with recombinant human NfL protein and serum seems to be a better choice than plasma as the matrix for a CRM. The results from this first commutability study on NfL in serum/plasma showed that it is feasible to create a CRM for NfL in blood and that spiking should be done using CSF rather than with recombinant human NfL protein.

Commutability of possible external quality assessment materials for progesterone measurement

BackgroundThe commutability of control materials used for external quality assessment (EQA) programs is of great importance. Evaluating the commutability of control materials is crucial to assess their suitability for EQA programs. MethodsForty-eight individual patient serum samples, commercial EQA samples, human serum pools (HSPs), commercially available sterile filtered charcoal stripped serum (CS) and swine serum were analyzed using the isotope dilution liquid chromatography-tandem mass spectrometry (ID LC-MS/MS) comparative method and six immunoassays for progesterone. The commutability was assessed according to the EP14-A2 guideline and the difference in bias approach, respectively. ResultsAccording to the EP14-A2 guideline, HSPs and CS were commutable for all the tested immunoassays, while swine serum showed positive matrix effects in some assays. Based on the difference in bias approach, a large number of inconclusive and noncommutable results appeared. ConclusionsThe commutability of the processed materials varied depending on which evaluation approach and criterion was applied. Noncommutability of the EQA materials was observed. And HSPs and CS were possible commutable candidate control materials according to the EP14-A2 guideline.

Establishment of a WHO Reference Reagent for anti-Mullerian hormone

BackgroundThere is a need for a reference material to support the development and ensure the quality of immunoassays for human AMH. A batch of ampoules, coded 16/190, containing lyophilised recombinant AMH was evaluated in a WHO Collaborative Study. The aims of the study were to determine the AMH content in terms of the calibration of each immunoassay method, to predict long-term stability and to assess the suitability of the preparation to calibrate AMH immunoassays.MethodsStudy participants were asked to report the AMH content of specific dilutions of coded ampoules of 16/190 and a comparator preparation containing approximately half the AMH content. In each assay, participants also reported the AMH content of 22 patient samples to assess commutability. A robust all-laboratory geometric mean of the content estimates was determined using the laboratory geometric mean estimates. Commutability was assessed using a difference in bias approach. Stability was predicted by the measurement of thermally accelerated degradation samples.ResultsSeven laboratories performed twenty-one immunoassay method-platform combinations, sixteen of which provided data which met the validity criteria, giving a consensus geometric mean estimate of AMH content of 511 ng/ampoule (95% CI, 426–612, n = 16, GCV 42%) and a robust geometric mean of 489 ng/ampoule. By contrast, the GCV% for the all-laboratory geometric mean of the relative content estimates for the comparator sample to 16/190 was 12%. Commutability was assessed using 20 of the 22 representative patient samples. Of the valid assays, 16/190 was within the limits of acceptable commutability for 6 methods, partially commutable for a further 3 methods and non-commutable when measured by 7 methods. The preparation was predicted to be highly stable when stored at − 20 °C.ConclusionThe majority of methods met the validity criteria. Content estimates showed a high between-method variability, yet assays exhibited a similar proportionality of response as demonstrated using the comparator sample. 16/190 was commutable in some but not all methods. On the basis of these results, it was agreed by the WHO Expert Committee on Biological Standardization to establish 16/190 as a WHO Reference Reagent for AMH with a content defined by consensus immunoassay of 489 ng/ampoule.

Commutability of reference materials for alkaline phosphatase measurements

Commutability is a prerequisite when using a candidate reference materials (CanRMs) for calibration and trueness control of routine methods or for value transfer from the reference method to end-user calibrators of routine methods through a calibration hierarchy. The CanRMs include commercial general chemistry materials (GCs), enzyme trueness verification materials (ETVs), and secondary reference materials (SRMs). The commutability of CanRMs was evaluated based on the difference in bias and EP14-A3 to investigate their suitability for ALP measurement. A total of 44 fresh individual clinical samples (CSs) and the CanRMs were analyzed by six routine methods (validated methods) and by IFCC primary reference method (comparative method) for the determination of Alkaline Phosphatase (ALP). The commutability was performed based on IFCC working group recommendations for assessing commutability and analyzed according to EP14-A3 guide and difference in bias approach, respectively. The bias of the routine methods was assessed according to CLSI guidelines. The result of commutable materials obtained from the two evaluation approaches are not significantly different. It was observed that the routine methods with lower bias were associated with more commutable CanRMs. None of the CanRMs were suitable for use as commutable RMs. The findings of this study have a number of important implications for future practice.

Study on commutability evaluation of reference materials for fibrinogen

Objective: To discuss the commutability evaluation method of reference materials for fibrinogen measurement and evaluate the commutability of the Third WHO International Standard Fibrinogen Plasma (WHO 09/264), SSC/ISTH Secondary Coagulation Standard (SSC LOT4) and homemade reference materials (RM01, RM02) in order to provide suggestions on how to determine the suitable method of commutability evaluation and reliable traceability standard. Methods: The comparability of fibrinogen among different measurement systems were evaluated and WHO 09/264 was used to calibrate each system to improve the comparability if the comparability among different systems couldn't be accepted. Forty clinical samples and the reference materials randomly interspersed among the clinical samples were measured on Stago STA-R Evolution, Sysmex CS 5100, IL ACL TOP 700 simultaneously. Measurement results were pairwise analyzed by Deming regression and difference in bias approach according to the Clinical and Laboratory Standards Institute (CLSI) EP14-A3 protocol and the recommendations of the International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) working group on commutability, respectively. Results: The comparability of fibrinogen measurement among common systems could not meet the criterion. WHO 09/264 could improve the agreement among different measurement systems. The prediction interval of Deming regression was affected by the comparability of measurement systems, resulting in unreliable results. The difference in bias approach was more suitable because its criterion was related to the medical requirements. WHO 09/264 was commutable between Stago and Sysmex, inconclusive between Stago and IL, Sysmex and IL (The calibration effectiveness of WHO 09/264 showed that it was commutable among the three measurement systems). SSC LOT4 was commutable between Stago and Sysmex, inconclusive between Stago and IL, Sysmex and IL. RM01 and RM02 were commutable between all systems pairs assessed by difference in bias approach. Conclusions: There are differences in the results of two commutability evaluation approaches. The difference in bias approach is recommended for commutability evaluation. WHO International Standard and homemade reference materials can be used as traceability standard for fibrinogen measurement.

Commutability of external quality assessment materials for serum magnesium and calcium measurements

The commutability of pooled patient sera (PPS) and control materials (CM) should be evaluated to investigate their suitability for use in an external quality assessment (EQA) program. Individual human samples, PPS and CM were analyzed by four routine methods and inductively coupled plasma mass spectrometry reference methods for magnesium and calcium measurements. The commutability was analyzed according to EP14-A3 protocol and the difference in bias approach, respectively. For magnesium measurements, all PPS were commutable and 3/5 CM were commutable for all measurement systems according to the EP14-A3 protocol. For calcium measurements, most PPS were commutable for all measurement systems, but the CM were only commutable with the Cobas c702 system. The IFCC approach produced similar commutability profiles, except that a large number of inconclusive results appeared. The routine methods exhibited excellent linearity and precision. The majority of relative biases between the routine and reference methods were beyond the bias limits. The commutability of the CM and PPS vary depending on which evaluation approach and criterion is applied. Superiority in the commutability of PPS over CM was observed whichever evaluation approach is applied.

Trueness assessment of HbA1c routine assays: are processed EQA materials up to the job?

Background With the worldwide increase of diabetes mellitus prevalence, ensuring that HbA1c assays are accurate is essential. External quality assessment (EQA) programs enable laboratories to verify that analytical methods perform according to the manufacturers' specifications. However, assessing trueness requires commutable materials, a property that is rarely characterized for EQA materials. Methods The difference in bias approach was used to assess commutability of 26 processed quality control materials for 17 of the most frequently used HbA1c assays. Involved assays included immuno-assays, enzymatic assays, affinity, ion-exchange HPLC boronate affinity HPLC and capillary electrophoresis. The measurements were performed at manufacturers or expert laboratories. Assay trueness was additionally assessed against the IFCC reference measurement procedure using fresh clinical specimens that were distributed to 450 medical laboratories. Results Commutability of processed EQA materials was highly heterogeneous and globally insufficient to rigorously assess the trueness of HbA1c assays. Using fresh clinical specimens, mean bias was -0.13 mmol/mol for low HbA1c (34 mmol/mol), between +1.0 and +1.3 mmol/mol for intermediate HbA1c (49 and 58 mmol/mol) and +1.2 mmol/mol for elevated HbA1c (90 mmol/mol). Conclusions This study demonstrates that due to insufficient commutability, most processed EQA materials are unsuitable to assess trueness of HbA1c assays and agreement between the different assays. These materials can only provide information on comparability of individual laboratory results with its peers and on assay precision. Using fresh whole blood samples, this study additionally shows that most HbA1c assays are fairly accurate and meet the total allowable error quality target of 5 mmol/mol.

Commutability assessment of reference materials for the enumeration of lymphocyte subsets.

Background Flow cytometric enumeration of lymphocyte subsets in peripheral blood can provide important information about immune status. Commutable reference materials (RM) are crucial for maintaining accurate and comparable measurement results over time and space. Commutability assessment of RMs for lymphocyte subsets enumeration has not been reported elsewhere. Methods Lymphocyte subsets were measured in triplicate on 56 patient samples and eight RMs using two measuring systems commonly used in laboratories (FACS Canto II and Cytomics FC500). The first step was to determine the suitability of RMs and comparability of different systems with patient samples. After the requirements of suitability and comparability were met, the second step was to assess commutability following regression approach and difference in bias approach. Results Two RMs were not measurable on FC500 system for CD3-CD16/56+ and CD3-CD19+ percentages. The results of comparability showed no significant difference in the two systems. Eight RMs for CD3+CD4+ cell count, six RMs for CD3+ and CD3+CD8+ percentages, five RMs for CD3-CD16/56+ percentage, and three RMs for CD3-CD19+ percentage were commutable using the two approaches. For CD3+, CD3+CD8+ and CD3-CD19+ percentages, the results of regression approach showed that one RM was non-commutable for each parameter, while the other approach showed that the RM was commutable. Conclusions The suitability of RM and comparability of different measuring systems are prerequisites for assessing commutability. This study indicated that different approaches led to different results. The difference in bias approach is recommended for criteria relating to medical requirements and performance characteristics of measuring systems in use.

Commutability of external quality assessment materials for serum sodium and potassium measurements.

Background The commutability of electrolyte trueness verification materials (ETVs) and commercial general chemistry materials (GCs) was evaluated to investigate their suitability for use in an external quality assessment (EQA) program for serum sodium and potassium measurements. Methods Eighty fresh individual human samples (40 for sodium measurements and 40 for potassium measurements), six ETVs and three GCs were analyzed by five routine methods (validated methods) and by inductively coupled plasma mass spectrometry reference methods (comparative methods) for the determination of sodium and potassium. The commutability was analyzed according to Clinical and Laboratory Standards Institute (CLSI) EP14-A3 protocol and difference in bias approach, respectively. The linearity, bias and imprecision of the routine methods were also assessed according to CLSI guidelines. Results According to EP14-A3 protocol, ETVs were commutable for all assays, and GCs were commutable for 3/5 assays for sodium. ETVs were commutable in most assays except Cobas C501, while GCs showed no commutability except in case of AU5821 for potassium. According to a difference in bias approach, the commutability of ETVs was inconclusive for most routine assays for both sodium and potassium, and GCs were inconclusive for sodium and non-commutable for potassium in most routine assays. The routine methods exhibited excellent linearities and precisions. The majority and minority of relative biases between the routine and reference methods were beyond the bias limits for sodium and potassium, respectively. Conclusions Superiority in the commutability of ETVs over GCs was observed among the sodium and potassium assays whichever evaluation approach was applied.

Commutability Assessment of Candidate Reference Materials for Pancreatic α-Amylase.

Measurement standardization of the catalytic concentration of α-amylase in serum is based on 3 pillars: the primary reference measurement procedure (PRMP), reference laboratories, and suitable certified reference materials (CRMs). Commutability is a prerequisite when using a CRM for calibration and trueness control of routine methods or for value transfer from the PRMP to end-user calibrators of routine methods through a calibration hierarchy. We performed a commutability study with 30 serum pools and 5 candidate reference materials (RMs) for pancreatic α-amylase using an automated version of the PRMP and 5 different routine methods. Four candidate RMs had an artificial matrix, each with a different composition, and 1 candidate RM was based on human serum. Data were analyzed according to a linear regression analysis with prediction interval as described in the Clinical and Laboratory Standards Institute guideline EP30-A and a difference in bias analysis as described in the recommendations of the IFCC Working Group on Commutability. The commutability profile of the 4 candidate RMs with an artificial matrix was variable. Only 1 candidate RM, with human serum albumin in the matrix, showed a good profile like that of the candidate RM based on serum. The comparison of both commutability assessment approaches indicated some differences because of inconclusive results for the difference in bias approach, suggesting a large uncertainty on the commutability assessment. A CRM for pancreatic amylase in an artificial matrix can be commutable for routine methods using the same substrate as the PRMP, but the matrix composition is crucial.

Preparation, calibration and evaluation of the First International Standard for human C-peptide.

Measurement of C-peptide by immunoassay contributes to the diagnosis of a number of disorders related to β cell function. Stocks of the current international reference reagent (IRR) for C-peptide, used to calibrate these immunoassays, are exhausted, and this report summarises the international study to establish a replacement World Health Organization (WHO) international standard (IS) to maintain the availability of a globally available reference material and support efforts to standardise C-peptide assays. The study was conducted in three phases; phase I involved the assignment of a value to a primary calibrant in mass units by amino acid analysis and phase II applied this value to the calibration of a candidate standard, 13/146, by reversed phase high-performance liquid chromatography (RP-HPLC) assay. In phase III, the candidate standard was compared to the first IRR by current immunoassays to assess its suitability to serve as an IS. Calibration of the candidate standard by RP-HPLC gave a final estimated content of 8.64 μg/ampoule with expanded uncertainty of 8.21-9.07 μg/ampoule (95% confidence; k=2.45). The candidate standard also appears sufficiently stable to serve as an IS, based on HPLC analysis of accelerated thermal degradation samples of 13/146, and was also shown to have appropriate immunological activity. A difference in bias approach was used to assess the commutability of 13/146 with human serum and urine samples. With the exception of two laboratories, the candidate standard demonstrated commutability with respect to the serum and urine samples included in this study. The candidate standard, 13/146, is suitable to serve as the First International Standard for human C-peptide, and it has been formally adopted by the Expert Committee on Biological Standardisation of the WHO.

Difference in bias approach for commutability assessment: application to frozen pools of human serum measured by 8 direct methods for HDL and LDL cholesterol.

We used a difference in bias approach to evaluate the commutability of 4 frozen serum pools for 8 direct methods for measurement of HDL and LDL cholesterol (HDLC and LDLC). Freshly collected nonfrozen sera from 138 diseased and 37 nondiseased patients and 4 frozen pools from the CDC Lipid Standardization Program were measured by direct methods and by the beta-quantification reference measurement procedure of the CDC. We used an error components model to estimate the difference in the bias component of error plus its uncertainty for frozen pools vs patient samples between the direct method and the reference procedure. Frozen pools with bias differences less than a critical value determined by either medical requirements for bias or the random error components of the measurement procedures were considered commutable. On the basis of medical requirement criteria, 1 of the 4 frozen pools was commutable for most of the HDLC methods for both diseased and nondiseased patients, and none was commutable for LDLC methods. On the basis of random error criteria, all of the frozen pools were generally commutable for all of the HDLC methods for both diseased and nondiseased patients, and 1 of the 4 frozen pools was generally commutable for most of the LDLC methods for both diseased and nondiseased patients. Commutability was assessed as the closeness of agreement of the difference in bias between a reference material and a set of patient samples. Criteria for commutability could be based on fixed medical requirements for bias or on random error components.