Analyte Cut-off Values Research Articles

Improving Harmonization and Standardization of Expanded Newborn Screening Results by Optimization of the Legacy Flow Injection Analysis Tandem Mass Spectrometry Methods and Application of a Standardized Calibration Approach.

Newborn screening (NBS) laboratories in the United Kingdom adhere to common protocols based on single analyte cutoff values (COVs); therefore, interlaboratory harmonization is of paramount importance. Interlaboratory variation for screening analytes in UK NBS laboratories ranges from 17% to 59%. While using common stable isotope internal standards has been shown to significantly reduce interlaboratory variation, instrument set-up, sample extraction, and calibration approach are also key factors. Dried blood spot (DBS) extraction processes, instrument set-up, mobile-phase composition, sample introduction technique, and calibration approach of flow injection analysis-tandem mass spectrometry (FIA-MS/MS) methods were optimized. Inter- and intralaboratory variation of methionine, leucine, phenylalanine, tyrosine, isovaleryl-carnitine, glutaryl-carnitine, octanoyl-carnitine, and decanoyl-carnitine were determined pre- and postoptimization, using 3 different calibration approaches. Optimal recovery of analytes from DBS was achieved with a 35-min extraction time and 80% methanol (150 μL). Optimized methodology decreased the mean intralaboratory percentage relative SD (%RSD) for the 8 analytes from 20.7% (range 4.1-46.0) to 5.4% (range 3.0-8.5). The alternative calibration approach reduced the mean interlaboratory %RSD for all analytes from 16.8% (range 4.1-25.0) to 7.1% (range 4.1-11.0). Nuclear magnetic resonance analysis of the calibration material highlighted the need for standardization. The purities of isovaleryl-carnitine and glutaryl-carnitine were 85.13% and 69.94% respectively, below the manufacturer's stated values of ≥98%. For NBS programs provided by multiple laboratories using single analyte COVs, harmonization and standardization of results can be achieved by optimizing legacy FIA-MS/MS methods, adopting a common analytical protocol, and using standardized calibration material rather than internal calibration.

Evaluation of a Common Internal Standard Material to Reduce Inter-Laboratory Variation and Ensure the Quality, Safety and Efficacy of Expanded Newborn Screening Results When Using Flow Injection Analysis Tandem Mass Spectrometry with Internal Calibration.

In 2015, the newborn screening (NBS) programmes in England and Wales were expanded to include four additional disorders: Classical Homocystinuria, Isovaleric Acidemia, Glutaric Aciduria Type 1 and Maple Syrup Urine Disease, bringing the total number of analytes quantified to eight: phenylalanine, tyrosine, leucine, methionine, isovalerylcarnitine, glutarylcarnitine, octanoylcarnitine and decanoylcarnitine. Post-implementation, population data monitoring showed that inter-laboratory variation was greater than expected, with 90th centiles varying from 17% to 59%. We evaluated the effect of stable isotope internal standard (IS) used for quantitation on inter-laboratory variation. Four laboratories analysed routine screening samples (n > 101,820) using a common IS. Inter-laboratory variation was determined for the eight analytes and compared with results obtained using an in-house common IS (n > 102,194). A linear mixed-effects model was fitted to the data. Using a common IS mix reduced the inter-laboratory variation significantly (p < 0.05) for five analytes. For three analytes, the lack of significance was explained by use of individual laboratory “calibration factors”. For screening programmes where laboratories adhere to single analyte cut-off values (COVs), it is important that inter-laboratory variation is minimised, primarily to prevent false positive results. Whilst the use of a common IS helps achieve this, it is evident that instrument set-up also contributes to inter-laboratory variation.

Predictive probability methods for interim monitoring in clinical trials with longitudinal outcomes.

In clinical research and development, interim monitoring is critical for better decision-making and minimizing the risk of exposing patients to possible ineffective therapies. For interim futility or efficacy monitoring, predictive probability methods are widely adopted in practice. Those methods have been well studied for univariate variables. However, for longitudinal studies, predictive probability methods using univariate information from only completers may not be most efficient, and data from on-going subjects can be utilized to improve efficiency. On the other hand, leveraging information from on-going subjects could allow an interim analysis to be potentially conducted once a sufficient number of subjects reach an earlier time point. For longitudinal outcomes, we derive closed-form formulas for predictive probabilities, including Bayesian predictive probability, predictive power, and conditional power and also give closed-form solutions for predictive probability of success in a future trial and the predictive probability of success of the best dose. When predictive probabilities are used for interim monitoring, we study their distributions and discuss their analytical cutoff values or stopping boundaries that have desired operating characteristics. We show that predictive probabilities utilizing all longitudinal information are more efficient for interim monitoring than that using information from completers only. To illustrate their practical application for longitudinal data, we analyze 2 real data examples from clinical trials.

Newborn screening for hyperargininemia due to arginase 1 deficiency.

Hyperargininemia caused by Arginase 1 deficiency is a rare disorder of the urea cycle that can be diagnosed by elevation of arginine in newborn screening blood spots when analyzed by tandem mass spectrometry. Hyperargininemia is currently included as a secondary target on the U.S. Recommended Uniform Screening Panel, which directly influences state-based newborn screening. Because of the apparent low disease frequency and lack of case detection and treatment data, detailed attention has not been given to a model newborn screening algorithm including appropriate analytical cutoff values for disease indicators. In this paper we assess the frequency of hyperargininemia in the U.S. identified by newborn screening to date and document the current status and variability of hyperargininemia newborn screening across U.S. newborn screening programs. We also review other data that support improved screening efficacy by utilizing the arginine/ornithine ratio and other amino acid ratios as discriminators in the screening algorithm. Analysis of archived California screening data showed that an arginine cutoff of 50μM combined with an arginine/ornithine ratio of 1.4 would have resulted in a recall rate of 0.01%. Using an arginine cutoff of 60μM and an arginine/(phenylalanine x leucine) ratio of 1.4, reportedly used in one screening program, or the R4S Tool Runner, would have resulted in a recall rate of <0.005%. All 9 diagnosed patients would have been found for either protocol. Thus, use of appropriate ratios as part of the screening algorithm has the potential to increase both screening sensitivity and specificity. Improved newborn screening effectiveness should lead to better case detection and more rapid treatment to lower plasma arginine levels hence improving long term outcome of individuals with hyperargininemia.

Expanded newborn screening in New South Wales: missed cases.

There have been few reports of cases missed by expanded newborn screening. Tandem mass spectrometry was introduced in New South Wales, Australia in 1998 to screen for selected disorders of amino acid, organic acid and fatty acid metabolism. Of 1,500,000 babies screened by 2012, 1:2700 were diagnosed with a target disorder. Fifteen affected babies were missed by testing, and presented clinically or in family studies. In three cases (cobalamin C defect, very-long-chain acyl-CoA dehydrogenase deficiency and glutaric aciduria type 1), this led to modification of analyte cut-off values or protocols during the first 3years. Two patients with intermittent MSUD, two with β-ketothiolase deficiency, two with citrin deficiency, two siblings with arginosuccinic aciduria, two siblings with homocystinuria, and one with cobalamin C defect had analyte values and ratios below the action limits which could not have been detected without unacceptable false-positive rates. A laboratory interpretation error led to missing one case of cobalamin C defect. Reference ranges, regularly reviewed, were not altered. For citrin deficiency, while relevant metabolites are detectable by tandem mass spectrometry, our cut-off values do not specifically screen for that disorder. Most of the missed cases are doing well and with no acute presentations although eight of 15 are likely to have been somewhat adversely affected by a late diagnosis. Analyte ratio and cut-off value optimisations are important, but for some disorders occasional missed cases may have to be tolerated to maintain an acceptable specificity, and avoid harm from screening.

Enhanced interpretation of newborn screening results without analyte cutoff values

To improve quality of newborn screening by tandem mass spectrometry with a novel approach made possible by the collaboration of 154 laboratories in 49 countries. A database of 767,464 results from 12,721 cases affected with 60 conditions was used to build multivariate pattern recognition software that generates tools integrating multiple clinically significant results into a single score. This score is determined by the overlap between normal and disease ranges, penetration within the disease range, differences between conditions, and weighted correction factors. Ninety tools target either a single condition or the differential diagnosis between multiple conditions. Scores are expressed as the percentile rank among all cases with the same condition and are compared to interpretation guidelines. Retrospective evaluation of past cases suggests that these tools could have avoided at least half of 279 false-positive outcomes caused by carrier status for fatty-acid oxidation disorders and could have prevented 88% of known false-negative events. Application of this computational approach to raw data is independent from single analyte cutoff values. In Minnesota, the tools have been a major contributing factor to the sustained achievement of a false-positive rate below 0.1% and a positive predictive value above 60%.

Evaluation of a new molecular assay for detection of human immunodeficiency virus type 1 RNA, hepatitis C virus RNA, and hepatitis B virus DNA

Background Rapid, sensitive, specific, and cost-effective screening of donated blood to prevent transmission of infectious agents remains challenging. In recent years, incorporation of nucleic acid testing for HIV-1 and HCV RNA improved blood safety by reducing the window period between infection and serologic detection. For HBV infection, this window period with most serologic assays is 50–60 days. Adding a nucleic acid test (NAT) for HBV DNA with existing NATs for HIV-1 and HCV RNA would further improve blood safety and blood screening efficiency. Objective To evaluate the Procleix Ultrio Assay for simultaneous detection of HIV-1 and HCV RNA and HBV DNA and corresponding discriminatory assays. Study design The performance of these assays, which utilize the same technology and assay format as the Procleix HIV-1/HCV assay, was determined using relevant clinical specimens and analytical sensitivity and specificity panels. Results The Procleix Ultrio Assay demonstrated specificity of ≥99.5% in healthy donor blood specimens and in plasma containing potentially interfering substances or other blood-borne pathogens. Assay sensitivity demonstrated >95% detection of 100 copies/mL, 30 IU/mL, and 15 IU/mL for HIV-1 and HCV RNA, and HBV DNA, respectively. The assay detects all known HIV-1 subtypes and HCV and HBV genotypes and is highly reproducible. Statistical analysis using receiver operating characteristic plots demonstrated wide analyte cutoff values for each assay associated with assay specificity and sensitivity of ≥99.5%. Conclusions In this investigational study, the Procleix Ultrio Assay sensitivity and specificity were similar to existing NATs used in blood-bank settings to detect HIV-1 and HCV RNA and provided equivalent sensitivity and specificity for detection of HBV DNA. Using this combination assay, blood safety may be improved and the multiplex format enhances blood screening efficiency. The throughput capability of this assay is compatible with large volume processing and the chemistry is adaptable to full automation.

Highly Sensitive Multiplex Assay for Detection of Human Immunodeficiency Virus Type 1 and Hepatitis C Virus RNA

Various nucleic acid assays have been developed and implemented for diagnostics and therapeutic monitoring of human immunodeficiency virus type 1 (HIV-1) and hepatitis C virus (HCV) infections. The high-throughput, semiautomated assays described here were developed to provide a method suitable for screening plasma specimens for the presence of HIV-1 and HCV RNAs. Three assays were developed: a multiplex HIV-1/HCV assay for simultaneous detection of HIV-1 and HCV, and discriminatory assays for specific detection of HIV-1 and HCV. The assay systems utilize three proprietary technologies: (i) target capture-based sample preparation, (ii) transcription-mediated amplification (TMA), and (iii) hybridization protection assay (HPA). An internal control is incorporated into each reaction to control for every step of the assay and identify random false-negative reactions. The assays demonstrated a sensitivity of at least 100 copies/ml for each target, and they detected with similar sensitivity all major variants of HCV and HIV-1, including HIV-1 group O strains. Assay sensitivity for one virus was not affected by the presence of the other. The specificity of these TMA-driven assays was >or=99.5% in both normal donor specimens and plasma containing potentially interfering substances or other blood-borne pathogens. Statistical receiver operating characteristic plots of 1 - specificity versus sensitivity data determined very wide analyte cutoff values for each assay at the point at which the assay specificity and sensitivity were both >or=99.5%. The sensitivity, specificity, and throughput capability predict that these assays will be valuable for large-volume plasma screening, either in a blood bank setting or in other diagnostic applications.