Laboratory-developed Assays Research Articles

Validation of the QIAsymphony RGQ system for DNA quantitation of different BK virus genotypes in whole blood samples

Human polyomavirus BK (BKV) is increasingly recognized as an opportunistic pathogen in transplant recipients. The aim of this work was to evaluate the artus® BK Virus QS-RGQ assay on the QIAsymphony RGQ system in whole blood (WB) samples (tests performed in an off-label capacity) according to different BKV genotypes by comparison with a laboratory-developed assay. BKV loads were measured in 111 WB samples and BKV genotype was determined by sequencing the full-length VP1 gene. The artus® assay exhibited a limit of detection of 77copies/mL, a linearity range from 3.0 to 6.0log10copies/mL, intra-assay and inter-assay coefficients of variation ranging from 0.65% to 5.18%. Regarding BKV quantitation, artus® and laboratory-developed assays were highly correlated (Spearman correlation coefficient Rho=0.79; P<0.0001) with an excellent overall agreement (96.4%) and no significant quantitative difference according to Bland–Altman analysis (mean difference: −0.34log10copies/mL). The results did not show any influence of BKV genotype on BKV quantitation by the artus® assay, except a potential underquantitation of BKV subtype Ia which deserves further confirmation. In conclusion, the QIAsymphony RGQ system appears to be appropriate for the quantitation of BKV load in WB samples.

Validation and clinical use of a sensitive HIV-2 viral load assay that uses a whole virus internal control

BackgroundHuman immunodeficiency virus type 2 (HIV-2) is distantly related to the more widespread HIV-1. Although HIV-2 infection is rare in the U.S., cases are concentrated in the Northeast. No FDA-approved HIV-2 viral load assays exist. A clinically validated laboratory-developed assay is currently available in the U.S., however it is not currently approved for use on New York State patients. ObjectiveTo develop a sensitive viral load assay to quantify HIV-2 RNA in plasma and to validate it for clinical use. MethodsThe real-time RT-PCR assay simultaneously amplifies HIV-2 and a whole virus internal control, added during the lysis step. Two extraction volumes can be used. Results are reported in HIV-2 RNA International Units (IU). ResultsThe assay has a limit of detection of 7IU/mL and a lower limit of quantification of 29IU/mL. The assay detects multiple strains of HIV-2 group A and B and generates reproducible results. Samples exchanged with a comparator laboratory produced similar viral load results, with 74% of positives differing by <0.5log10IU/mL. To date, we have tested 52 clinical specimens from 25 individuals. Twenty-eight (54%) specimens had measurable HIV-2 viral loads (range: 1.63–5.14log10IU/mL), 10 (19%) were positive but not quantifiable, and 14 were negative. HIV-2 RNA was detected in at least one specimen from 19 of 25 (76%) individuals tested. ConclusionsWe developed a sensitive and accurate HIV-2 viral load assay. Validation data indicate the assay is suitable for clinical use and its availability in New York State will improve clinical monitoring of HIV-2 infected patients.

Evaluation of Simplexa Flu A/B &amp; RSV for Direct Detection of Influenza Viruses (A and B) and Respiratory Syncytial Virus in Patient Clinical Samples

We evaluated the performance of the Simplexa Flu A/B & RSV kit on 170 prospective respiratory samples using a modified protocol, supplied by the manufacturer, that eliminates the RNA extraction step. Overall, compared against our laboratory-developed assay, the assay's sensitivity, specificity, and positive and negative predictive values were 95.1%, 99.6%, 98.7%, and 98.6%, respectively.

Conversion to the COBAS AmpliPrep/COBAS TaqMan CMV Test for management of CMV disease in transplant recipients

Testing of clinical plasma specimens by the COBAS AmpliPrep/COBAS TaqMan CMV Test (CAP/CTM CMV), COBAS AMPLICOR CMV MONITOR Test (CAM CMV), and a laboratory-developed assay using analyte-specific reagents (LC CMV) demonstrated substantial result bias for CAP/CTM CMV versus CAM CMV (r = 0.436) and CAP/CTM CMV versus LC CMV (r = 0.773).

Comparative Assessment of a Commercial Kit and Two Laboratory-Developed PCR Assays for Molecular Diagnosis of Congenital Toxoplasmosis

Toxoplasmosis is a worldwide infection that may cause severe disease and is regarded as a serious health problem in France. Detection of the parasite by molecular methods is crucial for diagnosing the disease. The extreme diversity of methods and performances of Toxoplasma PCR assays makes the use of commercial PCR kits an attractive alternative, as they offer a chance for standardization. We compared the performances of three molecular methods for the detection of Toxoplasma gondii DNA in amniotic fluid: a commercial method using nested PCR and two laboratory-developed methods, one using conventional PCR and the other one real-time PCR. This evaluation was based upon a T. gondii DNA serial dilution assay, three amniotic fluid samples spiked with T. gondii at different concentrations, and a clinical cohort of 33 amniotic fluid samples. The T. gondii DNA serial dilution assay showed a much lower sensitivity for the commercial kit than for the laboratory-developed methods. Moreover, out of 12 proven congenital toxoplasmosis cases, 91.7% were detected by the laboratory-developed assays, whereas only 50% were detected by the commercial kit. A lack of sensitivity of the method, partly due to the presence of PCR inhibitors, was the main drawback of the commercial method. This study emphasizes that commercial PCR diagnostic kits do not systematically perform better than carefully optimized laboratory-developed methods. There is a need for thorough evaluation of such kits by proficient groups, as well as for performance standards that commercial kits can be tested against to improve confidence in those selected by health care providers.

Update on Influenza Diagnostics: Lessons from the Novel H1N1 Influenza A Pandemic

The menu of diagnostic tools that can be utilized to establish a diagnosis of influenza is extensive and includes classic virology techniques as well as new and emerging methods. This review of how the various existing diagnostic methods have been utilized, first in the context of a rapidly evolving outbreak of novel influenza virus and then during the different subsequent phases and waves of the pandemic, demonstrates the unique roles, advantages, and limitations of each of these methods. Rapid antigen tests were used extensively throughout the pandemic. Recognition of the low negative predictive values of these tests is important. Private laboratories with preexisting expertise, infrastructure, and resources for rapid development, validation, and implementation of laboratory-developed assays played an unprecedented role in helping to meet the diagnostic demands during the pandemic. FDA-cleared assays remain an important element of the diagnostic armamentarium during a pandemic, and a process must be developed with the FDA to allow manufacturers to modify these assays for detection of novel strains in a timely fashion. The need and role for subtyping of influenza viruses and antiviral susceptibility testing will likely depend on qualitative (circulating subtypes and their resistance patterns) and quantitative (relative prevalence) characterization of influenza viruses circulating during future epidemics and pandemics.

Development of Hepatocellular Carcinoma in Patients with Chronic Hepatitis B Long After Achieving Hbsag Seroconversion: A Need for an Improved Hepatitis B Virus DNA Assay

The ultimate goal of antiviral treatment is prevention of hepatocellular carcinoma (HCC). Currently the end point of successful antiviral treatment for patients with chronic hepatitis B is to achieve HBsAg loss or HBsAg seroconversion. We report two patients who successfully developed anti-HBs with or without antiviral therapy and yet developed HCC. Initial commercial assay showed negative HBV DNA for both patients. However, they were found to have detectable HBV DNA by a new laboratory-developed HBV DNA assay. These cases show that patients with HBsAg seroclearance continue to be at risk for HCC and surveillance for HCC should be continued. The diagnosis of occult hepatitis B with an improved HBV DNA assays is also necessary as it is important for treatment for chronic HBV and prevention of HCC.

Developing a Quality System for Quantitative Laboratory-Developed Tests

Users of laboratory-developed assays face many challenges. In addition to designing an assay, collecting specimens for validation, and completing the validation, they must also design and implement a quality system to ensure continued performance of the assay. The situation is even more complex when dealing with a quantitative assay. This article presents some considerations for navigating the world of quantitative laboratory-developed assays and proposes a paradigm for developing a quality system for these assays.

Regulation of laboratory-developed diagnostic assays: Where we are

Technological advancements have made diagnostic assays very powerful and valuable tools for disease diagnosis. Diagnostic assays are used for a wide range of applications: diagnosis and prognosis o...

Multi-Site PCR-Based CMV Viral Load Assessment-Assays Demonstrate Linearity and Precision, but Lack Numeric Standardization: A Report of the Association for Molecular Pathology

Viralload (VL) assessment of cytomegalovirus (CMV) by real-time PCR is an important tool for diagnosing and monitoring CMV viremia in patients with compromised immune systems. We report results from a sample exchange organized by members of the Association for Molecular Pathology that compared PCR results from 23 laboratories; 22 such laboratories used a laboratory-developed real-time PCR assay and one laboratory used a competitive PCR assay. The samples sent to each laboratory were comprised of a dilution panel of CMV virion-derived reference materials that ranged from 0 to 500,000 copies/ml. Accuracy, linearity, and intralaboratory precision were established for the different laboratory-developed assays. Overall, PCR results were linear for each laboratory (R(2) > 0.97 in all but two). While 13 laboratories showed no significant quantitative assay bias, 10 laboratories reported VLs that were significantly different compared with expected values (bias range, -0.82 to 1.4 logs). The intralaboratory precision [mean coefficient of variance of 2% to 5% (log-scale)] suggested that changes in VLs of less than 3- to fivefold may not be significantly different. There was no significant association between laboratory-specific technical variables (PCR platform, calibrator, extraction method) and assay linearity or accuracy. These data suggested that, within each laboratory, relative VL values were linear, but additional method standardization and a CMV DNA reference standard are needed to allow laboratories to achieve comparable numeric results.

Interlaboratory Comparison of Cytomegalovirus Viral Load Assays

To assess interlaboratory variability in qualitative and quantitative cytomegalovirus (CMV) viral load (VL) testing, we distributed a panel of samples to 33 laboratories in the USA, Canada and Europe who performed testing using commercial reagents (n = 17) or laboratory-developed assays (n = 18). The panel included two negatives, seven samples constructed from purified CMV nucleocapsids in plasma (2.0-6.0 log(10) copies/mL) and three clinical plasma samples. Interlaboratory variation was observed in both actual (range, 2.0-4.0 log(10) copies/mL) and self-reported lower limits of detection (range, 1.0-4.0 log(10) copies/mL). Variation observed in reported results for individual samples ranged from 2.0 log(10) (minimum) to 4.3 log(10) (maximum)(.) Variation was greatest at low VLs. Assuming +/- 0.5 log(10) relative to the expected result represents an acceptable result, 57.6% of results fell within this range. Use of commercially available reagents and procedures was associated with less variability compared with laboratory-developed assays. Interlaboratory variability on replicate samples was significantly greater than intralaboratory variability (p < 0.0001). The significant interlaboratory variability in CMV VL observed may be impacting patient care and limiting interinstitutional comparisons. The creation of an international reference standard for CMV VL assay calibration would be an important step in quality improvement of this laboratory tool.

Interlaboratory Comparison of Epstein-Barr Virus Viral Load Assays

To assess interlaboratory variability in qualitative and quantitative Epstein-Barr virus (EBV) viral load (VL) testing, we distributed a panel of samples to 28 laboratories in the USA, Canada and Europe who performed testing using commercially available reagents (n = 12) or laboratory-developed assays (n = 18). The panel included two negatives, seven constructed samples using Namalwa and Molt-3 cell lines diluted in plasma (1.30-5.30 log(10) copies/mL) and three clinical plasma samples. Significant interlaboratory variation was observed for both actual (range 1.30-4.30 log(10) copies/mL) and self-reported (range, 1.70-3.30 log(10) copies/mL) lower limits of detection. The variation observed in reported results on individual samples ranged from 2.28 log(10) (minimum) to 4.14 log(10) (maximum). Variation was independent of dynamic range and use of commercial versus laboratory-developed assays. Overall, only 47.0% of all results fell within acceptable standards of variation: defined as the expected result +/- 0.50 log(10). Interlaboratory variability on replicate samples was significantly greater than intralaboratory variability (p < 0.0001). Kinetics of change in VL appears more relevant than absolute values and clinicians should understand the uncertainty associated with absolute VL values at their institutions. The creation of an international reference standard for EBV VL assay calibration would be an initial important step in quality improvement of this laboratory tool.

Consensus Characterization of 16 FMR1 Reference Materials: A Consortium Study

Fragile X syndrome, which is caused by expansion of a (CGG)(n) repeat in the FMR1 gene, occurs in approximately 1:3500 males and causes mental retardation/behavioral problems. Smaller (CGG)(n) repeat expansions in FMR1, premutations, are associated with premature ovarian failure and fragile X-associated tremor/ataxia syndrome. An FMR1-sizing assay is technically challenging because of high GC content of the (CGG)(n) repeat, the size limitations of conventional PCR, and a lack of reference materials available for test development/validation and routine quality control. The Centers for Disease Control and Prevention and the Association for Molecular Pathology, together with the genetic testing community, have addressed the need for characterized fragile X mutation reference materials by developing characterized DNA samples from 16 cell lines with repeat lengths representing important phenotypic classes and diagnostic cutoffs. The alleles in these materials were characterized by consensus analysis in nine clinical laboratories. The information generated from this study is available on the Centers for Disease Control and Prevention and Coriell Cell Repositories websites. DNA purified from these cell lines is available to the genetics community through the Coriell Cell Repositories. The public availability of these reference materials should help support accurate clinical fragile X syndrome testing.

Development of an Integrated Assay for Detection of BCR-ABL RNA

Current practice guidelines for managing patients with chronic myelogenous leukemia (CML) call for monitoring BCR-ABL transcript concentrations with a quantitative reverse transcription-PCR (qRT-PCR) assay. Because the available laboratory-developed assays lack consensus on the appropriate design, reporting of results, and reference intervals, we developed and evaluated an integrated BCR-ABL assay that yields standardized results for any laboratory and can be performed by technicians with no specialized training. We used the Cepheid Xpert BCR-ABL Monitor assay to measure both BCR-ABL and ABL (endogenous control) transcripts in blood samples from CML patients and healthy individuals. The assay involves 8 manual pipetting steps, fully automated nucleic acid purification, a nested qRT-PCR step, and data analysis. The BCR-ABL assay requires approximately 2 h 20 min and covers a 5-log concentration range with a lower detection limit for the BCR-ABL:ABL ratio of approximately 0.005%. Assay results were negative for 100% of the 56 known CML-negative samples (12 patients with other hematologic disorders and 44 healthy blood donors). Testing of CML-positive patients undergoing disease monitoring showed 85% agreement with negative results (17 of 20) and 100% agreement with positive results (26 of 26). An imprecision/portability study revealed no differences in performance between sites, days, instruments, and operators. The Xpert BCR-ABL Monitor assay provides a robust and reproducible alternative to laboratory-developed assays. Its ease of use may allow more laboratories to offer BCR-ABL testing for patients, and the short assay time enables same-day results for treating physicians.

Evaluation of Real-Time PCR Laboratory-Developed Tests Using Analyte-Specific Reagents for Cytomegalovirus Quantification

Viral load testing for cytomegalovirus (CMV) has become the standard for the diagnosis of infection and monitoring of therapy at many transplant centers. However, no viral load test has been approved by the FDA. Therefore, many laboratories rely on laboratory-developed assays. This study evaluated the performance characteristics of two real-time PCR tests developed using the artus CMV analyte-specific reagents (ASRs). One version is distributed by Abbott Molecular and the other by QIAGEN. For plasma specimens, the Abbott test had a limit of detection of 2.3 log10 copies/ml and a linear range up to at least 6.0 log10 copies/ml. Comparison of plasma viral loads using the Abbott test and the Roche Amplicor Monitor test showed a mean difference of -0.012 log10 copies/ml. In addition, the Abbott test viral loads correlated with the Digene Hybrid Capture assay ratios. Viral loads obtained from plasma specimens tested by the Abbott and QIAGEN tests were in very close agreement (mean difference, 0.144 log10 copies/ml). When the QIAGEN test was evaluated with the QIAGEN, MagNA Pure, and easyMAG extraction methods, the viral loads for all three methods were within 0.370 log10 copies/ml. Thus, there is good agreement between viral loads obtained by the different tests using the same extraction method or by the same test using different extraction methods. The availability of real-time PCR ASRs provides additional reagents that can be used for CMV viral load testing.

Performance Characteristics of Two Real-Time PCR Assays for the Quantification of Epstein-Barr Virus DNA

We compared the performance of a laboratory-developed 5'-nuclease real-time polymerase chain reaction assay and a commercial assay (LightCycler, Roche Diagnostics, Indianapolis, IN) for quantification of Epstein-Barr virus (EBV) DNA. Using standards provided by the manufacturer, the LightCycler assay was linear from 100 to 1 million copies per reaction. Based on dilution of a plasmid containing the amplicon, the laboratory-developed assay was linear from 22 to 45 million copies per reaction. Both assays detected 0.5 copies of genomic EBV DNA per reaction; both showed good reproducibility with coefficients of variation from 0.3% to 2.4% for the LightCycler and 1.8% to 5.1% for the laboratory-developed assay. For 31 whole blood specimens with measurable values in both assays, the viral load values obtained with the LightCycler averaged 2.3-fold higher than those obtained with the laboratory-developed assay. Testing 30 matched whole blood and plasma samples in the laboratory-developed assay showed whole blood viral load values averaged 10-fold higher than those for plasma. The LightCycler and laboratory-developed assays are sensitive and reproducible with broad linear ranges. Further clinical evaluation is needed to determine the viral load cutoff that is predictive of posttransplantation lymphoproliferative disorders.

Real‐Time PCR Improves Detection of Trichomonas vaginalis Infection Compared With Culture Using Self‐Collected Vaginal swabs

OBJECTIVE: To compare a real-time polymerase chain reaction (PCR) assay with broth culture for the detection of Trichomonas vaginalis using self-collected vaginal swabs. METHODS: Self-collected vaginal swabs were obtained from adolescent and young adult African-American women participating in HIV-1 prevention programs. T. vaginalis culture was performed using the InPouch TV System. Samples for the real-time PCR assay were collected using the BDProbeTec ET Culturette Direct Dry Swab system and tested in a laboratory-developed assay which targeted a repeated sequence of the genome. Discrepant samples that were culture negative and positive in the real-time PCR assay were tested in a confirmatory PCR which targeted a different region of the T. vaginalis genome, the18S ribosomal DNA gene. RESULTS: Of the 524 specimens tested by both culture and real-time PCR, 36 were culture positive and 54 were positive in the real-time PCR assay; 16 of the 18 discrepant specimens were also positive in the confirmatory PCR assay. Using a modified gold standard of positive by culture or positive in both PCR assays, the sensitivity of the real-time PCR assay was 100% and the specificity was 99.6%, whereas culture had a sensitivity of 69.2% and a specificity of 100%. CONCLUSIONS: The real-time PCR assay was sensitive and specific for the detection of T. vaginalis DNA from self-collected vaginal swab specimens. The ability to use the BDProbeTec dry swab system for the real-time PCR testing allowed for the detection of Chlamydia trachomatis, Neisseria gonorrhoeae, and T. vaginalis from a single specimen.

Multiplex RT-PCR for the Detection of Leukemia-Associated Translocations: Validation and Application to Routine Molecular Diagnostic Practice

The aim of this study was to validate the application of a commercially available multiplex reverse transcription polymerase chain reaction (RT-PCR) assay [Hemavision-7 System] for the seven most common leukemia translocations for routine molecular diagnostic hematopathology practice. A total of 98 samples, comprising four groups, were evaluated: Group 1, 16 diagnostic samples molecularly positive by our existing laboratory-developed assays for PML-RARalpha/t (15;17) or BCR-ABL/t (9;22); Group 2, 51 diagnostic samples negative by our laboratory-developed assays for PML-RARalpha/t (15;17) or BCR-ABL/t (9;22); Group 3, 21 prospectively analyzed diagnostic cases, without prior molecular studies; and Group 4, 10 minimal residual disease (MRD) samples. Analysis of the two previously studied cohorts (Groups 1 and 2) confirmed the diagnostic sensitivity and specificity of the multiplex assay with regard to these two translocations. Additionally, however, in the "negative" Group (Group 2) the assay revealed three unanticipated translocations (CBFbeta-MYH11, BCR-ABL, and MLL-AF4), two of which were confirmed on cytogenetics. Analysis of the prospective cohort demonstrated that the assay was cost-effective and amenable to standard laboratory practice, with an identically sensitive MRD detection rate to that of our laboratory-developed tests. Virtually all of the results obtained were consistent with the phenotype and karyotype by conventional methods. This study illustrates the utility of a kit-based multiplex RT-PCR assay for the molecular diagnosis and monitoring of leukemias and reinforces the complementary roles of molecular testing and cytogenetics in diagnostic hematopathology.

16S rRNA gene sequencing for bacterial pathogen identification in the clinical laboratory

For many years, sequencing of the 16S ribosomal RNA (rRNA) gene has served as an important tool for determining phylogenetic relationships between bacteria. The features of this molecular target that make it a useful phylogenetic tool also make it useful for bacterial detection and identification in the clinical laboratory. Sequence analysis of the 16S rRNA gene is a powerful mechanism for identifying new pathogens in patients with suspected bacterial disease, and more recently this technology is being applied in the clinical laboratory for routine identification of bacterial isolates. Several studies have shown that sequence identification is useful for slow-growing, unusual, and fastidious bacteria as well as for bacteria that are poorly differentiated by conventional methods. The technical resources necessary for sequence identification are significant. This method requires reagents and instrumentation for amplification and sequencing, a database of known sequences, and software for sequence editing and database comparison. Commercial reagents are available, and laboratory-developed assays for amplification and sequencing have been reported. Likewise, there are an increasing number of commercial and public databases. Despite the availability of resources, sequence-based identification is still relatively expensive. The cost is significantly reduced only by the introduction of more automated methods. As the cost decreases, this technology is likely to be more widely applied in the clinical setting.