External Quality Assessment Panel Research Articles

Validation, implementation and quality control of a Torque Teno Virus qPCR in a multinational clinical trial

BackgroundImmunosuppressive medication after organ transplantation is usually dosed through therapeutic drug monitoring. Trough levels of antirejection medication however, do not adequately predict rejection or infections. The TTVguideIT trial is a multinational clinical trial evaluating the safety of Torque Teno Virus (TTV) load assessed by qPCR, as an alternative to trough level tacrolimus dosing. MethodsPrior to, and during the clinical trial, the inter-and intra-laboratory variability, accuracy, and precision of the TTV R-GENE® assay was evaluated through analysis of internal quality control (IQC), external quality assessment (EQA) and linearity panels performed by the thirteen participating clinical virology laboratories, each using their standard testing platforms. ResultsIQC samples with a target of 4 log10 copies/mL (cp/mL) were tested by the participating laboratories 130 times during the implementation phase and 987 times during the trial phase. They showed excellent accuracy, with an inter-laboratory standard deviation (SD) of 0.17 log10 cp/mL, and an intra-laboratory SD of 0.03 to 0.20 log10 cp/mL during the implementation phase, and an inter-laboratory SD of 0.19 log10 cp/mL, and an intra-laboratory SD 0.07 to 0.18 log10 cp/mL during the trial phase. Three EQA panels and three linearity panels showed similarly small variability during implementation as well as within the trial phase. ConclusionThis data shows that TTV load measurement can be standardized for use in a multinational clinical trial. By using IQC, LP and EQA samples, the quality and integrity of the assay can be compared between laboratories and precise and accurate results can be generated.

External Quality Assessment (EQA) scheme for serological diagnostic test for SARS-CoV-2 detection in Sicily Region (Italy), in the period 2020-2022.

Since December 2019, worldwide public health has been exposed to a severe acute respiratory syndrome caused by Coronavirus-2. Serological testing is necessary for retrospective assessment of seroprevalence rates, and the determination of vaccine response and duration of immunity. For this reason, it was necessary to introduce a panel of tests able to identify and quantify Covid-19 antibodies. As a Regional Reference Centre, the CRQ Laboratory (Regional Laboratory for the Quality Control) developed and conducted an External Quality Assessment (EQA) panel of assays, to evaluate the quality of various methods, that were used by 288 Sicilian laboratories, previously authorized on behalf of the Public Health Service. The performance test was based on pooled samples with different levels of concentration of antibodies. 97 , 98, and 95 % of the participating laboratories tested all samples correctly in 2020, 2021, and 2022 respectively. The best performance was observed in the test of total Ig. The general performance of laboratories improved over the years. The incorrect diagnosis had and could still have important implications on vaccination cycles. Only through the effort of laboratory professionals, and the extension of the EQA scheme, a better harmonization of methods, protocols, and thus results, to guarantee a better healthcare system, will be possible.

External Quality Assessment Program for SARS-COV-2 Molecular Detection in Pakistan.

Amid coronavirus disease 2019 (COVID-19) pandemic, accurate detection of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is critical for diagnosis management and breaking down transmission chains. We designed a national external quality assessment panel (EQAP) for SARS-CoV-2 molecular detection comprising working laboratories nationwide. A molecular diagnostic EQA panel that consists of five samples for SARS CoV-2 testing was distributed to 141 public and private sector laboratories across country. These samples contain different concentrations of SARS-CoV-2 to evaluate the sensitivity of commercial kits available. Sensitivity among public and private sector laboratories was variable, particularly lower SARS-CoV-2 concentrations significantly increased the risk of false-negative tests, whereas Ct values of accurately tested SARS-CoV-2 specimens increased as concentration decreased. These findings highlighted that performance of used commercial kits was not significantly correlated to various extraction or PCR methods. This study highlights the need for a national external quality assessment panel (EQAP) in the country to improve the quality of the healthcare system while ensuring the accuracy and reliability of results. Furthermore, EQAPs can help laboratories meet accreditation and regulatory requirements. However, continued participation in EQAP is recommended for quality enhancement of laboratories.

External quality assessment for molecular detection of Ureaplasma urealyticum in China

Background and aimsA pilot external quality assessment (EQA) scheme for molecular detection of Ureaplasma urealyticum (UU) was conducted by the National Center for Clinical Laboratories (NCCL) to evaluate the testing capabilities of clinical laboratories and the actual performance of DNA-based nucleic acid amplification tests (NAAT) and RNA-based NAATs when applied in clinical settings. Materials and methodsThe EQA panel contained twelve lyophilized samples, including positive samples containing inactivated cell culture supernatants of UU at different concentrations and sterile saline for negative samples. The positive samples were further divided into three groups of high, moderate and low concentrations. The panels were distributed to the participants and the datasets were analyzed according to the qualitative results. ResultsA total of 365 laboratories participated in the EQA scheme, and 360 results submitted by 338 laboratories were collected, of which 96.11 % (346/360) of the returned results and 95.86 % (324/338) of the laboratories were deemed competent. The positive percentage agreement (PPA) was ≥ 97.5 % for high and moderate concentration samples, but varied significantly for low concentration samples, decreasing from 86.94 % to 51.94 % as the sample concentration decreased. Additionally, for low concentration samples, RNA-based NAAT showed higher PPAs than DNA-based NAATs, but these results were specific to UU supernatants used in this study. ConclusionMost of UU detection assays employed by the participants were generally consistent with their estimated limit of detection (LOD), and the majority of participants can reliably detect UU samples with high and moderate concentrations, while the poor analytical performance for low concentration samples requires further improvement and optimization.

External quality assessment to support the WHO ProSPeRo study for the evaluation of two dual HIV/syphilis point-of-care tests in seven countries

BackgroundSexually transmitted infections (STIs) such as syphilis and HIV remain to be a significant public health issue worldwide. Dual rapid point-of-care tests (POCTs) have shown promise for detecting antibodies to HIV and syphilis but have not been fully evaluated in the field. Our study supported the WHO ProSPeRo study on Sexually Transmitted Infection Point-of-Care Testing (STI POCT) by providing external quality assessment (EQA) for HIV and syphilis testing in reference laboratories and their associated clinical sites in seven countries.MethodsHIV/syphilis serum liquid and dried tube specimen (DTS) panels were prepared by CDC. Liquid panels were distributed to the reference laboratories for three rounds of testing using commercially and locally available laboratory-based serological tests. DTS panels were sent to the clinical testing sites for 8 rounds of POC testing using the Abbott SD BIOLINE HIV/Syphilis Duo test (hereafter referred to as SD BIOLINE) and the Chembio Dual Path Platform (DPP) HIV-Syphilis assay. EQA panels were tested at CDC using the Rapid Plasma Reagin (RPR) test and the Treponema pallidum Particle Agglutination assay (TP-PA) for syphilis antibodies. Genetic Systems HIV-1/HIV-2 Plus O EIA, Geenius HIV Supplemental Assay and the Oraquick Advance HIV test were used to detect HIV antibodies in the EQA panels. Results from the reference laboratories and POCT sites were compared to those obtained at the CDC and a percentage agreement was calculated.ResultsQualitative RPR and TP-PA performed at the reference laboratories demonstrated 95.4–100% agreement with CDC results while quantitative RPR and TP-PA tests demonstrated 87.7% and 89.2% agreement, respectively. A 93.8% concordance rate was observed for qualitative HIV testing in laboratories. EQA testing at clinical sites using dual tests showed 98.7% and 99.1% agreement for detection of HIV antibodies and eight out of 10 sites had > 95.8% agreement for syphilis testing. However, two clinical sites showed only 65.0–66.7% agreement for SD BIOLINE and 84.0–86.7% for DPP, respectively, for syphilis testing.ConclusionsOverall, laboratories demonstrated high EQA performance in this study. Both HIV/syphilis POCTs gave expected results in the clinic-based evaluations using DTS. However, testing errors were identified in a few testing sites suggesting the necessity for continuous training and monitoring the quality of POC testing.

A multicenter evaluation of the QIAstat-Dx meningitis-encephalitis syndromic test kit as compared to the conventional diagnostic microbiology workflow

PurposeRapid diagnosis and treatment of infectious meningitis and encephalitis (ME) is critical to minimize morbidity and mortality. Recently, Qiagen introduced the CE-IVD QIAstat-Dx ME panel (QS-ME) for syndromic diagnostic testing of meningitis and encephalitis. Some data on the performance of the QS-ME in comparison to the BioFire FilmArray ME panel are available. In this study, the performance of the QS-ME is compared to the current diagnostic workflow in two academic medical centers in the Netherlands.MethodsA total of 110 cerebrospinal fluid samples were retrospectively tested with the QS-ME. The results obtained were compared to the results of laboratory-developed real-time PCR assays (LDTs), IS-pro, bacterial culture, and cryptococcal antigen (CrAg) testing. In addition, the accuracy of the QS-ME was also investigated using an external quality assessment (EQA) panel consisting of ten samples.ResultsFour of the 110 samples tested failed to produce a valid QS-ME result. In the remaining 106 samples, the QS-ME detected 53/53 viral targets, 38/40 bacterial targets, and 7/13 Cryptococcus neoformans targets. The discrepant bacterial results consisted of two samples that were previously tested positive for Listeria monocytogenes (CT 35.8) and Streptococcus pneumoniae (CT 40), respectively. The QS-ME detected one additional result, consisting of a varicella-zoster virus signal (CT 35.9), in a sample in which both techniques detected Streptococcus pyogenes. Finally, 100% concordance was achieved in testing a blinded bacterial ME EQA panel.ConclusionThe QS-ME is a relevant addition to the syndromic testing landscape to assist in diagnosing infectious ME.

A small-scale external quality assessment for PCR detection of group B streptococcus in China

BackgroundGroup B streptococcus (GBS) is considered a leading cause of maternal and infant morbidity and mortality. Molecular diagnosis is a routinely used approach for GBS screening to protect pregnant women and prevent early-onset GBS neonatal disease. The objective of this study was to identify issues and guarantee the dependability of GBS molecular diagnosis by an external quality assessment (EQA) scheme. MethodsThe EQA panel comprised eight samples spiked with 10-fold dilutions of GBS suspension (20–2,000,000 copies/mL), and 2 negative control samples. The panels were coded randomly and distributed to participating laboratories for GBS detection. ResultsIn total, 44 participating laboratories submitted results with eight commercial GBS PCR assays and one in-house assay. Among them, 36 obtained an acceptable or higher performance score, while 8 required improvement. Among the 440 results returned, 62 (14.1 %) were incorrect, including 5 false positives and 57 false negatives. ConclusionsOur small-scale EQA showed that most participating laboratories have reliable diagnostic capacities for GBS PCR detection. Nonetheless, further improvements in the detection performance of some laboratories are required, particularly with low-concentration samples. Our survey also reinforces the use of EQA as an essential tool to evaluate the overall proficiency of clinical laboratories.

A-361 Implementation of a Fit-for-purpose Point of Care Quality Assurance Program

Abstract Background All individuals should have equitable access to accurate and timely testing for infectious diseases. Point of care testing (PoCT) has been developed to support populations having limited access to laboratory-based testing. Unlike laboratory-based testing, PoCT is often performed by non-laboratory staff and outside the jurisdiction of regulatory frameworks. Under these conditions, quality assurance (QA) of PoCT is often lacking; inaccurate testing can go undetected, leading to poor patient outcomes. A fit-for-purpose QA program was developed to monitor the quality of PoCT for infectious disease testing, particularly in low-middle income countries and in testing outside the laboratory regulatory environment. Methods In collaboration with the World Health Organization (WHO), the National Serology Reference Laboratory (NRL) reviewed the barriers to participation in QA programs experienced by PoCT sites. Using this information, NRL developed a QA model specifically designed for PoCT for infectious disease. In collaboration with Foundation for Innovative and New Diagnostics (FIND, Geneva, Switzerland), Kirby Institute (Sydney, Australia) and Flinders University (Adelaide, Australia), NRL implemented the PoCT QA model across Africa, Asia, and remote regional Australia. The model consists of competency panels (CP - one positive and one negative sample) and external quality assessment (EQA) panels. The EQA panels contain five samples. Whereas the test site knows the reactivity of the CP samples, the EQA samples are tested blinded. Both panels use inactivated samples that are stable at ambient temperature. The model uses streamlined logistics channels, with data collection and analysis using smartphone technology and QR codes. NRL designed a method for randomizing the identity of EQA sample vials so test sites can test QA panels ad hoc, and not be limited to specific test event dates. A range of support material such as pictorial instructions for use, virtual training events and on-line videos were produced to support test sites. Results More than 100 test sites from 14 countries have participated in the NRL PoCT QA programs. The model is designed so data is collected by test sites scanning QR codes and entering results directly into a data entry screen. The NRL PoCT QA program removed barriers to participation by offering sample types that are inactivated and stable at ambient temperature for extended periods of time, removing the need for dry ice shipping. The program is cost effective making it accessible to low- and middle-income countries. Data is collected using novel smartphone technology, facilitating results to be entered into a central database for immediate analysis. Testing of the QA samples can be done at any time, avoiding set test events. Conclusion Implementation of a fit-for-purpose PoCT QA for infectious disease testing removes the barriers to participation and facilitates the monitoring of testing over time. Any deficiencies in testing can be detected and addressed rapidly, ensuring that accurate test results are reported, and the population protected.

Evaluation of noninvasive prenatal screening for copy number variations among screening laboratories

ObjectiveTo evaluate the current situation of expanded noninvasive prenatal screening (NIPS) for copy number variations (CNVs) in laboratories in China, the National Center of Clinical Laboratories conducted an externalqualityassessment (EQA) program. MethodsThe EQA panel consisted of 12 artificial samples associated with different syndromes, which were mixed with maternal plasma collected from pregnant women and enzyme-digested cell-free DNA (cfDNA) from cell lines with different fetal fractions (FFs) ranging from 5% to 15%. The panel was validated by next-generation sequencing and distributed to laboratories, along with questionnaires and case scenarios. ResultsSixty-nine laboratories participated in the EQA program, and 91.30% (63/69) of laboratories correctly identified all samples. A total of 7.25% (5/69) of the laboratories reported false-negative results, and 2.90% (2/69) of the laboratories reported unexpected CNVs. The correct rates of the 22q11.2 deletion syndrome, Cri-du-chat syndrome, 1p36 deletion syndrome and Angelman/Prader-Willi syndrome samples were 97.46%, 98.55%, 100%, and 100%, respectively. With the increase in the FF, deletion size, and read depth, the detection rate increased. For results reports, only five laboratories reported FF values, one laboratory reported the CNV classification type, and none reported sensitivity, specificity, positive predictive values, and negative predictive values. ConclusionThe detection capabilities of NIPS for CNVs still need to be improved and standardized, and FF, deletion size, and read depth are factors that affect the detection rate.

Performance evaluation of SARS-CoV-2 antigen detection in the post-pandemic era: multi-laboratory assessment.

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) antigen detection is an indispensable tool for epidemic surveillance in the post-pandemic era. Faced with irregular performance, a comprehensive external quality assessment (EQA) scheme was conducted by the National Center for Clinical Laboratories (NCCL) to evaluate the analytical performance and status of SARS-CoV-2 antigen tests. The EQA panel included ten lyophilized samples containing serial 5-fold dilutions of inactivated SARS-CoV-2-positive supernatants of the Omicron BA.1 and BA.5 strains and negative samples, which were classified into "validating" samples and "educational" samples. Data were analyzed according to qualitative results for each sample. A total of 339 laboratories in China participated in this EQA scheme, and 378 effective results were collected. All validating samples were correctly reported by 90.56 % (307/339) of the participants and 90.21 % (341/378) of the datasets. The positive percent agreement (PPA) was >99 % for samples with concentrations of 2×107 copies/mL but was 92.20 % (697/756) for 4×106 copies/mL and 25.26 % (382/1,512) for 8×105 copies/mL samples. Colloidal gold was the most frequently used (84.66 %, 320/378) but showed the lowest PPAs (57.11 %, 1,462/2,560) for positive samples compared with fluorescence immunochromatography (90 %, 36/40) and latex chromatography (79.01 %, 335/424). Among 11 assays used in more than 10 clinical laboratories, ACON showed a higher sensitivity than other assays. The EQA study can help to validate whether it's necessary to update antigen detection assays for manufacturers and provide participants with information about the performance of assays to take the first step toward routine post-market surveillance.

A multicentre external quality assessment: A first step to standardise PCR protocols for the diagnosis of histoplasmosis and coccidioidomycosis.

In-house real-time PCR (qPCR) is increasingly used to diagnose the so-called endemic mycoses as commercial assays are not widely available. To compare the performance of different molecular diagnostic assays for detecting Histoplasma capsulatum and Coccidioides spp. in five European reference laboratories. Two blinded external quality assessment (EQA) panels were sent to each laboratory that performed the analysis with their in-house assays. Both panels included a range of concentrations of H. capsulatum (n = 7) and Coccidioides spp. (n = 6), negative control and DNA from other fungi. Four laboratories used specific qPCRs, and one laboratory a broad-range fungal conventional PCR (cPCR) and a specific cPCR for H. capsulatum with subsequent sequencing. qPCR assays were the most sensitive for the detection of H. capsulatum DNA. The lowest amount of H. capsulatum DNA detected was 1-4 fg, 0.1 pg and 10 pg for qPCRs, specific cPCR and broad-range cPCR, respectively. False positive results occurred with high concentrations of Blastomyces dermatitidis DNA in two laboratories and with Emergomyces spp. in one laboratory. For the Coccidioides panel, the lowest amount of DNA detected was 1-16 fg by qPCRs and 10 pg with the broad-range cPCR. One laboratory reported a false positive result by qPCR with high load of Uncinocarpus DNA. All five laboratories were able to correctly detect H. capsulatum and Coccidioides spp. DNA and qPCRs had a better performance than specific cPCR and broad-range cPCR. EQAs may help standardise in-house molecular tests for the so-called endemic mycoses improving patient management.

Multiplex Real-time PCR Assay for the Detection of all Chlamydia Species and Simultaneous Differentiation of C. psittaci and C. pneumoniae in Human Clinical Specimens.

We developed and assessed the performance of a new multiplex real-time PCR assay for the detection of all Chlamydia species and simultaneous differentiation of Chlamydia psittaci and Chlamydia pneumoniae-two important human respiratory pathogens-in human clinical specimens. Next-generation sequencing was used to identify unique targets to design real-time PCR assays targeting all Chlamydia species, C. psittaci, and C. pneumoniae. To validate the assay, we used a panel of 49 culture isolates comprising seven C. psittaci genotypes, eight C. pneumoniae isolates, seven other Chlamydia species, and 22 near-neighbor bacterial and viral isolates, along with 22 specimens from external quality assessment (EQA) panels and 34 nasopharyngeal and oropharyngeal swabs and cerebrospinal fluid, stool, and sputum specimens previously identified as positive or negative for C. psittaci or C. pneumoniae. The assays were 100% specific, with limits of detection of 7.64- 9.02 fg/μL. The assay results matched with historical assay results for all specimens, except for one owing to the increased sensitivity of the new C. psittaci assay; the results of the EQA specimens were 100% accurate. This assay may improve the timely and accurate clinical diagnosis of Chlamydia infections and provide a greater understanding of the burden of disease caused by these agents.

Affordable drug resistance genotyping of HIV-1 reverse transcriptase, protease and integrase genes, for resource limited settings

BackgroundAs use of dolutegravir (DTG) becomes more common in resource limited settings (RLS), the demand for integrase resistance testing is increasing. Affordable methods for genotyping all relevant HIV-1 pol genes (i.e., protease (PR), reverse transcriptase (RT) and integrase (IN)) are required to guide choice of future antiretroviral therapy (ART). We designed an in-house HIV-1 drug resistance (HIVDR) genotyping method that is affordable and suitable for use in RLS.MethodsWe obtained remnant plasma samples from CAPRISA 103 study and amplified HIV-1 PR, RT and IN genes, using an innovative PCR assay. We validated the assay using remnant plasma samples from an external quality assessment (EQA) programme. We genotyped samples by Sanger sequencing and assessed HIVDR mutations using the Stanford HIV drug resistance database. We compared drug resistance mutations with previous genotypes and calculated method cost-estimates.ResultsFrom 96 samples processed, we obtained sequence data for 78 (81%), of which 75 (96%) had a least one HIVDR mutation, with no major-IN mutations observed. Only one sample had an E157Q INSTI-accessory mutation. When compared to previous genotypes, 18/78 (23%) had at least one discordant mutation, but only 2/78 (3%) resulted in different phenotypic predictions that could affect choice of subsequent regimen. All CAPRISA 103 study sequences were HIV-1C as confirmed by phylogenetic analysis. Of the 7 EQA samples, 4 were HIV-1C, 2 were HIV-1D, and 1 was HIV-1A. Genotypic resistance data generated using the IDR method were 100% concordant with EQA panel results. Overall genotyping cost per sample was estimated at ~ US$43–$US49, with a processing time of ~ 2 working days.ConclusionsWe successfully designed an in-house HIVDR method that is suitable for genotyping HIV-1 PR, RT and IN genes, at an affordable cost and shorter turnaround time. This HIVDR genotyping method accommodates changes in ART regimens and will help to guide HIV-1 treatment decisions in RLS.

Establishing an External Quality Assessment (EQA) Program for Urinalysis in Medical Laboratories of Thailand.

Thailand Association of Clinical Biochemists (TACB) introduced External Quality Assurance schemes (EQAs) for urinalysis (UA) using urine strips in medical laboratories of Thailand. The few available External Quality Assessment (EQA) programs on urinary microalbumin rarely include an evaluation of clinical cases. The aim of the present study was to assess a descriptive analysis of biochemical urinalysis including urine microalbumin in the Thailand laboratory practice. From January 2021 to December 2021, four surveys were organized. EQA urine samples were distributed to the participants by mail. The participants measured the UA of 2 samples quarterly and returned the results together with the information about their instruments and suggestion for the performance of the laboratory report quarterly. Moreover, summary of the situation of each laboratory performance was feedbacked by online system. Fifty-eight laboratories participated in the survey. The EQA panels included positive and negative samples. The analytical results for passed parameters of urine chemical test range from 79.3-100%. All special tests; microalbumin, creatinine, and beta-HCG showed correct result from 85.1-96.1%. The overall accuracy, specificity, and sensitivity were 92.6, 85.7, and 75,4%, respectively. The major issues were observed: the low sensitivity for the detection of low-concentration samples and the incapacity of several methods to detect the positive sample. The assessment is needed to continuously evaluate the improvement proficiency of laboratories in Thailand.

External quality assessment of SARS-CoV-2 serology in European expert laboratories, April 2021.

BackgroundCountries worldwide are focusing to mitigate the ongoing SARS-CoV-2 pandemic by employing public health measures. Laboratories have a key role in the control of SARS-CoV-2 transmission. Serology for SARS-CoV-2 is of critical importance to support diagnosis, define the epidemiological framework and evaluate immune responses to natural infection and vaccine administration.AimThe aim of this study was the assessment of the actual capability among laboratories involved in sero-epidemiological studies on COVID-19 in EU/EEA and EU enlargement countries to detect SARS-CoV-2 antibodies through an external quality assessment (EQA) based on proficiency testing.MethodsThe EQA panels were composed of eight different, pooled human serum samples (all collected in 2020 before the vaccine roll-out), addressing sensitivity and specificity of detection. The panels and two EU human SARS-CoV-2 serological standards were sent to 56 laboratories in 30 countries.ResultsThe overall performance of laboratories within this EQA indicated a robust ability to establish past SARS-CoV-2 infections via detection of anti-SARS-CoV-2 antibodies, with 53 of 55 laboratories using at least one test that characterised all EQA samples correctly. IgM-specific test methods provided most incorrect sample characterisations (24/208), while test methods detecting total immunoglobulin (0/119) and neutralising antibodies (2/230) performed the best. The semiquantitative assays used by the EQA participants also showed a robust performance in relation to the standards.ConclusionOur EQA showed a high capability across European reference laboratories for reliable diagnostics for SARS-CoV-2 antibody responses. Serological tests that provide robust and reliable detection of anti-SARS-CoV-2 antibodies are available.

Technical and health governance aspects of the External Quality Assessment Scheme for the SARS-CoV-2 molecular tests: institutional experience performed in all clinical laboratories of a Regional Health Service.

Since December 2019, the worldwide public health has been threatened by a severe acute respiratory syndrome caused by Coronavirus-2. From the beginning, a turning point has been the identification of new cases of infection, in order to minimize the virus spreading among the population. For this reason, it was necessary introducing a panel of tests able to identify positive cases, which became crucial for all countries. As a Regional Reference Centre, the CRQ Laboratory (Regional Laboratory for the Quality Control) developed and conducted an External Quality Assessment (EQA) panel of assay, so as to evaluate the quality of real-time reverse transcription polymerase chain reaction (PCR), which were used by 62 Sicilian laboratories, previously authorized to issue certificates for the COVID-19 diagnosis, on behalf of the Public Health Service. The qualitative performance test was based on pooled samples with different viral loads of SARS-CoV-2 or human Coronavirus OC43. 75% of the participating laboratories tested all core samples correctly, while the remaining 25% interpreted incorrectly the EQA exercise samples matching negatively the standards required. Subsequent inspection visits confirmed the issue of incorrect positive and negative certifications for COVID-19 by private and public laboratories, despite the possession of the authorization requirements currently provided for by current regulations, with a significant impact on the SSR.

National external quality assessment for molecular detection of severe acute respiratory syndrome coronavirus 2 Delta variant

Objective: To clarify the impact of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) Delta variant on the performance of existing molecular diagnostic assays, and investigate the detection ability of clinical laboratories across China. Methods: The first nationwide external quality assessment (EQA) for molecular detection of Delta variant was carried out based on the non-infectious phage virus-like particles samples, which were prepared by genetic engineering methods and distributed to 8 488 laboratories nationwide. The EQA panel was composed of three Delta variant samples (7.5×102, 1.5×103 and 6.0×103 copies/ml), one non-variant weak positive sample and one negative sample. The percentage of agreement (PA) of Delta variant samples with different concentration, the PA of Delta variant and non-variant samples with 7.5×102 copies/ml, the PA of assays used by more than 100 laboratories for Delta variant samples with different concentration and the PA of Delta variant and non-variant samples with 7.5×102 copies/ml were calculated and analyzed. Results: The data from 8 127 laboratories were available for evaluation. The testing capability of 98.77% (8 027/8 127) of the participating laboratories was found to be competent in reporting correct results for all samples. The overall percentage of agreement (OPA), negative percentage of agreement (NPA) and positive percentage of agreement (PPA) of the samples were 99.64% (40 490/40 635), 99.73% (8 105/8 127), 99.62% (32 385/32 508), respectively. With the decrease of the concentration of the samples, the PPA of Delta variant samples decreased. The PPAs were 99.41% and 99.51% for Delta variant and non-variant samples with 7.5×102 copies/ml, respectively, with no statistical difference (P=0.392). The OPA, NPA and PPA of the assays used by more than 100 laboratories were all greater than 98%, and no statistical difference of the PPAs was identified between Delta variant and non-variant samples with 7.5×102 copies/ml (P>0.05). Conclusions: Delta variant fails to impair the performance of current molecular diagnostic assays in China. The clinical laboratories have the same detection capabilities for Delta variant and non-variant samples. However, in certain laboratories, further improvement is required to ensure the accurate detection of weak positive samples.

External Quality Assessment for Severe Acute Respiratory Syndrome Coronavirus 2 RNA Detection in Chongqing, China.

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) poses a huge threat to public health. Therefore, clinical laboratories must have the ability to detect SARS-CoV-2 RNA. With the enhanced detection in Chongqing, many laboratories rapidly implemented assays for the molecular detection of SARS-CoV-2 based on real-time reverse transcription polymerase chain reaction (rRT-PCR) assays. This study aimed to improve the detection capabilities of clinical laboratories by evaluating their performance for SARS-CoV-2 RNA detection through the external quality assessment (EQA) programs of 2020 in Chongqing to contribute to the prevention of this epidemic. The EQA panels consist of eight positive samples with concentrations within 2.7 - 5.0 log10 copies/mL quantified by digital PCR and two negative samples with other human coronaviruses clinically validated by four commercial assays. All 21 samples from four rounds were distributed to the participating laboratories through cold-chain transportation. Depending on the results from each sample, laboratories were asked to use one or two assays to detect SARS-CoV-2 RNA. Test results and raw data were also required. All data were evaluated, and the testing performance of commercial assays was compared. For the rounds, all laboratories used commercial assays. Four rounds of EQA programs were performed, and the percent agreements of participants were 97.5% (39/40), 97.5% (39/40), 98.9% (88/89), 100.0% (131/131). Only three false negative results and one false positive result were obtained. Statistical significance in the Ct values of the ORF region and N region of SARS-CoV-2-RNA was found by using one-step, one-step concentration, and magnetic bead methods (p < 0.05). The Ct values of the ORF region of SARS-CoV-2-RNA in P5 and P6 were significantly different in the different batches of reagent A (p < 0.05). The ORF region of SARS-CoV-2-RNA was not detected in a batch of reagent B. The majority of laboratories in Chongqing have reliable diagnostic ability for SARS-CoV-2 detection. Our data emphasized the importance of EQA for monitoring the performance of clinical laboratories. However, clinical laboratories must first effectively evaluate the performance of reagents prior to their use.

Multi-center evaluation of Cepheid Xpert® Xpress SARS-CoV-2/Flu/RSV molecular point-of-care test

BackgroundSARS-CoV-2 is taking a huge toll on society while influenza and RSV detection are also becoming more important. These viruses pose a high burden on health care. Rapid and accurate diagnostics for these pathogens are important for swift triage in the hospital. Fast molecular point of care test (mPOCT) assays for these pathogens can prove an alternative. Here a multi-center evaluation of the Xpert® Xpress SARS-CoV-2/Flu/RSV assay is reported. Study designThe Xpert® Xpress SARS-CoV-2/Flu/RSV assay was compared to three reference assays at three Dutch medical microbiology laboratories. An external quality assessment panel consisting of 16 specimens containing SARS-CoV-2, influenza viruses, RSV or human seasonal coronaviruses, or a combination thereof were used. Clinical specimens containing SARS-CoV-2 (n = 57), influenza viruses (n = 21) or RSV (n = 12), at a wide range of relevant concentrations were used. One laboratory also tested zoonotic avian and swine influenza viruses, and eight relevant SARS-CoV-2 variants. ResultsThe Xpert® Xpress SARS-CoV-2/Flu/RSV assay showed equal performance compared to the reference assays. All SARS-CoV-2 variants of interest and variants of concern were accurately detected. Human seasonal coronaviruses were not detected. All four circulating seasonal influenza virus subtypes/lineages and both RSV types were accurately detected as well as a set of recent zoonotic avian and swine influenza viruses. The clinical specimens showed 98.2% concordance using this assay. ConclusionThe Xpert® Xpress SARS-CoV-2/Flu/RSV assay is a good alternative for accurate detection for SARS-CoV-2, influenza type A virus, influenza type B virus and RSV types A and B detection in a short timeframe.

Verification of analytical bacterial spectrum of QIAstat-Dx® GI V2 and Novodiag® Bacterial GE+ V2-0 diagnostic panels.

BackgroundImplementing multiplex PCR or syndromic panel-based testing platforms to detect microbial species that cause acute diarrhoea may guide patient management more effectively and efficiently.ObjectivesTo assess and compare the performance of two syndromic panel-based testing systems, QIAstat-Dx® Gastrointestinal Panel V2 (QGI) and the Novodiag® Bacterial GE+ V2-0 (NGE).MethodsThe QGI and NGE panels include 16 and 14 bacterial gastrointestinal pathogens, respectively. The performance of the panels was tested retrospectively using 141 positive clinical stool specimens, External Quality Assessment (EQA) panels and spiked faecal specimens.ResultsFor Campylobacter jejuni and coli (n = 20), Salmonella (n = 24), Shigella (n = 13), Yersinia enterocolitica (non-1A biotypes) (n = 8), Clostridioides difficile (n = 24) and Vibrio parahaemolyticus (n = 2), QGI correctly verified 19/20, 20/24, 13/13, 8/8, 23/24 and 2/2, whereas NGE correctly verified 20/20, 17/24, 13/13, 8/8, 14/24 and 1/2. Among diarrhoeagenic Escherichia coli (n = 29), QGI reported one Shiga toxin-producing E. coli (STEC) stx1a O26:H11 as STEC serotype O157:H7 and NGE failed on one enteropathogenic E. coli, one enteroaggregative E. coli and one STEC (stx2e). Y. enterocolitica biotype 1A (non-pathogenic) (n = 6) were all positive in QGI, but negative in NGE.ConclusionsBoth QGI and NGE testing panels can improve laboratory workflow and patient management by providing user-friendly platforms that can rapidly detect a number of targets with one specimen. QGI was significantly more sensitive in identifying C. difficile. Both methods had suboptimal detection of Salmonella and this needs to be examined further. The short hands-on time and turnaround time are of value for on-demand testing and use in a high-throughput setting.