External Quality Assessment Research Articles

Targeted ultra performance liquid chromatography tandem mass spectrometry procedures for the diagnosis of inborn errors of metabolism: validation through ERNDIM external quality assessment schemes.

Early diagnosis of inborn errors of metabolism (IEM) is crucial to ensure early detection of conditions which are treatable. This study reports on targeted metabolomic procedures for the diagnosis of IEM of amino acids, acylcarnitines, creatine/guanidinoacetate, purines/pyrimidines and oligosaccharides, and describes its validation through external quality assessment schemes (EQA). Analysis was performed on a Waters ACQUITY UPLC H-class system coupled to a Waters Xevo triple-quadrupole (TQD) mass spectrometer, operating in both positive and negative electrospray ionization mode. Chromatographic separation was performed on a CORTECS C18 column (2.1×150, 1.6 µm). Data were collected by multiple reaction monitoring. The internal and EQA results were generally adequate, with a few exceptions. We calculated the relative measurement error (RME) and only a few metabolites displayed a RME higher than 30 % (asparagine and some acylcarnitine species). For oligosaccharides, semi-quantitative analysis of an educational panel clearly identified the 8 different diseases included. Overall, we have validated our analytical system through an external quality control assessment. This validation will contribute to harmonization between laboratories, thus improving identification and management of patients with IEM.

External quality assessment for molecular detection of Ureaplasma urealyticum in China

Background and aimsA pilot external quality assessment (EQA) scheme for molecular detection of Ureaplasma urealyticum (UU) was conducted by the National Center for Clinical Laboratories (NCCL) to evaluate the testing capabilities of clinical laboratories and the actual performance of DNA-based nucleic acid amplification tests (NAAT) and RNA-based NAATs when applied in clinical settings. Materials and methodsThe EQA panel contained twelve lyophilized samples, including positive samples containing inactivated cell culture supernatants of UU at different concentrations and sterile saline for negative samples. The positive samples were further divided into three groups of high, moderate and low concentrations. The panels were distributed to the participants and the datasets were analyzed according to the qualitative results. ResultsA total of 365 laboratories participated in the EQA scheme, and 360 results submitted by 338 laboratories were collected, of which 96.11 % (346/360) of the returned results and 95.86 % (324/338) of the laboratories were deemed competent. The positive percentage agreement (PPA) was ≥ 97.5 % for high and moderate concentration samples, but varied significantly for low concentration samples, decreasing from 86.94 % to 51.94 % as the sample concentration decreased. Additionally, for low concentration samples, RNA-based NAAT showed higher PPAs than DNA-based NAATs, but these results were specific to UU supernatants used in this study. ConclusionMost of UU detection assays employed by the participants were generally consistent with their estimated limit of detection (LOD), and the majority of participants can reliably detect UU samples with high and moderate concentrations, while the poor analytical performance for low concentration samples requires further improvement and optimization.

NPS–EQA PART II: Four years’ experience in external quality assessment program in Italy for classical and new psychoactive substances analysis in hair

In 2019, the Italian National Institute of Health established an external quality assessment (EQA) program to evaluate the performance of laboratories of collaborative centres participating in the National Early Warning System in hair testing for classical and new psychoactive substances (NPS). The results obtained in the four rounds (2019–2023) and the evolution in hair testing performance for classic drugs of abuse and new psychoactive substances are presented. A total of 11 hair specimens, including 3 blank samples, were prepared by adding different classes of classical and NPS at known concentrations to pre-screened drug-free hair. False negative and false positive results were calculated for the qualitative data evaluation. The quantitative evaluation included the imprecision (as % coefficient of variation, CV%) and the accuracy (as % error, ERR%) of the results with respect to a mean value obtained by reference laboratories and Z-score values were assessed. Over the years, an improvement in false negative results (from 52.4% in the first year to 34.3% in the last one) and false positive results (from 55.0% in the first year to 30.8.% in the last one) was observed. In the first round, the mean ERR% ranged from 6.2% to 112.8% due to NPS determination. However, in the subsequent three rounds, the mean ERR% ranged from 10.4% to 22.4%, The mean CV% in the four rounds was approximately 41.5% (ranging from 44.3% to 53.3%). Between 12.0% and 56.6% of the reported results in all rounds should be considered satisfactory. EQA programs help laboratories to identify and correct problems within their processes by highlighting errors and variations. This ensures that the results produced are accurate and reproducible.

NPS–EQA PART I: Four years’ experience in external quality assessment program in Italy for classical and new psychoactive substances analysis in oral fluid

In 2019, Italian National Institute of Health established an external quality assessment program (EQA) to evaluate the performance of oral fluid testing for classical and new psychoactive substances by laboratories participating in the National Early Warning System collaborative centres. This report presents the results of four rounds between 2019 and 2023. Eleven oral fluid specimens, including 3 blank samples, were prepared by adding different classes of and new psychoactive drugs at known concentrations to pre-screened drug-free oral fluid. False-negative and false-positive results were calculated for the qualitative data evaluation. The quantitative evaluation measured the imprecision and accuracy of the results, in terms of coefficient of variation (CV%) and percent error (ERR%), respectively, with respect to a mean value obtained by reference laboratories. Z-score values were then calculated. Over the years, there has been a significant improvement in false-negative results (from 42.7% in the first year to 19.4% in the last year), but not in false-positive results (from 33.3% in the first year to 22.2% in the last one). In addition to the classic drugs of abuse (e.g. cocaine, amphetamine, methadone), the substances found in false positive samples belonged to the class of synthetic cannabinoids (e.g 5-fluoro CUMYL-PINACA and 5-fluoro-EDMB-PICA), synthetic opioids (e.g butyrylfentanyl) and tryptamines (e.g. 5-methoxy-N-methyl-N-isopropyltryptamine). The four rounds yielded a mean ERR% of approximately 22.1% and a mean CV% of around 41.5%. The participating laboratories demonstrated variable performances in relation to the class of analysed psychoactive substances, as evidenced by the calculated Z-scores. Between 25% and 60% of the reported results in all rounds should be considered satisfactory. EQA is a crucial element of laboratory quality management systems. It promotes continuous improvement and maintains high standards in the field of forensic and clinical drug testing.

Navigating Quality Assessment Hurdles in Clinical Laboratory Services: A Comprehensive Review in Resource-Limited Settings.

External quality assessment is the process of evaluating the performance of a laboratory and the competence of professionals. Participation in EQA and standardizing the quality of laboratory services are a mandatory requirements for accreditation. This review is aimed at identifying and discussing challenges that hinder the effective implementation of an EQA program in countries with resource limited setting. To obtain abundant information, articles were identified by searching the literature publishedin English using the National Library of Medicine, PubMed, Science Direct and AMC digital library databases. The articles identified in the references were manually searched and included. After the article was identified, it was imported to Endnote version 8.1 and exported to Microsoft Word for citation. Based on this review, the major identified challenges that hinder the implementation of an EQA program include the high cost of control materials, malfunction and lack of maintenance for equipment failure and breakdown, a knowledge gap among laboratory professionals, noncommutability of control samples, and difficulty in assigning target values. In addition, failing to participate in EQA and failing to take corrective action are the major challenges identified. As a result, applying to an EQA program in resource-limited counties was highly challenging. To attain high performance in the laboratory and to provide quality laboratory service for patient care, the EQA supplier and the user laboratory must pay attention to these issues and take appropriate corrective actions for ongoing quality improvement and accreditation.

Variable Performance of D-dimer Testing by Hemostasis Laboratories: The Australasian/Asia-Pacific Experience.

D-dimers represent the breakdown products of fibrin. Thus, elevated plasma D-dimers will arise following a thrombotic event, such as a deep vein thrombosis or a pulmonary embolism, and therefore, a nonelevated D-dimer is used to effectively exclude such events. D-dimers are also elevated in a range of other conditions, for example, during disseminated intravascular coagulation. D-dimer levels may also be associated with prognostic value. For example, highly raised D-dimer levels can be associated with worsening clinical features in coronavirus disease 2019. Thus, D-dimer testing represents a commonly requested hemostasis test, often performed in 24/7 laboratories. Unfortunately, D-dimer testing is neither standardized nor harmonized across manufacturers or laboratories. Indeed, considering reporting units and the magnitude of units, up to 28 different combinations may be reported by laboratories. We provide updated findings for D-dimer testing in our geographic region, using recent data from the Royal College of Pathologists of Australasia Quality Assurance Programs, an international external quality assessment program, currently with over 450 participants in the D-dimer module. Data show a wide variety of assays in use and variable outcomes in reported numerical values when assessing proficiency samples. D-dimer testing mostly comprised reagents from three main manufacturing suppliers, with a small number of users of reagents from other manufacturers. Reported results showed important differences in numerical values for the same homogeneous tested samples when normalized to a single reporting unit (e.g., mg/L). Nevertheless, despite using different test reagents and reporting, most participants uniformly identified D-dimer values as below or above a "detection" cut-off for samples that were constructed to be below or above most cut-off values. As expected, mixed findings were reported for samples containing levels around expected cut-off values. We hope that our findings, reflecting on the heterogeneity of test reagents and test data, help improve diagnostic testing for D-dimer testing and facilitate harmonization and standardization, in the future.

Quality control and external quality assessment for the independent clinic-based evaluation of point-of-care testing to detect Chlamydia trachomatis, Neisseria gonorrhoeae and Trichomonas vaginalis in eight countries

BackgroundSexually transmitted infections caused by Chlamydia trachomatis (CT), Neisseria gonorrhoeae (NG) and Trichomonas vaginalis (TV) remain significant global health problems. The World Health Organization (WHO) has recently conducted a multi-faceted, multi-country validation study (ProSPeRo), which included an evaluation of the Xpert CT/NG and Xpert TV assays on the GeneXpert system (Cepheid, Sunnyvale, Ca., USA) in clinic-based settings across eight countries. To support the study, a training and quality management system was implemented and evaluated.MethodsA comprehensive training program for the study was developed. Quality control (QC) and external quality assessment (EQA) samples were provided by an accredited quality assurance provider. QC testing was conducted at 14 point-of-care testing (POCT) clinics, while EQA samples were tested by the POCT sites and a reference laboratory supporting each clinic.ResultsFor QC testing, concordance with the expected results for CT and NG was > 99% and rates of unsuccessful tests were < 4%. For TV testing, concordance was similar (97%), but rates of unsuccessful tests were high (18%), particularly in the ‘TV negative’ sample. For EQA testing initially conducted in 2018, concordance was 100% for CT and NG, and 90% for TV for the reference laboratory group (which used non-GeneXpert systems). Concordance for the POCT group was also high (> 94%) for all analytes, but this cohort (which used GeneXpert systems) exhibited a high rate of unsuccessful TV tests. All but one of these unsuccessful tests was subcategorised as ‘invalid’.ConclusionsThe high level of concordance for QC and EQA testing confirm that the trained operators at the POC clinical sites were competent to conduct POC testing and that the training and quality systems implemented for the ProSPeRo study were effective. The quality materials used were satisfactory for CT and NG but exhibited poor performance for TV testing on the GeneXpert system. The WHO should continue to work with industry and EQA providers to provide improved materials that are reliable, stable and cost effective for quality management, as it seeks to rollout molecular-based STI POCT in non-laboratory-based settings.Trial registrationEthics approval to conduct the ProSPeRo study was granted by the WHO Ethics Review Committee.

External quality assessment to support the WHO ProSPeRo study for the evaluation of two dual HIV/syphilis point-of-care tests in seven countries

BackgroundSexually transmitted infections (STIs) such as syphilis and HIV remain to be a significant public health issue worldwide. Dual rapid point-of-care tests (POCTs) have shown promise for detecting antibodies to HIV and syphilis but have not been fully evaluated in the field. Our study supported the WHO ProSPeRo study on Sexually Transmitted Infection Point-of-Care Testing (STI POCT) by providing external quality assessment (EQA) for HIV and syphilis testing in reference laboratories and their associated clinical sites in seven countries.MethodsHIV/syphilis serum liquid and dried tube specimen (DTS) panels were prepared by CDC. Liquid panels were distributed to the reference laboratories for three rounds of testing using commercially and locally available laboratory-based serological tests. DTS panels were sent to the clinical testing sites for 8 rounds of POC testing using the Abbott SD BIOLINE HIV/Syphilis Duo test (hereafter referred to as SD BIOLINE) and the Chembio Dual Path Platform (DPP) HIV-Syphilis assay. EQA panels were tested at CDC using the Rapid Plasma Reagin (RPR) test and the Treponema pallidum Particle Agglutination assay (TP-PA) for syphilis antibodies. Genetic Systems HIV-1/HIV-2 Plus O EIA, Geenius HIV Supplemental Assay and the Oraquick Advance HIV test were used to detect HIV antibodies in the EQA panels. Results from the reference laboratories and POCT sites were compared to those obtained at the CDC and a percentage agreement was calculated.ResultsQualitative RPR and TP-PA performed at the reference laboratories demonstrated 95.4–100% agreement with CDC results while quantitative RPR and TP-PA tests demonstrated 87.7% and 89.2% agreement, respectively. A 93.8% concordance rate was observed for qualitative HIV testing in laboratories. EQA testing at clinical sites using dual tests showed 98.7% and 99.1% agreement for detection of HIV antibodies and eight out of 10 sites had > 95.8% agreement for syphilis testing. However, two clinical sites showed only 65.0–66.7% agreement for SD BIOLINE and 84.0–86.7% for DPP, respectively, for syphilis testing.ConclusionsOverall, laboratories demonstrated high EQA performance in this study. Both HIV/syphilis POCTs gave expected results in the clinic-based evaluations using DTS. However, testing errors were identified in a few testing sites suggesting the necessity for continuous training and monitoring the quality of POC testing.

Investigating the Current Harmonization Status of Tumor Markers Using Global External Quality Assessment Programs: A Feasibility Study.

The harmonization status of most tumor markers (TMs) is unknown. We report a feasibility study performed to determine whether external quality assessment (EQA) programs can be used to obtain insights into the current harmonization status of the tumor markers α-fetoprotein (AFP), prostate specific antigen (PSA), carcinoembryonic antigen (CEA), cancer antigen (CA)125, CA15-3 and CA19-9. EQA sample results provided by 6 EQA providers (INSTAND [Germany], Korean Association of External Quality Assessment Service [KEQAS, South Korea], National Center for Clinical Laboratories [NCCL, China], United Kingdom National External Quality Assessment Service [UK NEQAS, United Kingdom], Stichting Kwaliteitsbewaking Medische Laboratoriumdiagnostiek [SKML, the Netherlands], and the Royal College of Pathologists of Australasia Quality Assurance Programs [RCPAQAP, Australia]) between 2020 and 2021 were used. The consensus means, calculated from the measurement procedures present in all EQA programs (Abbott Alinity, Beckman Coulter DxI, Roche Cobas, and Siemens Atellica), was used as reference values. Per measurement procedure, the relative difference between consensus mean for each EQA sample and the mean of all patient-pool-based EQA samples were calculated and compared to minimum, desirable, and optimal allowable bias criteria based on biological variation. Between 19040 (CA15-3) and 25398 (PSA) individual results and 56 (PSA) to 76 (AFP) unique EQA samples were included in the final analysis. The mean differences with the consensus mean of patient-pool-based EQA samples for all measurement procedures were within the optimum bias criterion for AFP, the desirable bias for PSA, and the minimum bias criterion for CEA. However, CEA results <8 µg/L exceeded the minimum bias criterion. For CA125, CA15-3, and CA19-9, the harmonization status was outside the minimum bias criterion, with systematic differences identified. This study provides relevant information about the current harmonization status of 6 tumor markers. A pilot harmonization investigation for CEA, CA125, CA15-3, and CA19-9 would be desirable.

Remote support of an external quality assessment program in 10 laboratories in Bhutan, Uganda, and Malawi: Pathologists Overseas experience between 2009 and 2017.

This article describes Pathologists Overseas (PO) experience supporting external quality assessment (EQA) programs in 10 clinical laboratories across 3 countries between 2009 and 2017. Laboratories were enrolled in the condensed chemical pathology EQA program provided by the Royal College of Pathologists of Australasia Quality Assurance Program. Participants were given an initial 2- to 4-day in-person training, followed by 1 year of active feedback on performance via emails or phone calls by a PO volunteer. There were 2 performance metrics: percentage of reported results as a measure of compliance and percentage of acceptable reported results as a measure of accuracy. Laboratories demonstrated high compliance with result reporting, with medians of 69.9%, 71.7%, and 81.3% before, during, and after feedback, respectively. Concomitant medians for the percentage of acceptable reported results were 41.2%, 57.3%, and 53.5%, respectively. Six laboratories had low performance in terms of accuracy at baseline (<60%). Active feedback improved the percentage of acceptable reported results for these lower-performing laboratories. External quality assessment programs can be successfully adopted long term by laboratories in low-resource settings. Active feedback requires significant time and effort but could be especially beneficial for laboratories with poor baseline performance.

Ten years of an external quality program control in clinical microbiology: a statistical analysis of the results

AbstractExternal quality assessment data of clinical microbiology obtained over ten years by the Colombian company PROASECAL in laboratories of seven countries in Central and South America are analyzed. The objective is to describe the quality of clinical microbiology results of the participants in the study period (2010–2021). This analysis includes the results of genus and species identification and proper reporting of both Gram staining and susceptibility testing. Data from 195 laboratories, which processed 31 bacteria, were analyzed. In this study, 32 % of laboratories were classified as good because they successfully determined the genus and species, 36 % fair, 12 % poor, and 20 % critical, to which recommendations for improvement were sent as part of the reports. In the analysis conducted for concordance between Genus, Morphology, and Gram, the success rates obtained are between 83 % and 94 %. Regarding antibiograms, the performance observed in Gram-positive bacteria ranges from 57 to 98 %, while in Gram-negative bacteria, it is between 82 and 98 %. The descriptive tools to explain external quality assessment results in clinical microbiology are limited to the percentage of successes in each item to be reported. For the analysis of the population data set, in this article, we propose to use contingency tables (including estimates of sensitivity, specificity, and predictive values) and equality of proportions tests as techniques that facilitate the interpretation of the data. On the other hand, the statistical analysis described here can be used as an analysis methodology for similar studies.

Whole blood clotting time: Current practices among Thailand National External Quality Assessment Scheme for blood coagulation member laboratories.

The Thai National Guidelines for Hemostatic Laboratory Testing were established in 2018. The guidelines recommend that the 20-min whole blood clotting time (20WBCT) method be used to diagnose/monitor snake bites. The aim of this study was to survey members of the Thailand National External Quality Assessment Scheme (NEQAS) for Blood Coagulation to investigate the use of 20WBCT testing compared between the 2021 post-guideline and 2007 pre-guideline periods. In July 2021, questionnaires were sent from the Faculty of Medicine Siriraj Hospital, Mahidol University to 521 Thailand NEQAS for Blood Coagulation member laboratories to survey their WBCT practices. Current WBCT practices were compared with pre-guideline WBCT practices, and chi-square test (x2) was used to test for differences between groups. Ninety-seven (18.6%) of 521 surveys were returned. Seventy-one laboratories (73.2%) reported knowing about 20WBCT from the Thai national guidelines. The reported average frequency of overall WBCT testing in 2021 was 12.4 times/month. The proportion of laboratories that reported using the 20WBCT test increased from 2.0% in 2007 to 46.4% in 2021 (p < 0.001), and the indications for performing WBCT were virtually unchanged from 2007 to 2021. The proportion of laboratories that reported having problems with WBCT testing decreased from 32.7% in 2007 to 16.5% in 2021. Despite our findings that almost three-quarters of respondent laboratories reported knowing about 20WBCT testing from the WBCT guidelines, and that WBCT-specific problems decreased significantly from 2007 to 2021, more work and training is needed to improve WBCT guideline dissemination, understanding, and adherence in Thailand.

Virus sequencing performance during the SARS-CoV-2 pandemic: a retrospective analysis of data from multiple rounds of external quality assessment in Austria.

Introduction: A notable feature of the 2019 coronavirus disease (COVID-19) pandemic was the widespread use of whole genome sequencing (WGS) to monitor severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infections. Countries around the world relied on sequencing and other forms of variant detection to perform contact tracing and monitor changes in the virus genome, in the hopes that epidemic waves caused by variants would be detected and managed earlier. As sequencing was encouraged and rewarded by the government in Austria, but represented a new technicque for many laboratories, we designed an external quality assessment (EQA) scheme to monitor the accuracy of WGS and assist laboratories in validating their methods. Methods: We implemented SARS-CoV-2 WGS EQAs in Austria and report the results from 7 participants over 5 rounds from February 2021 until June 2023. The participants received sample material, sequenced genomes with routine methods, and provided the sequences as well as information about mutations and lineages. Participants were evaluated on the completeness and accuracy of the submitted sequence and the ability to analyze and interpret sequencing data. Results: The results indicate that performance was excellent with few exceptions, and these exceptions showed improvement over time. We extend our findings to infer that most publicly available sequences are accurate within ≤1 nucleotide, somewhat randomly distributed through the genome. Conclusion: WGS continues to be used for SARS-CoV-2 surveillance, and will likely be instrumental in future outbreak scenarios. We identified hurdles in building next-generation sequencing capacity in diagnostic laboratories. EQAs will help individual laboratories maintain high quality next-generation sequencing output, and strengthen variant monitoring and molecular epidemiology efforts.

Recommendations on the measurement and use of the alcohol consumption biomarker CDT. A position paper from the IFCC Working Group on CDT standardisation

BackgroundCarbohydrate deficient transferrin (CDT) is a biomarker for excessive alcohol consumption utilized in clinical and forensic medicine and workplace testing. Previously, many different analytical methods for CDT were used and the measurand varied considerably, making direct comparison of test results difficult. To end this confusion, the IFCC established a working group on CDT standardisation (WG-CDT) which completed its tasks in 2017. MethodsThis IFCC position paper by the WG-CDT summarizes state of the art information about the measurand and the analytical methods and gives concise recommendations for its utilization. ResultsThe results achieved by the CDT standardisation process led to accuracy improvements in national external quality assessment schemes over the years. A brief review of ROC based comparison studies with the traditional biomarkers (GGT, MCV, ALT and AST) discusses the bias resulting from inadequate study populations. In large groups of the general population the superior diagnostic performance of CDT is confirmed. ConclusionThe relationship between alcohol intake versus resulting CDT is discussed as well as the cutoff and measurement uncertainty. Concerning the application in practice, potential pitfalls are considered and recommendations handling both analytical and preanalytical caveats are given. Finally, some examples of serious misunderstandings in publications about CDT are addressed.

External quality assessment survey for SARS-CoV-2 nucleic acid amplification tests in clinical laboratories in Tokyo, 2021

IntroductionNucleic acid amplification tests (NAATs) play a pivotal role in clinical laboratories for diagnosing COVID-19. This study aimed to elucidate the accuracy of these tests. MethodsIn 2021, an external quality assessment of NAATs for SARS-CoV-2 was conducted in 47 laboratories in Tokyo, Japan. In open testing, where the laboratories knew that the samples were intended for the survey, a simulated nasopharyngeal swab suspension sample was used, featuring a positive sample A with a viral concentration of 50 copies/μL, positive sample B with 5 copies/μL, and a negative sample. Laboratories employing real-time RT-PCR were required to report cycle threshold (Ct) values. In blind testing, where the samples were processed as normal test samples, a positive sample C with 50 copies/μL was prepared using a simulated saliva sample. ResultsOf the 47 laboratories, 41 were engaged in open testing. For sample A, all 41 laboratories yielded positive results, whereas for sample B, 36 laboratories reported positive results, 3 laboratories reported “test decision pending”, 1 laboratory reported “suspected positive”, and 1 laboratory did not respond. All 41 laboratories correctly identified the negative samples as negative. The mean Ct values were 32.2 for sample A and 35.2 for sample B. In the blind test, six laboratories received samples. Sample C was identified as positive by five laboratories and negative by one laboratory. ConclusionsThe nature of the specimen, specifically the saliva, may have influenced the blind test outcomes. The identified issues must be meticulously investigated and rectified to ensure accurate results.

External quality assessment of non-small cell lung carcinoma panel testing – a pilot study

External quality assessment of non-small cell lung carcinoma panel testing – a pilot study

Longitudinal analysis of external quality assessment of immunoassay-based steroid hormone measurement indicates potential for improvement in standardization.

As hormonal disorders are linked to several diseases, the accurate quantitation of steroid hormone levels in serum is crucial in order to provide patients with a reliable diagnosis. Mass spectrometry-based methods are regarded as having the highest level of specificity and sensitivity. However, immunoassays are more commonly used in routine diagnostics to measure steroid levels as they are more cost effective and straightforward to conduct. This study analyzes the external quality assessment results for the measurement of testosterone, progesterone and 17β-estradiol in serum using immunoassays between early 2020 and May 2022. As reference measurement procedures are available for the three steroid hormones, the manufacturer-specific biases were normalized to the reference measurement values. The manufacturer-specific coefficients of variation were predominantly inconspicuous, below 20% for the three hormones when outliers are disregarded, however there were large differences between the various manufacturer collectives. For some collectives, the median bias to the respective reference measurement value was repeatedly greater than ±35%, which is the acceptance limit defined by the German Medical Association. In the case of testosterone and progesterone determination, some collectives tended to consistently over- or underestimate analyte concentrations compared to the reference measurement value, however, for 17β-estradiol determination, both positive and negative biases were observed. This insufficient level of accuracy suggests that cross-reactivity continues to be a fundamental challenge when antibody detection is used to quantify steroids with a high structural similarity. Distinct improvements in standardization are required to provide accurate analysis and thus, reliable clinical interpretations. The increased accuracy of the AX immunoassay for testosterone measurement, as observed in the INSTAND EQAs between 2020 and 2022, could be the result of a recalibration of the assay and raises hope for further improvement of standardization of immunoassay-based steroid hormone analyses in the coming years.

Re-testing as a method of implementing external quality assessment program for COVID-19 real time PCR testing in Uganda.

Significant milestones have been made in the development of COVID19 diagnostics Technologies. Government of the republic of Uganda and the line Ministry of Health mandated Uganda Virus Research Institute to ensure quality of COVID19 diagnostics. Re-testing was one of the methods initiated by the UVRI to implement External Quality assessment of COVID19 molecular diagnostics. participating laboratories were required by UVRI to submit their already tested and archived nasopharyngeal samples and corresponding meta data. These were then re-tested at UVRI using the WHO Berlin protocol, the UVRI results were compared to those of the primary testing laboratories in order to ascertain performance agreement for the qualitative & quantitative results obtained. Ms Excel window 12 and GraphPad prism ver 15 was used in the analysis. Bar graphs, pie charts and line graphs were used to compare performance agreement between the reference Laboratory and primary testing Laboratories. Eleven (11) Ministry of Health/Uganda Virus Research Institute COVID19 accredited laboratories participated in the re-testing of quality control samples. 5/11 (45%) of the primary testing laboratories had 100% performance agreement with that of the National Reference Laboratory for the final test result. Even where there was concordance in the final test outcome (negative or positive) between UVRI and primary testing laboratories, there were still differences in CT values. The differences in the Cycle Threshold (CT) values were insignificant except for Tenna & Pharma Laboratory and the UVRI(p = 0.0296). The difference in the CT values were not skewed to either the National reference Laboratory(UVRI) or the primary testing laboratory but varied from one laboratory to another. In the remaining 6/11 (55%) laboratories where there were discrepancies in the aggregate test results, only samples initially tested and reported as positive by the primary laboratories were tested and found to be false positives by the UVRI COVID19 National Reference Laboratory. False positives were detected from public, private not for profit and private testing laboratories in almost equal proportion. There is need for standardization of molecular testing platforms in Uganda. There is also urgent need to improve on the Laboratory quality management systems of the molecular testing laboratories in order to minimize such discrepancies.

High quality of SARS-CoV-2 molecular diagnostics in a diverse laboratory landscape through supported benchmark testing and External Quality Assessment.

A two-step strategy combining assisted benchmark testing (entry controls) and External Quality Assessments (EQAs) with blinded simulated clinical specimens to enhance and maintain the quality of nucleic acid amplification testing was developed. This strategy was successfully applied to 71 diagnostic laboratories in The Netherlands when upscaling the national diagnostic capacity during the SARS-CoV-2 pandemic. The availability of benchmark testing in combination with advice for improvement substantially enhanced the quality of the laboratory testing procedures for SARS-CoV-2 detection. The three subsequent EQA rounds demonstrated high quality testing with regard to specificity (99.6% correctly identified) and sensitivity (93.3% correctly identified). Even with the implementation of novel assays, changing workflows using diverse equipment and a high degree of assay heterogeneity, the overall high quality was maintained using this two-step strategy. We show that in contrast to the limited value of Cq value for absolute proxies of viral load, these Cq values can, in combination with metadata on strategies and techniques, provide valuable information for laboratories to improve their procedures. In conclusion, our two-step strategy (preparation phase followed by a series of EQAs) is a rapid and flexible system capable of scaling, improving, and maintaining high quality diagnostics even in a rapidly evolving (e.g. pandemic) situation.

OrangeStereo: A navel orange stereo matching network for 3D surface reconstruction

Three-dimensional (3D) surface reconstruction is crucial to accurately detecting navel orange external qualities such as size and shape, and binocular stereo vision is promising for practical sorting scenarios due to its high frame rates and ease of deployment. For objects with texture-less surface, such as navel oranges, it is very challenging to match the corresponding points using traditional stereo matching algorithms because the detected feature points have high similarity in color as well as structure. Most of the existing deep learning-based stereo matching algorithms focus on the stereo matching performance of the whole image and lack the attention to the matching performance of the main region. Meanwhile, simple background with less texture will bring more uncertainty to the matching of corresponding points, which affects the robustness of the model. The OrangeStereo was proposed based on the GwcNet structure to achieve a better corresponding points matching effect of navel oranges, which can provide more accurate 3D surface information. The Structural Features Extraction (SFE) module was introduced after the initial feature extraction module to extract stable structural features and avoid the limitations of using single convolutional features. The Attention Weights Generation (AWG) module was utilized at matching cost calculation stage to help suppress redundant information and make the network pay more attention to the matching performance of specific regions. The improved loss function assigned a greater weight to the loss of the navel orange region using semantic information from left image to make the network more focused on the matching effect of the navel orange region. An ablation study was conducted to confirm the efficiency of the SFE module, AWG module, and the improved loss function of the algorithm. The ablation study contained five sub-experiments, including the baseline model, adding the SFE and the AWG modules respectively, and whether to add the improved loss function based on the addition of previous two modules. Additionally, PSMNet, GwcNet, RealtimeStereo, and ACVNet, four typical stereo matching methods, were contrasted with the OrangeStereo. The proposed OrangeStereo achieved better performance with EPE, RMSE, bad-1, bad-3, bad-5, and inference time of 0.60 pixels, 3.53 pixels, 2.37 %, 1.83 %, 1.62 %, and 33 ms in the orange region, respectively. The R2 and RMSE for the depth of orange utilizing our method were 0.982 and 0.81 mm, respectively. The proposed algorithm can be employed to obtain accurate depth information of fruits quickly, and it is expected to be used in the 3D reconstruction of fruits in the actual commercial fruit sorting lines to achieve more accurate external quality assessment.