Setting up an external quality assessment scheme to assess the effectiveness of microbiology testing currently carried out in heart valve banking

BackgroundThe World Health Organization (WHO) recommends parasite-based diagnosis of malaria before treatment. The use of nucleic-acid amplification (NAAT) for detection of Plasmodium spp. has expanded rapidly in recent years, for epidemiological research globally and clinical care in high-resource settings. Data from NAATs are frequently used to inform policy decisions, so quality control is essential to ensure results are reliable and comparable. Therefore, robust quality control, including an external quality assessment (EQA) scheme targeting malaria NAATs, is essential. The WHO Global Malaria Programme and the UK National External Quality Assessment Service (UK NEQAS) have collaborated since 2017 to implement a global malaria NAAT EQA scheme.MethodsPanels of specimens containing five major species of human-infecting Plasmodium at various parasite concentrations and negative samples were created in lyophilized blood (LB) and dried blood spot (DBS) formats. Two distributions per year were sent, containing five LB and five DBS specimens. Samples were validated by expert referee laboratories prior to distribution. Between 37 and 51 laboratories participated in each distribution and submitted results online. Participants were scored based on their laboratory's stated capacity to identify Plasmodium species, and individual laboratory reports were sent which included performance comparison with anonymized peers. Change in performance over time was calculated using a generalized mixed model with a logit link function.ResultsParticipating laboratories were located in 42 countries. Sample format (DBS or LB) and parasite density were found to significantly affect performance, while referee labs performed better at identifying P. falciparum samples than non-referee labs. Performance of laboratories improved significantly over time, especially for lower density and P. falciparum samples.ConclusionsResults from the first eleven distributions indicate that the EQA scheme has facilitated improved performance of laboratories over time, highlighting the value of implementing such programmes. EQA schemes are critical to safeguarding the reliability of data and diagnoses, especially in situations where NAAT methodologies and protocols are used. In future, funders should make participation in an EQA scheme a requirement for laboratories, and countries can take initiatives to embed such schemes into their own national assessment programmes.

The performance of many laboratories can be evaluated by participation in external quality assessment (EQA) schemes. EQA allows for comparison of a laboratory's performance with a source outside the laboratory-either a peer group of laboratories or a reference laboratory. Such EQA schemes do not exist in tissue banking despite the fact that tissue establishments (TE) perform very complex procedures. This paper describes the first ever EQA scheme in the field specifically assessing microbiological aspects in heart valve (HV) banking. Twenty-two TEs participated. Three HV tissue samples were sent to each participating TE-two contaminated with non-pathogenic micro-organisms and a third negative control. The aims were to isolate and identify the micro-organisms present and then to successfully decontaminate the HV tissue using the routine standard operating procedures of the TE. Eight of the TEs were able to isolate and identify all contaminating micro-organisms present, and of these, five also successfully decontaminated the tissue; 13 TEs failed to establish the identity of one or more of the contaminants; five TEs appear to have introduced contamination during the processing or testing of the tissue; and eight failed to successfully decontaminate the HV tissue. This initiative provides TEs with an international benchmark for tissue product microbiology testing. It has identified significant variation in practice and in the ability of different TEs to identify the presence of contamination. There is now work ongoing with the aim of setting up a regular EQA scheme for HV banking.

BackgroundThe World Health Organization (WHO) recommends parasite-based diagnosis of malaria. In recent years, there has been surge in the use of various kinds of nucleic-acid amplification based tests (NAATs) for detection and identification of Plasmodium spp. to support clinical care in high-resource settings and clinical and epidemiological research worldwide. However, these tests are not without challenges, including lack (or limited use) of standards and lack of reproducibility, due in part to variation in protocols amongst laboratories. Therefore, there is a need for rigorous quality control, including a robust external quality assessment (EQA) scheme targeted towards malaria NAATs. To this effect, the WHO Global Malaria Programme worked with the UK National External Quality Assessment Scheme (UK NEQAS) Parasitology and with technical experts to launch a global NAAT EQA scheme in January 2017.MethodsPanels of NAAT EQA specimens containing five major species of human-infecting Plasmodium at various parasite concentrations and negative samples were created in lyophilized blood (LB) and dried blood spot (DBS) formats. Two distributions per year were sent, containing five LB and five DBS specimens. Samples were tested and validated by six expert referee laboratories prior to distribution. Between 37 and 45 laboratories participated in each distribution and submitted results using the online submission portal of UK NEQAS. Participants were scored based on their laboratory’s stated capacity to identify Plasmodium species, and individual laboratory reports were sent which included performance comparison with anonymized peers.ResultsAnalysis of the first three distributions revealed that the factors that most significantly affected performance were sample format (DBS vs LB), species and parasite density, while laboratory location and the reported methodology used (type of nucleic acid extraction, amplification, or DNA vs RNA target) did not significantly affect performance. Referee laboratories performed better than non-referee laboratories.ConclusionsGlobally, malaria NAAT assays now inform a range of clinical, epidemiological and research investigations. EQA schemes offer a way for laboratories to assess and improve their performance, which is critical to safeguarding the reliability of data and diagnoses especially in situations where various NAAT methodologies and protocols are in use.

Simple SummaryPatients and clinicians often rely on the outcome of laboratory tests, but can we really trust these test results? Good quality management is key for laboratories to guarantee reliable test results. This review focusses on external quality assessment (EQA) schemes which are a tool for laboratories to examine and improve the quality of their testing routines. In this review, an overview of the role and importance of EQA schemes for clinical laboratories is given, and different types of EQA schemes and EQA providers available on the market are discussed, as well as recent developments in the EQA landscape.External quality assessment (EQA) schemes are a tool for clinical laboratories to evaluate and manage the quality of laboratory practice with the support of an independent party (i.e., an EQA provider). Depending on the context, there are different types of EQA schemes available, as well as various EQA providers, each with its own field of expertise. In this review, an overview of the general requirements for EQA schemes and EQA providers based on international guidelines is provided. The clinical and scientific value of these kinds of schemes for clinical laboratories, clinicians and patients are highlighted, in addition to the support EQA can provide to other types of laboratories, e.g., laboratories affiliated to biotech companies. Finally, recent developments and challenges in laboratory medicine and quality management, for example, the introduction of artificial intelligence in the laboratory and the shift to a more individual-approach instead of a laboratory-focused approach, are discussed. EQA schemes should represent current laboratory practice as much as possible, which poses the need for EQA providers to introduce latest laboratory innovations in their schemes and to apply up-to-date guidelines. By incorporating these state-of-the-art techniques, EQA aims to contribute to continuous learning.

S04 - External Quality Assessment Schemes in the management of solid tumors: the Italian perspective

External quality assessment of hormone determinations

AimsIn addition to providing external quality assessment (EQA) schemes, United Kingdom National External Quality Assessment service (UK NEQAS) for Molecular Genetics also supports the education of laboratories. As an enhancement...

Different methods for ceruloplasmin tend to give different results in external quality assessment schemes. During the production of the certified reference material ERM-DA470k/IFCC discrepant measurement results were also found for ceruloplasmin measured with different methods, and consequently the protein could not be certified in the material. We performed a commutability study with 30 serum samples and the reference materials ERM-DA470, ERM-DA470k/IFCC, and ERM-DA472/IFCC, using 6 different methods. Data were analyzed according to the CLSI Guideline C53-A to assess whether the reference materials had the same behavior as the serum samples with respect to measurement results obtained with combinations of the methods used. Measurement results from different methods showed a good linear correlation for the serum samples. ERM-DA470 showed marked noncommutability for certain combinations of methods. ERM-DA470k/IFCC and ERM-DA472/IFCC were commutable for more combinations of methods. The lack of commutability of ERM-DA470 for certain combinations of methods correlates with results from the UK National External Quality Assessment Service showing discrepancies between results from these methods. For serum stored in the presence of sodium azide the results from different methods are essentially equivalent. Ceruloplasmin in ERM-DA470 is a fully documented example of a situation in which, due to lack of commutability, the use of a common material for calibration did not lead to harmonization .

A novel approach to external quality assessment (EQA) using the Internet mimics the diagnostic situation so that multiple tests can be requested and EQA cases can be 'tailor made' to address a specific chromosome syndrome, disease, or clinical dilemma. The web-based EQA system was trialled on a large UK EQA scheme, UK NEQAS for Clinical Cytogenetics. It has also been used to implement a new Cytogenetics European Quality Assessment scheme, CEQA, set up with the intention of providing laboratories in countries without access to a local EQA scheme the opportunity of participation in EQA. Overall, Internet-based EQA allows for a varied EQA programme. Poor performance was detected in both CEQA and UK NEQAS constitutional EQA schemes and also in the UK NEQAS oncology EQA scheme. The Internet-based EQA overcomes submission delays due to international surface mail. There is also a reduction in administration and assessors' time compared to a retrospective EQA involving the submission of unique cases for EQA assessment, as participants analyse the same three Internet-based EQA cases simultaneously. Many EU27 (EU member states) laboratories still do not participate in their national EQA schemes, so until EQA participation becomes mandatory as a component of compulsory laboratory accreditation, the quality of laboratory diagnostic service is unpredictable.

Methodological and statistical issues in developing an External Quality Assessment scheme in laboratory medicine: Focus on biomarker research

For diagnosing SARS-CoV-2 infection and for monitoring its spread, the implementation of external quality assessment (EQA) schemes is mandatory to assess and ensure a standard quality according to national and international guidelines. Here, we present the results of the 2020, 2021, 2022 EQA schemes in Lombardy region for assessing the quality of the diagnostic laboratories involved in SARS-CoV-2 diagnosis. In the framework of the Quality Assurance Programs (QAPs), the routinely EQA schemes are managed by the regional reference centre for diagnostic laboratories quality (RRC-EQA) of the Lombardy region and are carried out by all the diagnostic laboratories. Three EQA programs were organized: (1) EQA of SARS-CoV-2 nucleic acid detection; (2) EQA of anti-SARS-CoV-2-antibody testing; (3) EQA of SARS-CoV-2 direct antigens detection. The percentage of concordance of 1938 molecular tests carried out within the SARS-CoV-2 nucleic acid detection EQA was 97.7%. The overall concordance of 1875 tests carried out within the anti-SARS-CoV-2 antibody EQA was 93.9% (79.6% for IgM). The overall concordance of 1495 tests carried out within the SARS-CoV-2 direct antigens detection EQA was 85% and it was negatively impacted by the results obtained by the analysis of weak positive samples. In conclusion, the EQA schemes for assessing the accuracy of SARS-CoV-2 diagnosis in the Lombardy region highlighted a suitable reproducibility and reliability of diagnostic assays, despite the heterogeneous landscape of SARS-CoV-2 tests and methods. Laboratory testing based on the detection of viral RNA in respiratory samples can be considered the gold standard for SARS-CoV-2 diagnosis.

Background: Robust preanalytical and analytical processes are critical for the detection of cryoproteins. There is significant variation in practice in the detection, analysis and reporting. Results: A survey in 2018 of 137 laboratories participating in the UK National External Quality Assessment Service (UK NEQAS) (6) quality control program showed significant variation in the laboratory processes which highlighted the need for standardisation of the detection, analysis and reporting of cryoglobulins.Conclusion: The first available EQA scheme aiming to harmonise practice for cryoprotein testing has been developed by UK NEQAS and laboratories should participate in an appropriate EQA scheme to fulfil requirements for ISO accreditation.

External Quality Assessment (EQA) programs play a crucial role in monitoring laboratory performance, identifying inconsistencies, and promoting the adoption of best practices in autoimmune diagnostics. Over the past decade, this field has undergone substantial evolution, driven by technological advances, enhanced standardisation, and increasing efforts toward harmonisation. This review examines findings from two recent studies assessing the decade-long evolution of autoimmune testing through data from the UK National External Quality Assessment Service (UK NEQAS) programmes. The results highlight considerable progress in the adoption of novel immunoassay technologies and improvements in test standardisation. However, challenges persist, particularly in achieving full harmonisation across laboratories and methodologies.

An external quality assessment (EQA) scheme for pneumococcal serotype identification has been performed over a period of 11 years, by a network of European pneumococcal reference laboratories. We report the results from the EQA, and present an assessment of the acceptability and utility of the EQA scheme. Reports from 22 EQA panels distributed in 2005–2016 were analysed. Each EQA panel consisted of seven isolates. A questionnaire including seven questions related to the acceptability and utility of the EQA scheme was distributed to all participating laboratories. Altogether, 154 pneumococcal isolates were tested. Of the 92 serologically distinct serotypes currently defined, 49 serotypes were included in the rounds. Discrepant results were observed in eight EQA rounds, involving 11 isolates (7.1%, 95% CI: 4% to 12%). All participating laboratories reported that the EQA scheme was useful for quality assurance purposes. Our results show that comparable serotyping data can be obtained in different laboratories. The EQA participation helps to keep the typing procedures at a high standard and provides data for accreditation purposes. The EQA is helpful when new technologies are introduced, and reveal limitations of both genotypic and phenotypic methods. Continuation of the presented EQA scheme is planned.

Molecular genetic techniques have entered many areas of clinical practice. Public expectations from this technology are understandably high. To maintain confidence in this technology, laboratories must implement the highest standards of quality assurance (QA). External quality assessment (EQA) is recognized as an essential component of QA. The United Kingdom National External Quality Assessment Service (UKNEQAS) for Molecular Genetics, first set up in 1991, is currently the longest provider of EQA to molecular genetic testing laboratories in the UK, The Netherlands, and Ireland. Errors in the scheme are sporadic events. However, evidence from this and other EQA schemes suggests that a residual error rate persists, which should be taken into account in clinical practice. This EQA scheme has evolved from the respective scientific bodies of the constituent countries and retains a strong emphasis on collective peer review. It is essential that the steps taken to ensure quality in this rapidly expanding field are clear and transparent to participants and public alike. We describe the procedures developed and the governance imposed to monitor and improve analytical and reporting standards in participant laboratories and we compare our experiences with those of equivalent EQA services in the United States.