Test Performance Study Research Articles

Test performance study to evaluate diagnostic tests for the detection and identification of Xylophilus ampelinus in vine material spiked with cells from X. ampelinus cultures

A test performance study (TPS) was conducted in 2020 to evaluate performance of serological and PCR-based tests for the detection of Xylophilus ampelinus in homogenised vine samples. In total, 11 labs participated, although there were fewer participants for the serological tests than the PCR-based tests. The panel of samples sent to participants included spiked samples containing 104–108 cfu per ml (serological tests) or 102–106 cfu per ml (PCR-based tests) as well as positive and negative controls. The five PCR-based tests were found to be fit for purpose, with similar performance across a range of metrics (analytical sensitivity, diagnostic sensitivity and specificity, and repeatability and reproducibility assessed in terms of accordance and concordance, respectively). Serological methods (two immunofluorescence tests and two ELISA tests) were found to be less sensitive with regard to both analytical and diagnostic sensitivity. Furthermore, the occurrence of false positives suggests that a positive IF result may not be conclusive when considered in isolation. One of the ELISA tests exhibited much lower analytical and diagnostic sensitivity than the other serological tests and would not be considered suitable for the purpose considered by this TPS.

An Inter-Laboratory Comparative Study on the Influence of Reagents to Perform the Identification of the Xylella fastidiosa Subspecies Using Tetraplex Real Time PCR

In 2022, a test performance study (TPS) assessing the influence of different master mixes on the performance of the tetraplex real-time PCR (TqPCR) assay was organized. TqPCR allows for the specific detection and identification of Xylella fastidiosa (Xf) subspecies in a single reaction. Eighteen official laboratories of the Italian National Plant Protection Organization received a panel of 12 blind samples, controls, primers, probes, and different master mixes to participate in the TPS. Furthermore, the Research Centre for Plant Protection and Certification of the Council for Agricultural Research and Economics performed an intra-laboratory study (ITS) on spiked plant matrices to evaluate the analytical sensitivity of TqPCR employing the selected master mixes with the best performance. Naturally infected samples were analyzed for subspecies identification via TqPCR compared with the official multilocus-sequence-typing (MLST) method. The best results in this comparative study were obtained using Fast Universal PCR Master Mix (Applied Biosystems) and Brilliant multiplex QPCR Master Mix (Agilent), and they confirmed that the TqPCR test is reliable, offering the advantage of identifying this subspecies at the same time, thus saving time and resources. The TqPCR assay is suggested among the tests to be used by laboratories performing the official diagnosis of Xf to support the activities of official monitoring.

Inter-Laboratory Comparison of RT-PCR-Based Methods for the Detection of Tomato Brown Rugose Fruit Virus on Tomato

In 2020, a test performance study (TPS) for the specific detection of tomato brown rugose fruit virus (ToBRFV) was organized in the frame of the H2020 Valitest project. Since no validated tests were available, all the protocols reported in the literature were at first screened, performing preliminary studies in accordance with the EPPO standard PM 7/98 (4). Five molecular tests, two conventional RT-PCR and three real-time RT-PCR were found to be suitable and were included in the TPS. Thirty-four laboratories from 18 countries worldwide took part in TPS, receiving a panel of 22 blind samples. The panel consisted of sap belonging to symptomatic or asymptomatic leaves of Solanum lycopersicum and Capsicum annuum. The results returned by each laboratory were analyzed and diagnostic parameters were assessed for each test: reproducibility, repeatability, analytical sensitivity, diagnostic sensitivity and diagnostic specificity. All the evaluated tests resulted in being reliable in detecting ToBRFV and were included in an EPPO Standard PM 7/146—Diagnostics.

Test performance study for detection of Ralstonia solanacearum and Clavibacter sepedonicus in potato tubers with TaqMan PCR

A test performance study (TPS) was organized in 2018 with ten official testing laboratories to evaluate the performance of different real‐time PCR tests for the detection of Clavibacter sepedonicus and/or Ralstonia solanacearum in potato tubers. Participants were sent spiked potato extracts with low (0.8–1.2 × 104 cfu mL‐1), medium (1.6–2.4 × 105 cfu mL‐1) and high (1.6–2.4 × 107 cfu mL‐1) bacterial loads, DNA extracts thereof and heel‐end cores from symptomatic potato tubers. The four real‐time PCR tests in this TPS for detection of C. sepedonicus were considered fit for purpose as principal screening methods. Two real‐time PCRs in this TPS were considered fit for purpose as principal screening methods for detection of R. solanacearum. A third real‐time PCR missed 23% of the DNA samples from low‐level R. solanacearum spikes and is considered not fit for purpose as a principal screening method. Correct identification of spiked samples was lower when DNA extraction from the spiked samples was performed by the participating laboratories, highlighting the importance of appropriate DNA extraction protocols.

Performance of diagnostic tests for the detection and identification of Pseudomonas syringae pv. actinidiae (Psa) from woody samples

The aim of this study was to characterise the performance of new molecular methods for the detection and identification of Pseudomonas syringae pv. actinidiae (Psa) and to provide validation data in comparison to the assays mentioned in official diagnostic protocols and being currently used. Eleven molecular tests for the Psa detection were compared in an inter-laboratory comparison where each laboratory had to analyse the same panel of samples consisting of thirteen Psa-spiked kiwifruit wood extracts. Laboratories had to perform also isolation from the wood extracts. Data from this interlaboratory test performance study (TPS) was statistically analysed to assess the performance of each method. In order to provide complete validation data, both for detection and identification, this TPS was supplemented by a further study of identification from pure culture of phylogenetically closely related Pseudomonas spp., Psa, and bacterial strains associated with kiwifruit. The results of both these studies showed that simplex-PCRs gave good results, whereas duplex-PCR and real-time PCR were the most reliable tools for detection and identification of Psa. Nested and multiplex-PCR gave false-positive results. The use of the most reliable detection test is suggested for routine analyses, but when Psa-free status needs to be accurately assessed, it is recommended that at least two detection tests are used. This work provides a wide comparison of the available diagnostic methods, giving new information for a possible revision of the official diagnostic protocols (e.g. European and Mediterranean Plant Protection Organization (EPPO) protocol PM7/120 for the detection of Psa).

Euphresco Sendo: An international laboratory comparison study of molecular tests for Synchytrium endobioticum detection and identification

An international test performance study (TPS) was organised to generate validation data for three molecular Synchytrium endobioticum tests: van den Boogert et al. (European Journal of Plant Pathology 113, 47–57, 2005), and van Gent-Pelzer et al. (European Journal of Plant Pathology, 126, 129-133, 2010) for the detection of S. endobioticum, and the pathotype 1(D1) identification test described by Bonants et al. (European Journal of Plant Pathology, 143, 495-506, 2015). Two TPS rounds were organised focussing on different test matrices, i.e. round 1: warted potato tissue, and round 2: resting spore suspensions. When using the tests for detection and identification of S. endobioticum in warted potato tissue, no significant differences were observed for diagnostic sensitivity, diagnostic specificity, overall accuracy, analytical sensitivity and robustness. When using the tests for detection and identification of S. endobioticum in resting spore suspensions, the van den Boogert and van Gent-Pelzer tests significantly outperform the Bonants test for diagnostic sensitivity and diagnostic specificity. For overall accuracy and analytical sensitivity, the van Gent-Pelzer significantly outperforms the van den Boogert and Bonants tests and is regarded as the test of choice when identifying S. endobioticum from resting spores. Tests regarded fit for purpose for routine testing of wart material and resting spore suspensions are proposed for the update of EPPO standard PM7/28(1) Synchytrium endobioticum.

PM 7/28 (2) Synchytrium endobioticum

Specific scopeThis Standard describes a diagnostic protocol for Synchytrium endobioticum.This Standard should be used in conjunction with PM 7/76 Use of EPPO diagnostic protocols.Specific approval and amendmentApproved in 2003‐09. Revision approved in 2017‐06.

Detection and identification of Xanthomonas arboricola pv. pruni from symptomless plant material: results of an Italian test performance study

Xanthomonas arboricola pv. pruni, the causal agent of bacterial spot disease of stone fruits, is a regulated quarantine pathogen in the European Union, listed as an A2 pest by the European and Mediterranean Plant Protection Organization (EPPO). Because detection and identification of this pathogen is key for its management and to ensure the production of pest free propagation material, it should be based on reliable tests, in particular when dealing with symptomless material. The current EPPO diagnostic Standard (PM 7/64) does not provide specific molecular methods for detection of this pest. The present paper summarizes the results of a test‐performance study (TPS) to validate, at a national level, a detection procedure for this bacterium. A working group was established in order to evaluate the performance criteria for tests included in the current EPPO Standard, and for a conventional PCR. On the basis of the obtained performance criteria, a diagnostic procedure was elaborated and then applied to perform an inter‐laboratory comparison. Screening tests for the detection of the bacterium on symptomless plant material based on IF and/or PCR were proposed, in parallel with isolation on agar media. For identification two methods were suggested: a molecular test or IF. This paper reports on the results of the TPS and proposes a flow diagram for the detection and identification of X. arboricola pv. pruni.

DNA barcoding as an identification tool for selected EU‐regulated plant pests: an international collaborative test performance study among 14 laboratories

DNA barcoding protocols for selected EU‐regulated arthropods, bacteria, fungi, nematodes and phytoplasmas were developed within the Quarantine organisms Barcoding of Life (QBOL) project financed by 7th framework program of the European Union. DNA barcodes generated with the developed protocols were stored in the Q‐bank database. An test performance study (TPS) was set up involving 14 participating laboratories to validate the use of the developed protocols as a diagnostic tool and to identify possible difficulties in the use of the protocols and Q‐bank. This paper describes the steps that were used to set up the TPS, to validate the protocols and to identify difficulties. TPS data shows that the developed tests are very robust and produce highly reproducible results. Participants managed to define good consensus sequences which allowed them to correctly identify their samples using Q‐bank in 78% of all cases. Q‐bank outperformed NCBI and BOLD in terms of diagnostic sensitivity and diagnostic specificity for all organism groups. Using general qualifiers, performance criteria and feedback from TPS participants, difficulties in the set‐up of the TPS, the use of the protocols and databases, and the proficiency of participants were identified/evaluated and recommendations for future work were made. The developed DNA barcoding protocols and Q‐bank have proven to be useful tools in support of the identification of selected EU‐regulated plant pests and pathogens on the desired taxonomical level.