Evaluation of the Interlaboratory Concordance in Quantification of Human Immunodeficiency Virus-Specific T Cells with a Gamma Interferon Enzyme-Linked Immunospot Assay

Abstract

The gamma interferon (IFN-gamma) enzyme-linked immunospot (ELISPOT) assay is a reference method for the ex vivo monitoring of antigen-specific T cells and a primary tool for assessing clinical trials of human immunodeficiency virus (HIV) or cancer vaccines. Four experienced laboratories in Paris compared their results with this method by exchanging frozen blood samples from eight HIV-seronegative and eight HIV-seropositive subjects. Each laboratory measured the IFN-gamma-producing cells specific for HIV, Epstein-Barr virus, cytomegalovirus, and influenza using the same set of peptides and the same ELISPOT reader but its own ELISPOT technique. The cutoff values for positive responses (50 or 100 spot-forming cells/10(6) peripheral blood mononuclear cells over background) were consistent with the binomial statistic criterion. The global qualitative concordance, as assessed by the kappa index, ranged from 0.38 to 0.92, that is, moderate to excellent, and was better for non-HIV 9-mer peptide pools than for HIV 15-mer peptide pools. The interlaboratory coefficient of variation for the frequency of virus-specific T cells was 18.7% (data are expressed on a log scale). Clustering analysis of HIV-positive subjects showed qualitative agreement for ELISPOT results from all four laboratories. Overall, the good interlaboratory qualitative concordance of IFN-gamma ELISPOT assays with only the peptide source and ELISPOT reader in common suggests that a qualitative comparison of interlaboratory findings is feasible. Nonetheless, a single set of standard operating procedures should be used in multicenter trials to improve standardization.