Application of the CLSI EP15-A3 Guideline as an Alternative Troubleshooting Tool for Verification of Assay Precision

Abstract

Abstract Introduction The CLSI EP15-A3 guideline “User Verification of Precision and Estimation of Bias” provides a simple experimental approach to estimate a method’s imprecision and bias. The objective is to determine if the laboratory precision performance of repeatability (SR) and within-laboratory imprecision (SWL) are in accordance to the manufacturer specification claims (MSCs). Objectives Evaluate the utility of the EP15-A3 protocol to verify method precision during a troubleshooting investigation and after major instrument maintenance, using a carcinoembryonic antigen (CEA) immunoassay as an example. Methods CEA was performed on the Beckman Coulter DxI (Beckman Coulter, Brea, CA). Quality control (QC) levels (L1: 2.89; L2: 21.10; L3: 39.10 ng/mL) (Bio-Rad Laboratories, Irvine, CA) were used. Each QC level was measured before and after instrument maintenance as follows: five replicates per run, one run per day, and during 5 days. Imprecision estimates (IEs) for SR (%CVR) and SWL (%CVWL) were calculated by one-way analysis of variance using Microsoft Excel Analyse-it software. Estimated imprecision was compared to MSC and desirable imprecision specifications based on biological variation (BV). Results A change in the analytical performance of CEA was detected by a decreased sigma-metric indicator. After a bias problem was ruled out, the observed %CVR for L1, L2, and L3 were 7.2%, 3.7%, and 4.8%, respectively. The %CVWL were 8.3%, 5.0%, and 5.5%, which exceeded the MSC of %CVWL~4.0% to 4.5%. After a laboratory investigation, major instrument maintenance was performed by the manufacturer. The %CVR and %CVWL estimates for L1, L2, and L3 after maintenance were 3.2%, 3.8%, 3.5% and 3.9%, 4.2%, 4.0%, respectively. After maintenance, the CEA performance was consistent with the MSC for each of the levels analyzed and within the BV impression goal of %CV ≤6.4. Conclusion CLSI EP15-A3 guideline is an alternative troubleshooting tool that can be used to investigate and verify method precision performance before and after significant instrument maintenance.