Statistical Approaches for Establishing Appropriate Immunogenicity Assay Cut Points: Impact of Sample Distribution, Sample Size, and Outlier Removal

Abstract

The statistical assessments needed to establish anti-drug antibody (ADA) assay cut points (CPs) can be challenging for bioanalytical scientists. Poorly established CPs that are too high could potentially miss treatment emergent ADA or, when set too low, result in detection of responses that may have no clinical relevance. We evaluated 16 validation CP datasets generated with ADA assays at Regeneron’s bioanalytical laboratory and compared results obtained from different CP calculation tools. We systematically evaluated the impact of various factors on CP determination including biological and analytical variability, number of samples for capturing biological variability, outlier removal methods, and the use of parametric vs. non-parametric CP determination. In every study, biological factors were the major component of assay response variability, far outweighing the contribution from analytical variability. Non-parametric CP estimations resulted in screening positivity in drug-naïve samples closer to the targeted rate (5%) and were less impacted by skewness. Outlier removal using the boxplot method with an interquartile range (IQR) factor of 3.0 resulted in screening positivity close to the 5% targeted rate when applied to entire drug-naïve dataset. In silico analysis of CPs calculated using different sample sizes showed that using larger numbers of individuals resulted in CP estimates closer to the CP of the entire population, indicating a larger sample size (~ 150) for CP determination better represents the diversity of the study population. Finally, simpler CP calculations, such as the boxplot method performed in Excel, resulted in CPs similar to those determined using complex methods, such as random-effects ANOVA.Graphical