This article reviews and summarizes methods for controlling false positives in animal carcinogenicity studies and promotes an alternative that incorporates historical control information via Bayesian methods. The Bayesian paradigm is used as a procedure generator; however, frequentist multisample, age-stratified exact trend tests are used in the ultimate analysis. Critical values for the exact tests are chosen to maximize total expected power, conditional on tumor totals, by using prior distributions. To control the risk of a false-positive finding for one or more tumor types, the sum of the individual critical levels is constrained to be less than a nominal familywise error rate, such as .05. The resulting tests give more power to tumor types with higher-than-expected tumor totals. We use historical control data from animal carcinogenicity studies obtained from a large pharmaceutical company to train and evaluate the tests. There is greatly enhanced power of the proposed method, with concurrent error rate control, because the targeting procedure gives higher power to affected sites, and the procedure tends to produce critical values that are as small as possible overall (implying higher power), subject to the overall risk level constraint. Randomly sampling from real historical animal populations, we compare operating characteristics of various methods proposed in the literature and requested by regulatory agencies. Commonly used methods can have greatly inflated false-positive rates, particularly with larger studies. In some cases, we find greater power for the proposed method, even compared to methods that do not control false positives.
Read full abstract