Asymptotical Tests on the Equivalence, Substantial Difference and Non‐inferiority Problems with Two Proportions

Abstract

AbstractLet d = p2 − p1 be the difference between two binomial proportions obtained from two independent trials. For parameter d, three pairs of hypothesis may be of interest: H1: d ≤ δ vs. K1: d > δ; H2: d ∉ (δ1, δ2) vs. K2: d ∈ (δ1, δ2); and H3: d ∈ [δ1, δ2] vs. K3: d ∉ [δ1, δ2], where Hi is the null hypothesis and Ki is the alternative hypothesis. These tests are useful in clinical trials, pharmacological and vaccine studies and in statistics generally. The three problems may be investigated by exact unconditional tests when the sample sizes are moderate. Otherwise, one should use approximate (or asymptotical) tests generally based on a Z‐statistics like those suggested in the paper. The article defines a new procedure for testing H2 or H3, demonstrates that this is more powerful than tests based on confidence intervals (the classic TOST – two one sided tests – test), defines two corrections for continuity which reduce the liberality of the three tests, and selects the one that behaves better. The programs for executing the unconditional exact and asymptotic tests described in the paper can be loaded at http://www.ugr.es/~bioest/software.htm. (© 2004 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)