Comparing tests judged asymptotically equally efficient

Abstract

For comparing two competing testing procedures whose power functions cannot be calculated exactly, the Pitman asymptotic relative efficiency is commonly used. This measure offers the advantages of simplicity in computation and interpretation, but is asymptotic in nature. In particular, it cannot distinguish between certain pairs of tests, namely, those with an asymptotic relative efficiency of 1. In this paper, we offer an alternative basis for making finite sample comparisons between tests judged asymptotically equally efficient. The criteria for comparison is based on the ratio of efficacies. Using this new criterion, we consider a series of examples in which two tests with an ARE of 1 are compared for finite n. In each case, either exact or simulated power curves are used to evaluate the effectiveness of this criterion in properly discriminating between the competing test procedures. Lastly, conditions are specified where the proposed criterion should be most effective.