Exact distribution of the F-statistic under heteroskedasticity of unknown form for improved inference

Abstract

In this paper, we derive the exact finite sample distribution of the F () statistic for a single linear restriction on the regression parameters. We show that the F statistic can be expressed as a ratio of quadratic forms, and therefore its exact cumulative distribution under the null hypothesis can be derived from the result of Imhof [Computing the distribution of quadratic forms in normal variables. Biometrika. 1961;48(3/4):419–426]. A numerical calculation is carried out for the exact distribution of the F statistic using various HC covariance matrix estimators, and the rejection probability under the null hypothesis (size) based on the exact distribution is examined. The results show the exact finite sample distribution is remarkably reliable, while, in comparison, the use of the F-table leads to a serious over-rejection when the sample is not large or leveraged/unbalanced.