A comparison of methods for identifying location effects in unreplicated fractional factorials in the presence of dispersion effects

Abstract

Most methods for identifying location effects in unreplicated fractional factorial designs assume homoscedasticity of the response values. However, dispersion effects in the underlying process may create heteroscedasticity in the response values. This heteroscedasticity may go undetected when identification of location effects is pursued. Indeed, methods for identifying dispersion effects typically require first modeling location effects. Therefore, it is imperative to understand how methods for identifying location effects function in the presence of undetected dispersion effects. We used simulation studies to examine the robustness of four different methods for identifying location effects—Box and Meyer (1986), Lenth (1989), Berk and Picard (1991), and Loughin and Noble (1997)—under models with one, two, or three dispersion effects of varying sizes. We found that the first three methods usually performed acceptably with respect to error rates and power, but the Loughin–Noble method lost control of the individual error rate when moderate-to-large dispersion effects were present.