Bias in exponential and power function fits due to noise: comment on Myung, Kim, and Pitt.

Abstract

Myung, Kim, and Pitt (2000) demonstrated that simple power functions almost always provide a better fit to purely random data than do simple exponential functions. This result has important implications, because it suggests that high noise levels, which are common in psychological experiments, may cause a bias favoring power functions. We replicate their result and extend it by showing strong bias for more realistic sample sizes. We also show that biases occur for data that contain both random and systematic components, as may be expected in real data. We then demonstrate that these biases disappear for two- or three-parameter functions that include linear parameters (in at least one parameterization). Our results suggest that one should exercise caution when proposing simple power and exponential functions as models of learning. More generally, our results suggest that linear parameters should be estimated rather than fixed when one is comparing the fit of nonlinear models to noisy data.