A comparison of sensitivity analysis and error analysis based on a stream ecosystem model

Abstract

When individual model parameters must be measured in field or laboratory experiments, the provision of feedback information for allocation of research efforts is an important function of modeling. Both sensitivity analysis and Monte Carlo error analysis can be used to determine which parameters require intensified measurement effort. When both methods are applied to a stream ecosystem model, the assumptions of sensitivity analysis are violated if reasonable estimates of measurement errors on parameters are used. Sensitivity analysis estimates a linear relationship between a state variable and a parameter and largely ignores higher order effects. In the model investigated in this study, higher-order effects dominate prediction error, and the results of sensitivity analysis are misleading. It is suggested that the simple correlation coefficient derived from analysis of Monte Carlo simulations is a more reasonable way to rank model parameters according to their contribution to prediction uncertainty. For the stream model used in this study, halving variance on the four parameters, indicated as most important by sensitivity analysis, reduces prediction errors by only 2–6%. Halving variance on the four, completely different, parameters with the largest simple correlation coefficients reduces prediction errors by 17–31%.