Validation and Calibration of Human Performance Models to Support Simulation-Based Acquisition

Abstract

We present a methodology under development for calibration and validation of human performance models in support of simulation-based acquisition processes --- a human performance modeling validation program. We describe a conceptual framework based on an investigation of the characteristics of a wide variety of performance modeling frameworks and application domains. We offer initial taxonomies of model actions and empirical performance actions that will support the necessary mappings between model predictions and empirical observations for all models over the full range of required representation detail, and across all stages of the acquisition process in order to establish a solid analytic basis for calibration and validation of SBA processes and human performance modeling frameworks. We describe methods for specifying performance measures so that for any given design decision, performance measures captured using a model can be mapped to performance measures obtained during live test and evaluation.