An Investigation of Human Performance Model Validation

Abstract

Abstract : This report summarizes research to develop a methodology for calibration and validation of human performance models in support of simulation-based acquisition (SBA) processes - a human performance modeling validation program. A review was conducted of the various types of human performance models (HPMs) that have been developed and considered for SBA, focusing particularly on the category of cognitive models (CMs). The results of an informal review of the usage of HPMs and CMs in several major recent defense acquisition programs are described. Also, details the conceptual framework based on an investigation of the characteristics of a wide variety of performance modeling frameworks and application domains. Offered is the initial taxonomies of model actions and empirical performance actions that will support the necessary mappings between model predictions and empirical observations for all models over the full range of required representation detail, and across all stages of the acquisition process in order to establish a solid analytic basis for calibration and validation of SBA processes and human performance modeling frameworks. Also, described are the methods for specifying performance measures so that for any given design decision, performance measures captured using a model can be mapped to performance measures obtained during live test and evaluation.