The Agent-Based Simulation (ABS) Verification, validation and Accreditation (VV&A) Study Phase 2 - Joint/DoD

Abstract

Abstract : This is the final report for the Agent Based Simulation (ABS) Verification, Validation, and Accreditation (VV&A) Framework Study Phase II. It reports on the tasks associated with this ABS VV&A (ABSVal) Framework Study project with an emphasis on insights gained in the application of the general ABSVal Framework developed in support of analysis applications. The project consisted of four main tasks: Task 1 Create Measures of Validity Task 2 VV&A Process Application Task 3 Test Case Workshops Task 4 Publishable Documentation and Reports The bulk of the effort was placed on Task 2. The development of measures of validity proceeded as part of the testing of the ABSVal Framework in specific application domains. The results of the overall effort were presented to the community at large through workshops and publications presented at various conference venues. Most of the material from this project resides at http://orsagouge.pbwiki.com/ABSVal. The key insight gained by this project was that the validation of models in support of analysis resides within the analysis process itself. That is, validation cannot be decoupled from the analysis plan, process, and results. Validation in this intended use identifies the limitations and boundaries of the analysis itself, lending clarity to that process for the recipients of the simulation and analytical results. This project resulted in sample validation reports that were independently critiqued, publications to the larger modeling and simulation community, and guidance for what ought to be included in a validation effort in support of analysis applications.