Acceptance Sampling to Aid in Verification of Computational Simulation Models

Abstract

Advances in computing allow for the construction of increasingly large and complex models and simulations. Exhaustive error checking of these intricate, large computational simulation models is daunting and potentially impractical. This paper explores an approach to error checking simulation model components using an Acceptance Sampling methodology from the field of industrial manufacturing. We propose a systematic process in which a simulation inspector examines only a fraction of the computational model elements to give a measure of the errors present. Our proposed process contributes to established verification processes by sampling from the simulation components to identify whether the model is acceptably error-free or which components require correcting. The proposed verification methodology relies on a number of statistical constraints, but serves the interests of simulation professionals as part of the overall verification process. We illustrate the application and usefulness of our methodology through a case study of a citywide microscopic transportation model.