Building credibility for human systems integration in model‐based systems engineering

Abstract

AbstractRobust and trusted digital human representations are necessary to successfully account for human considerations in model‐based systems engineering (MBSE). Multiple domains and modeling frameworks leverage verification, validation, and accreditation (VV&A) processes to characterize when and under what conditions a model is valid to establish credibility. A literature review was completed on mathematical, physics‐based, software development, discrete event simulation, agent‐based, system dynamics, and MBSE models with the goal of proposing a process for performing VV&A on digital engineering (DE) and MBSE models for sociotechnical systems. However, this research also revealed the need for a broader framework to characterize the risk associated with using these models for making high‐consequence decisions. While accomplishing the literature review, another approach to building credibility was identified that is used heavily in the financial industry, namely model risk management (MRM). This process is extended by leveraging MRM approaches from within the financial community to propose a framework for sociotechnical model users to characterize the risk of using MBSE models to make programmatic decisions. The primary contribution of this work is to document a meta‐analysis of model VV&A while proposing an alternative approach to characterizing and communicating credibility that was discovered during this analysis. This approach could be a viable option for ensuring the credibility of human systems integration in MBSE models.