The Application of Computer Aided Evaluative Techniques to System Test and Evaluation

Abstract

Determining the operational suitability of a complex system requires a substantial testing program and, consequently, yields large amounts of data. The different pieces of information, however, have different relative importances in terms of implications for required decisions. In addition, this data must be organized in a manner that accomplishes certain functions. A function of paramount importance is to monitor various aspects of system performance to determine how good the system is with respect to all factors relevant to operational acceptability. These questions about system performance necessary for effective decision making are not answered or summarized by single pieces of the available data. Yet, somehow the data must be organized to facilitate decision making and make meaningful statements about such factors. This paper reports on the feasibility of the application of computer aided evaluative techniques in combining precise pieces of test information into summary measures at differing levels of generality to facilitate decisions about system operability and acceptability.