An Approach for Iteratively Generating Adequate Tests in Metamorphic Testing: A Case Study

Abstract

Metamorphic testing is an effective technique for testing "non-testable" programs. But the quality of metamorphic testing is highly depended on the selection of metamorphic relations and the test generation. This paper introduces an approach for iteratively developing metamorphic relations and producing adequate tests guided by testing and test evaluation results. The approach includes a framework for the development of metamorphic relations and tests, and a strategy for iteratively refining the relations and tests for generating adequate tests. The test adequacy evaluation is built on the evaluation of test coverage criteria, mutation testing, and testing of mutated metamorphic relations. The approach and its effectiveness are discussed through testing a Monte Carlo modeling program.