Automated top-down heuristic assembly of a classification multistage test

Abstract

This paper discusses automated top-down heuristic assembly of multistage testing (MST). MST has gained increasing popularity in recent years. Automated test assembly (ATA) is one of the most important components for developing MST tests. In this study, we developed a top-down, heuristic design to assemble a classification MST test. Heuristic ATA methods have great application potential due to simplicity and feasibility. Top-down assembly is also a useful strategy for assembling short MST tests or migrating existing linear tests to MST. The full detail of the proposed assembly method is given in this paper. A simulation study was conducted to evaluate the assembly results under conditions crossed by the following five factors: 1) information target source; 2) assembly order among stages; 3) level of item overlap control; 4) number of stages; 5) stage length assignment. This paper could be used to guide practitioners and researchers on implementing this method in practice.