Classification Utility of Test Composites from the ASVAB, CAT-ASVAB, and ECAT Batteries.

Abstract

Abstract : The present study compares the classification efficiency of eight unique alternative combinations of individual tests from the Armed Services Vocational Aptitude Battery (ASVAB), Enhanced Computer Administered Tests battery (ECAT), and Computerized Adaptive Testing version of the ASVAB (CAT-ASVAB). These candidate batteries differ in terms of abilities measured, mode of administration, and test time. In addition to examining classification efficiency, this study also evaluates the utility of each battery. As expected, the eight candidate batteries differed significantly in terms of classification efficiency. Differences among the batteries accounted for about 50% of the total variation in efficiency. This translates into a 23% improvement in predicted performance from the least to the most effective of the eight batteries. In terms of relative contribution, it appears that the greatest improvement results from increasing the abilities measured, followed by mode of administration, with test time contributing the least. Comparing paper-and-pencil with computerized batteries produced utilities (in net present value terms) that ranged from $6.8 to $11.6 billion. These were the four largest utilities in the study. Among the other two comparisons, one compared two paper-and-pencil tests and the other compared two computerized tests. The utilities for these amounted to $2.3 billion and $3.2 billion, respectively.