An Empirical Assessment of Coaching and Practice Effects on Three Army Tests of Spatial Aptitude.

Abstract

Abstract : Three Army tests of spatial aptitude; Assembling Objects, Figural Reasoning, and Orientation were included in the Enhanced Computer Administered Testing (ECAT) project. ECAT was a joint service effort to evaluate measures for possible addition to future versions of the Armed Services Vocational Aptitude Battery (ASVAB). Because both practice and coaching effects might threaten the long-term validity of these tests, U.S. Army Research Institute for the Behavioral and Social Sciences researchers assessed their susceptibility to such effects. Overall, we found coaching and practice effects that are comparable to those obtained in previous research using spatial tests. The Orientation test was the only measure for which specific coaching led to significantly larger effect sizes than did practice alone. These results have ramifications for future research and development, such as exploring ways to: lower the susceptibility of the Orientation test to coaching, and reduce practice effects on the Assembling Objects and Figural Reasoning tests. We hope these activities help to ensure the long term validity of these Army tests.