Performance Measurement in Distributed Environments: Initial Results and Implications for Training

Abstract

Advances in telecommunications and simulation technologies have created opportunities for conducting distributed team training through networked simulations. In distributed team training, in which simulators may be geographically dispersed, military teams train together in the same battlespace despite the physical separation. In these types of training environments, multiple users are located at multiple sites; consequently, the efficient and effective conduct of training is a challenge. One area that is particularly challenging is the measurement of team performance. Two case studies are reported in which team performance measurement instruments were developed and tested in a distributed training environment. The measurement tools were designed within the context of an instructional approach known as event-based training, which relies on the creation of explicit linkages among learning objectives, exercise events, performance measures, and after-action review or feedback. Active duty, reserve, and National Guard personnel from the Marine Corps, Air Force, and Army participated in several days of training exercises conducted within a network of simulators that were geographically distributed across the United States. The development and use of the measurement instruments are described, data from both case studies are presented, and implications for training are discussed.