Cognitive Task Analysis for the Real(-time) World

Abstract

As part of a review and evaluation of the Federal Aviation Administration's air traffic control (ATC) training program, we tested whether cognitive task analysis techniques could help identify the knowledge, skills, and strategies used by proficient controllers, at a level appropriate for deriving instructional objectives. Our approach involved modifying commonly-used methods (e.g., interviews and think-aloud protocols) for use in a real-time, real-world task domain. Expert controllers were videotaped performing realistic ATC scenarios. We then elicited “play-by-play” analysis of the scenario from other expert controllers and retrospective protocols from the subjects. Other techniques were used to obtain convergent data on controllers' knowledge representation and organization. The methodology was successful in describing several cognitive components of ATC expertise that had previously defied explication at a level of detail appropriate for instruction. We discuss briefly training implications and other ways in which we have used the data.