A Cognitive Systems Engineering Application for Interface Design

Abstract

Cognitive Systems Engineering (CSE) is primarily a blend of technological opportunities, findings from cognitive research, and Cognitive Task Analysis. Using CSE, we were able to produce an efficient and effective redesign of the AWACS Weapons Director (WD) station. The design effort was completed in a relatively short period of time. A Cognitive Task Analysis was performed using two interview techniques: Concept Mapping and the Critical Decision method (CDM). The information obtained using these methods pinpointed specific cognitive areas which any redesign of the WD interface must address. A revised interface was developed and evaluated. During the evaluation, the training of the participants on the revised interface was quite brief (4.5 hours). As a result, the WDs did not achieve the same degree of familiarity or automatization with the revised interface that they have with the current interface. Yet, when WDs were using the revised system their performance improved. This was indicated by an increase in performance for a number of process and outcome measures. Also, a skilled WD provided blind ratings of WD performance. These global ratings were significantly higher for the revised interface. The effectiveness of the revised interface suggests that it is possible to pinpoint cognitive task requirements and to make these the driving factors in a design effort. Moreover, these Cognitive Systems Engineering activities do not consume a great deal of time or effort. The use of CSE may be a feasible aspect of the design process, enabling system developers to achieve a much stronger effectiveness at relatively low cost.