An augmented reality binocular system (ARBS) for air traffic controllers

Abstract

The primary means by which air traffic tower controllers obtain information is through direct out-thewindow viewing, although a considerable amount of time is spent looking at electronic displays and other information sources inside the tower cab. The Air Force Research Laboratory sponsored the development of a prototype Augmented Reality Binocular System (ARBS) that enhances tower controller performance, situation awareness, and safety. The ARBS is composed of a virtual binocular (VB) that displays real-time imagery from high resolution telephoto cameras and sensors mounted on pan/tilt units (PTUs). The selected PTU tracks to the movement of the VB, which has an inertial heading and elevation sensor. Relevant airfield situation text and graphic depictions that identify airfield features are overlaid on the imagery. In addition, the display is capable of labeling and tracking vehicles on which an Automatic Dependent Surveillance - Broadcast (ADS-B) system has been installed. The ARBS provides air traffic controllers and airfield security forces with the capability to orient toward, observe, and conduct continuous airfield operations and surveillance/security missions from any number of viewing aspects in limited visibility conditions. In this paper, we describe the ARBS in detail, discuss the results of a Usability Test of the prototype ARBS, and discuss ideas for follow-on efforts to develop the ARBS to a fieldable level.