Real-time dynamic 3D view for tactical weather avoidance using head tracking

Abstract

Today, some of the more advanced flight decks are equipped with both a lateral and vertical presentation of weather products (e.g. ownship RADAR) on a multi-function display (MFD). The lateral view is overlaid on a map display, whereas the vertical view is on a separate vertical situation display (VSD). This requires the pilots to integrate the two views in order to build a good mental picture of the weather situation along the flight path. The goal of this study is to evaluate the feasibility and utility of a real-time tactical weather avoidance concept that would provide decision-making support to flight crews by the application of head tracking technology. Specifically, the intended function of the system is to support flight crews in making tactical weather avoidance decisions by using a three dimensional (3D) real-time, dynamic weather view integrated into a synthetic vision (SV) primary flight display (PFD) controlled by head tracking technology. This would allow flight crews to “look around” into, above, and below a weather system along the flight path in a real-time, dynamic 3D presentation. The use of head tracking technology would eliminate the need for a designated control of this added functionality because the head movements will be automatically translated into a real-time, dynamic view of the area of interest (e.g. a system of thunderstorms). The results of the proof of concept evaluation supported the notion that providing the capability to look around and accurately assess the position of objects/events (e.g., weather phenomena, obstacles, traffic) along the flight path within a synthetic vision display has the potential to optimize the pilot decision-making process during elevated workload situations (such as flight adverse weather avoidance).