Metrics and Analysis Methods for Evaluation of a Real-Time Automated Separation Assurance System

Abstract

*A system of metrics and analysis plots has been developed in order to evaluate the effectiveness and accuracy of trajectory prediction and automated conflict prediction and resolution algorithms. This research is conducted using a real-time air traffic management system to perform experimental runs using both live and simulated air traffic scenarios. The resulting data from these runs needs to be analyzed both to evaluate the performance of the software and to create objective metrics and plots for use in research studies. Specific analysis methods have been developed to assess data runs based on losses of legal separation between aircraft, conflict detections, trajectory prediction error, flight amendments, leveloffs, and fuel burn. I. Introduction ASA is developing tools and concepts to assist air traffic controllers in ensuring safe and efficient operations under increasing traffic demand. This work is divided into specialized tasks to focus on addressing specific air traffic management (ATM) needs. One such task is Separation Assurance (SA) research whose primary goals are to study automated algorithms for ensuring adequate separation between aircraft and to improve traffic flow through Air Route Traffic Control Center (ARTCC), or Center, airspace by using efficient, conflict-free flight paths. 1 In this research, the Center TRACON Automation System (CTAS) 2-4 is an important ATM tool with capabilities for automated conflict detection and resolution used as an experimental environment for comparing actual and simulated air traffic scenarios. The evaluation of the performance of this system under real-time traffic conditions is critical for proving the effectiveness of automated separation assurance algorithms