An Experiment to Measure the Value of Statistical Probability Forecasts for Airports

Abstract

Abstract The economic value of weather forecasts for airports for commercial aviation is investigated by introducing financial data into the decision-making process for fuel carriage by aircraft. Using specific operating costs for a given flight, an optimal decision probability threshold can be calculated that identifies whether that flight should carry extra fuel, in case of adverse weather conditions and subsequent diversion. Forecasts of these adverse conditions can then be applied to a critical threshold to make a real-time decision regarding the carriage of additional fuel. This study focuses on forecasts of low ceiling and/or reduced visibility and their corresponding impact on forecast value for flights arriving at three major airports in the United States. Eighteen daily flights by American Airlines were examined during a 14-month period, a total of approximately 7500 flights. Using operating cost data from this period, a critical decision threshold was derived for each daily flight. Two sets of forecasts, statistically derived probabilistic forecasts and National Weather Service terminal aerodrome forecasts (TAFs), were then applied to each flight’s fuel carriage decision-making process. The probabilistic forecasts, which utilize regional surface observations, were generated for the destination airport with a lead time appropriate to the airline’s flight planning time. If the forecast probability of adverse weather was greater than the critical decision threshold for a given flight, then additional fuel was deemed necessary for that flight. The categorical TAFs that corresponded timewise to the developed probabilistic forecasts were obtained for each location. For this study, a categorical “yes” forecast denotes the expectation that the visibility and/or cloud ceiling conditions are such that extra fuel is required, while a categorical “no” forecast does not require extra fuel. The analysis presented herein indicates that by using statistical, probabilistic forecasts rather than categorical forecasts, a significant saving is made in operating costs. This is probably because of a more optimal balance between false alarms and misses for each flight, rather than more “accurate” forecasts per se. This is the mechanism by which probabilistic forecasts create value, rather than increasing the number of hits and correct rejections and/or decreasing the number of false alarms and misses. For each of the flights investigated in this study, the total cost of using probabilistic forecasts was less than that of using TAFs. An average of $23,000 is saved per flight during this 14-month period. Projecting these figures over all American Airlines flights, a potential annual savings of approximately $50 million in operating costs would be realized by using probabilistic forecasts of adverse landing weather conditions instead of the traditional TAF.