Discovering latent themes in aviation safety reports using text mining and network analytics

Abstract

Aviation accidents, referring to unexpected and undesirable events involving aircraft, often cause great damage to property and human life. Learning from historical accidents is pivotal for improving safety in aviation. However, aviation accidents are typically documented and stored as unstructured or semi-structured free-text, rendering the ability to analyze such data a difficult task. This study presents a novel framework that combines text mining and network analytics techniques and provides the ability to analyze aviation accident reports automatically. The framework comprises a four-step modelling approach to: (1) the transformation of unstructured aviation safety report texts into structured numeric matrices using the TF-IDF matrix; (2) the identification of aviation accident topics using a Structural Topic Model (STM); (3) the production of a Word Co-occurrence Network (WCN) to determine the interrelations between aviation safety risk factors; and (4) quantitative analysis by technology of keywords to pinpoint key causal factors in aviation safety events. The proposed framework is validated by analyzing aviation accident reports collected by the National Transportation Safety Board (NTSB). The results indicate that STM provides a more granular partitioning of topics and better distinguishes between similar events compared to traditional Latent Dirichlet Allocation (LDA). Among the identified topics, “Fuel and Power” and “En-route Phase” have the highest occurrence rate according to STM. Additionally, “Aircraft Crash” is the most prevalent topic in aviation accidents that resulted in fatal injuries, while “Landing phase” is the most prevalent topic in non-fatal injuries on accidents. Based on the word co-occurrence network, three centrality measures highlight “inspection of equipment” and “take off” as the most important risk factors in aviation safety. The proposed framework provides a comprehensive solution for in-depth analysis of aviation safety reports, offering decision support for aviation safety management and accident prevention, thereby reducing risks and strengthening safety measures.