An open flame and smoke detection dataset for deep learning in remote sensing based fire detection

Abstract

ABSTRACT The early warning of fires is pivotal for preventing substantial economic losses and ecological damage. However, the enhancement of fire model generalization performance still faces challenges due to limitations in existing fire datasets, such as image quantity and heterogeneity. Taking the advantage of rapid advancements in remote sensing technology and artificial intelligence, we introduce the Flame And Smoke Detection Dataset (FASDD), a pioneering collection comprising over 120,000 heterogeneous images covering various fire scenarios, aiming to promote the evolution of fire detection models. FASDD serves as a challenging benchmark for object detection tasks and features three sub-datasets: FASDD_CV, FASDD_UAV, and FASDD_RS. These sub-datasets comprise cross-domain images from ground-based, airborne, and spaceborne sensors, respectively. Extensive experiments using advanced Swin Transformer models demonstrate satisfactory fire detection performance, with mAP scores of 84.9%, 89.7%, and 74.0% on the respective sub-datasets. Notably, the application case in wildfire localization highlights the proficiency of FASDD_RS models for monitoring and tracking forest fires. Trained on FASDD_RS, FASDD_UAV, and FASDD_CV, deep learning models can be individually deployed on edge devices including satellites, drones, and terrestrial sensors, thus empowering collaborative fire warning within the space-air-ground integrated observation network. Additionally, a standardized procedure for data preparation, data procedure, and quality assurance is established, providing off-the-shelf annotations with four common configurations to facilitate machine learning model training. FASDD stands as a pivotal benchmark, providing valuable resources for training and evaluating deep learning fire detection models, especially Large Vision Models (LVM). It holds the potential to accelerate research progress in urban firefighting or forest fire detection, providing vital security measures for early fire warning and emergency response tasks.