Self-Attention Guidance and Multiscale Feature Fusion-Based UAV Image Object Detection

Abstract

Object detection on UAV images is a recent research hotspot. Existing object detection methods have achieved good results on general scenes, but there are inherent challenges with UAV images. The detection accuracy of UAV images is limited by complex backgrounds, significant scale differences, and densely arranged small objects. To solve these problems, we propose a UAV image object detection network based on Self-attention Guidance and Multi-scale Feature fusion (SGMFNet). Firstly, we design a Global-Local Feature Guidance module (GLFG). This module can effectively combine local information and global information, which makes the model focus on the object area and reduces the impact of complex background. Secondly, an improved Parallel Sampling Feature Fusion module (PSFF) is designed to efficiently fuse multi-scale features. Thirdly, we design an Inverse-residual Feature Enhancement module (IFE), which is embedded in the front of the newly added detection head to enhance feature extraction on small objects. Finally, we conduct a large number of experiments on the VisDrone2019 dataset. The results show that the proposed SGMFNet outperforms other popular methods, and has achieved good results in many scenarios.