Abstract

Due to the large amount of video data from UAV aerial photography and the small target size from the aerial perspective, pedestrian detection in drone videos remains a challenge. To detect objects in UAV images quickly and accurately, a small-sized pedestrian detection algorithm based on the weighted fusion of static and dynamic bounding boxes is proposed. First, a weighted filtration algorithm for redundant frames was applied using the inter-frame pixel difference algorithm cascading vision and structural similarity, which solved the redundancy of the UAV video data, thereby reducing the delay. Second, the pre-training and detector learning datasets were scale matched to address the feature representation loss caused by the scale mismatch between datasets. Finally, the static bounding extracted by YOLOv4 and the motion bounding boxes extracted by LiteFlowNet were subject to the weighted fusion algorithm to enhance the semantic information and solve the problem of missing and multiple detections in UAV object detection. The experimental results showed that the small object recognition method proposed in this paper enabled reaching an mAP of 70.91% and an IoU of 57.53%, which were 3.51% and 2.05% higher than the mainstream target detection algorithm.

Highlights

  • Drones play a key role in smart city environments such as intelligent transportation [2], crowd management [3], and natural disasters [4]

  • A weighted filtration algorithm for redundant frames is proposed to reduce redundant frames and calculations; A weighted fusion algorithm for static and dynamic bounding boxes is proposed to improve the detection accuracy; We introduced scale matching to reduce the loss of detector features and further improve the accuracy of the detector

  • After static and motion boxes weighted fusion, the proposed method mAP is increased by 3.51%, IoU increased by 2.05%

Read more

Summary

Introduction

The development of smart cities has set off a wave of trends, including unmanned and intelligent systems. Smart cities foster sustainable urban development by harnessing networked and integrated sustainable urban technologies [1]. Drones play a key role in smart city environments such as intelligent transportation [2], crowd management [3], and natural disasters [4]. UAVs play a key role in smart cities for pedestrian detection and use detection technology integrated in people’s daily lives. The combination of UAV and pedestrian detection is being explored and studied. The detection data can be collected by a digital camera installed on the drone [6]. The aerial images of drones have the problems of small object sizes, low signal-to-noise ratios, and complex backgrounds. Quickly and accurately detecting small-sized pedestrian objects in UAV images is a challenging problem

Methods
Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call