Overview of image fusion technology for low-cost UAVs perception system

Abstract

With the gradual improvement of the autonomous capabilities of Unmanned Aerial Vehicles (UAVs), the field of tasks has expanded, and it is necessary for UAVs to fully perceive target information from multiple levels and dimensions in the process of target detection and identification in the complex environment. Therefore, for UAVs, the main goal of fusion perception technology is to achieve resource interoperability and information complementarity between sensors, such as to increase the detection advantages of different image sensors in frequency, space, and time. In this paper, based on low-cost UAVs, the research is carried out from two aspects: UAVs and fusion perception sensors, and image-based fusion perception technology. The factors that need to be considered in UAVs’ sensor configuration are analyzed from four aspects: UAVs’ platform attributes, sensor attributes, flight environment, and task types and requirements. Then, we summarize the current image fusion perception technology in the process of UAVs’ detection and identification, which provides an effective reference for product development and technology research in related fields. Finally, the challenges faced by the future development of fusion technology are proposed. The overview shows that, sensor configuration scheme and information fusion scheme have the relationship of mutual promotion and restriction in the process of searching for the optimal fusion strategy. It is necessary to develop heterogeneous information fusion algorithm based on sensor characteristics. Moreover, the level of precise sensing elements, efficient information acquisition algorithms, configuration schemes and fusion algorithm implementations are required to improve for the result of 1+1<2.