Maritime Electro-Optical Image Object Matching Based on Improved YOLOv9

Abstract

The offshore environment is complex during automatic target annotation at sea, and the difference between the focal lengths of visible and infrared sensors is large, thereby causing difficulties in matching multitarget electro-optical images at sea. This study proposes a target-matching method for visible and infrared images at sea based on decision-level topological relations. First, YOLOv9 is used to detect targets. To obtain markedly accurate target positions to establish accurate topological relations, the YOLOv9 model is improved for its poor accuracy for small targets, high computational complexity, and difficulty in deployment. To improve the detection accuracy of small targets, an additional small target detection head is added to detect shallow feature maps. From the perspective of reducing network size and achieving lightweight deployment, the Conv module in the model is replaced with DWConv, and the RepNCSPELAN4 module in the backbone network is replaced with the C3Ghost module. The replacements significantly reduce the number of parameters and computation volume of the model while retaining the feature extraction capability of the backbone network. Experimental results of the photovoltaic dataset show that the proposed method improves detection accuracy by 8%, while the computation and number of parameters of the model are reduced by 5.7% and 44.1%, respectively. Lastly, topological relationships are established for the target results, and targets in visible and infrared images are matched based on topological similarity.