Multi‐target detection and tracking of shallow marine organisms based on improved YOLO v5 and DeepSORT

Abstract

AbstractIn order to solve the related problems of detection and tracking of shallow marine organisms, this paper designs a YOLO v5 multi‐target detection and tracking algorithm with attention mechanism. When working underwater, the authors usually encounter many difficulties. Different luminosity and complex coral background usually affect the detection of marine organisms. At the same time, the unrestricted movement of marine organisms, the ability to hide behind rocks and algae, and their mutual occlusion while swimming pose additional challenges to this task. Considering the characteristics of shallow marine organisms activity environment, the attention mechanism is added to the feature extraction network of YOLO v5 to reduce redundant information and improve the detection accuracy of shallow marine organism targets in complex environment. The improved algorithm improves the average detection accuracy of marine organisms target detection by 3.2%. Aiming at the problem of shallow marine organisms target tracking, a shallow marine organisms multi‐target tracking algorithm based on improved Deep Simple Online And Realtime Tracking (SORT) is designed. The improved YOLO v5 algorithm is used to replace Faster R‐CNN (Faster Region‐Convolutional Neural Networks) as the detector of DeepSORT tracking algorithm, and the cascade matching strategy is adopted to solve the problem that the target cannot be tracked continuously when it is occluded for a long time. The experimental results show that the shallow marine organisms multi‐target tracking algorithm based on improved DeepSORT reduces the number of id transformation of marine biological target tracking in shallow sea environment, and improves the accuracy of shallow marine organisms multi‐target tracking.