Automatic segmentation of golden pomfret based on fusion of multi-head self-attention and channel-attention mechanism

Abstract

In precision fishery, the accurate segmentation of each golden pomfret image from the background is an important step to obtain golden pomfret information in real time. However, in complex sea conditions and highly occluded scenes, traditional segmentation methods are still challenging to segment golden pomfret with high speed and high accuracy. In this study, a novel model named SE-TongNet, which fuses multi-head self-attention mechanism and channel mechanism based on Mask R-CNN framework, is proposed for automatic segmentation of golden pomfret. Among them, the multi-head self-attention module creates the sparse attention map for enhancing the fine-grained features of golden pomfret, which can better meet the requirements of real-time detection and segmentation. Also, a novel channel attention mechanism is embedded to filter the redundant information of some channels, thereby optimizing the model. Overall, the SE-TongNet model enables robust learning with multi-policy understanding of high-level semantics in coupled noise scenarios and improves computational efficiency. The test results show that compared with other state-of-the-art networks, the improved method can accurately and effectively segment golden pomfret, with mAP and segmentation rate reaching 82.55 and 5.31fps, respectively. Furthermore, the performance of the SE-TongNet is robust and practical in four major scenarios.