Global semantic-guided graph attention network for Siamese tracking with ranking loss

Abstract

Most Siamese trackers based on graph attention models focus on the topology between nodes when extracting features. These approaches ignore contextual information regarding the overall structure of the target, resulting in a diminished capacity for target discrimination. In this paper, to resolve this issue, we propose a global semantic-guided graph attention network for Siamese tracking. Firstly, in order to balance the node constraints with the overall information of the target, a global semantic awareness module (GSA) is proposed. It utilizes the attention strategy to focus on the overall characteristics of the target, aiming to mine the relationship of the target context. Incorporating it into the semantic-guided graph attention network through cross-correlation operations can avoid the problem of focusing only the information between nodes without being able to effectively characterize the target. Secondly, to enhance the accuracy of single-point feature regression results, a novel extreme point feature aggregation module (EPA) is proposed. We obtain feature information of the extreme points on the bounding box and combine them with single-point features for the bounding box feature representation to improve the regression accuracy. Finally, to establish a connection or bridge between the classification and regression subnetworks, a categorical regression alignment network is designed. An IOU-guided ranking loss is introduced to align the classification confidence with the IOU of the corresponding positive sample localization prediction to solve the problem of misalignment of the classification branch with the regression branch effectively. Experiments conducted on five challenging benchmarks datasets, namely GOT-10K, OTB-100, LaSOT, UAV123, and TC128, demonstrate that our approach exhibits superior performance compared to other tracking methods in terms of tracking accuracy and execution efficiency.