Combined Correlation Filters with Siamese Region Proposal Network for Visual Tracking

Abstract

Siamese network based trackers have received extensive attention with their trade-off between accuracy and speed. In particular, Siamese Region Proposal Network (SiamRPN) tracker can get more accurate bounding box with proposal refinement, yet, most siamese trackers are lack of discrimination without target classification and robustness without online learning module. To tackle the problem, in this paper, we propose an ensemble tracking framework based on SiamRPN tracker, consisting of two components: (1) Correlation Filter module with hierarchical features fusion; and (2) SiamRPN module. The Correlation Filter module fully exploits both the semantic features for classification and the lower-level features for precise localization through online learning process. By cascading the Correlation Filter to SiamRPN tracker, which can equip with discrimination power. The entire network based on multitask learning strategy is trained in an end-to-end manner, which enhances both robustness and module adaptability effect. In extensive experiments evaluations on GOT-10K test dataset, OTB2015 and VOT2016 benchmarks, our tracking approach obtains better performance than other trackers, including SiamRPN tracker, by a notable margin.