Object tracking: feature selection by reinforcement learning

Abstract

In recent years, deep convolutional features have been deployed in discriminative correlation filters (DCF) to boost object tracking performance. However, features captured from pre-trained classification networks are usually trained for image classification tasks, not object tracking. In this paper, we find that different convolutional feature channels play different roles in tracking different targets. Some feature channels are favorable for tracking a given target and can be acquired based on this target, some are irrelevant to track this target, and some can be the primary cause of trackers' performance degradation when tracking this target. Thus, we perform feature selection before learning correlation filters for object tracking, and the feature selection module is realized by reinforcement learning. We penalize the features non-positive to obtain a DCF tracker based on positive convolutional feature channels. Compared with DCF based trackers without a feature selection technique, our scheme improves the robustness of target representation, lessens the dimension of activations, and achieves better tracking performance. Extensive experiments on the OTB dataset demonstrate our feature selection scheme is simple, robust, and effective for DCF based trackers.