RGBT tracking using randomly projected CNN features

Abstract

Integrating multiple complementary features has been proved to be an effective way for improving tracking results. In this paper, we exploit how to perform robust visual tracking in challenging situations by adaptively integrating information from RGB and thermal videos. Specifically, convolutional neural network (CNN) representation with random projection is proposed to depict RGB and thermal images, respectively. Furthermore, an adaptive fusion strategy based on a period of time is developed. We jointly optimize the reliable weights of different modalities. In addition, we explore the random projection to CNN features. Extensive experiments against other state-of-the-art methods demonstrate the effectiveness of the proposed method. Through analyzing quantitative tracking results, we provide basic insights in RGB and thermal data tracking.