Real-Time Vehicle Tracking using Convolutional Neural Networks in Aerial Video

Abstract

Vehicle tracking based on video images has been widely used in military and civilian fields. The tracking method must robust enough to hand the unexpected situations that may occur during the tracking process. In this paper, a novel vehicle tracking method based on convolutional neural networks (CNNs) is proposed to target the accurate and speed demand of vehicle tracking. The proposed method contains two networks with shared weights. It utilizes the residual block to reduce the train error. Offline training is used to achieve real-time tracking. It also use transfer learning to reduce training time. The experimental results under the real aerial video demonstrate that vehicle tracker achieves an accuracy of 70.8% and the speed of 135fps with GPU. The proposed method is robust enough to handle occlusion and other interference conditions.