Multi-frame twin-channel descriptor for person re-identification in real-time surveillance videos

Abstract

Automatic re-identification of people entering the camera network is an important and challenging task. Multiple frames of the same person will be easily available in surveillance videos for re-identification. Dealing with pose variations of the person in the image and partial occlusion issues is major challenge in single-frame re-identification process. The use of more frames from the surveillance videos can generate robust descriptor to tackle issues of pose variations and occlusion. In this paper, we have emphasized on using multiple frames from the same video to generate a multi-frame twin-channel descriptor. The work deals with building a spatial-temporal descriptor which takes advantage of the twin paths to extract features of the person image. Mahalanobis distance metric learning algorithms is used for matching and evaluation. Our descriptor is evaluated on two benchmark datasets and found to surpass the performance of the existing methods.