Abstract

Person re-identification (Re-ID) is a non-overlapping multi-camera retrieval task to match different images of the same person, and it has become a hot research topic in many fields, such as surveillance security, criminal investigation, and video analysis. As one kind of important architecture for person re-identification, Siamese networks usually adopt standard softmax loss function, and they can only obtain the global features of person images, ignoring the local features and the large margin for classification. In this paper, we design a novel symmetric Siamese network model named Siamese Multiple Granularity Network (SMGN), which can jointly learn the large margin multiple granularity features and similarity metrics for person re-identification. Firstly, two branches for global and local feature extraction are designed in the backbone of the proposed SMGN model, and the extracted features are concatenated together as multiple granularity features of person images. Then, to enhance their discriminating ability, the multiple channel weighted fusion (MCWF) loss function is constructed for the SMGN model, which includes the verification loss and identification loss of the training image pair. Extensive comparative experiments on four benchmark datasets (CUHK01, CUHK03, Market-1501 and DukeMTMC-reID) show the effectiveness of our proposed method and its performance outperforms many state-of-the-art methods.

Highlights

  • Person re-identification is a crucial task in video analytics scenarios and it received more and more attention on computer vision field [1,2]

  • We introduce a new classification loss called large margin cosine loss (LMCL) [35] to make multiple granularity features have the character of margin maximization for classification

  • The Siamese Multiple Granularity Network (SMGN) model can improve the performance of person re-identification

Read more

Summary

Introduction

Person re-identification is a crucial task in video analytics scenarios and it received more and more attention on computer vision field [1,2]. In the identification model, the problem is that it usually only uses the global information and ignores the local information of the images. Compared with the identification model, the verification input images are the same person [15,16]. Verification models take a pair of images as input and determine whether they belong to the same person or not. We propose a novel symmetric Siamese network model called SMGN, the backbone CNN of which is composed by two branches, i.e., a local branch and a global branch. Compared with the traditional Siamese network model, SMGN can obtain LMMG features of person images, including local features and global features, which would be of great benefit to person re-identification.

Hand-Crafted Feature-Based Person Re-ID
Deep Learned Feature-Based Person Re-ID
Loss Function-Based Person Re-ID
The Proposed Method
The Structure of SMGN
The framework of the proposed proposed Siamese
Multiple Granularity Features
Multi-Channel Weighted Fusion Loss
Identification Loss
Verification Loss
Fusion Loss
Person re-Identification Based on SMGN
Experiment Results
CUHK01
CUHK03
Market-1501
DukeMTMC-REID
Metric Protocols
Implementation Details
Parameter Settings
Parameter
Effect of m
Performance on the CUHK01 Dataset
Performance on the CUHK03 Dataset
Performance on the Market-1501dataset
Performance on DukeMTMC-reID
Conclusions
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call