Network For Person Re-identification Research Articles

Self-selective receptive field network for person re-identification

AbstractPerson Re-identification (Re-ID) technology aims to solve the matching problem of the same pedestrians at different times and places, which has important application value in the field of public safety. At present, most scholars focus on designing complex models to improve the accuracy of Re-ID, but the high complexity of the model further restricts the practical application of Re-ID algorithm. To solve the above problems, this paper designs a lightweight Self-selective Receptive Field (SRF) block instead of directly designing complex models. Specifically, the module can be plug-and-play on the general backbone network, so as to significantly improve the performance of Re-ID while effectively controlling the amount of its own parameter and calculation: (1) the SRF block encodes pedestrian targets and image contexts at different scales by constructing pyramidal convolution group and allows the module to independently select the size of the receptive field through training by means of self-adaptive weighting; (2) in order to reduce the complexity of SRF block, we introduce a "channel scaling factor" and design a "grouped convolution operation" by constraining the channels of the feature map and changing the structure of the convolution kernel respectively. Experiments on multiple datasets show that SRF Network (SRFNet) for Re-ID can achieve a good balance between performance and complexity, which fully demonstrates the effectiveness of SRF block.

Utilizing Silhouette and Head Information for Improved Cloth-changing Person Re-Identification

In recent years, significant progress has been made in person re-identification (ReID). However, as the time span increases, the phenomenon of changing clothes often occur, and the performance of methods based on person re-identification may decrease in this case. In this article, we focus on solving the problem of cloth-changing person re-identification from a single RGB image, which is more challenging, and improving the accuracy and robustness of traditional methods for recognition. We propose a cloth-changing Feature Regularization learning framework by fusing Silhouette and Head information (SHFR), a two-stream framework which transfers the silhouette information and head information learned by auxiliary stream to the main stream and supplements features unrelated to clothing. Specifically, the main stream approach we adopt is the traditional cloth-changing person re-identification network. In the auxiliary stream, we use the DeepLabV3 semantic segmentation model to extract person silhouette features, and the FCHD fully convolutional head detection model to extract head information with advanced semantic information. We concatenate the head information and background information into the silhouette as input for BackBone to continue training the network. In order to utilize silhouette information and head information, we regularize the cloth-changing features on both main stream and auxiliary stream, allowing main stream model to pay more attention to features unrelated to clothing and improve the accuracy of model recognition. We conduct extensive experiments on our model on the PRCC dataset, and the results show that our method has highly competitive performance.

Efficient and lightweight multiscale network for person reidentification

Efficient and lightweight multiscale network for person reidentification

IGIE-net: Cross-modality person re-identification via intermediate modality image generation and discriminative information enhancement

Given an RGB image (or an IR image) of a pedestrian, the task of cross-modality person re-identification aims to retrieve images of a specific pedestrian from an IR (or RGB) gallery. However, the huge modality discrepancy between RGB and IR images significantly affects the performance of cross-modality person re-identification. For the purpose of reducing the impact of modality discrepancy and extracting more discriminative pedestrian features, a new cross-modality person re-identification network is proposed by us, which is based on intermediate modality image generation and discriminative information enhancement (IGIE-Net). Specifically, we design an intermediate modality image generation module (IMIGM) to effectively weaken the impact of modality discrepancy, which first extracts the modality-specific and modality-shared information contained in RGB and IR images separately, and then generates intermediate RGB and intermediate IR images by adaptively fusing original RGB and original IR images with their corresponding modality-specific and modality-shared information separately. In addition, we also design a discriminative information enhancement module (DIEM) to obtain more discriminative pedestrian representations by enhancing the discriminative information contained in the deep features of pedestrians. Extensive experiments on the publicly available SYSU-MM01 and RegDB datasets indicate that the performance of IGIE-Net reaches the current advanced level.

Multi-scale and multi-patch feature fusion network for person re-identification

Person re-identification relies on discriminative features. However, most researches focus on extracting features from the high-layer of network while ignoring the middle-layer features, some important details are overlooked frequently. To address this issue, we propose a Multi-Scale and Multi-Patch Feature Fusion Network(MSPF). We employ modified OSFA to extract, align, and fuse the feature maps in the middle-layer of network, which can compensate for the lack of detailed information in the high-level network features. To obtain richer detailed global features of pedestrian, we construct a multi-patch feature fusion module(MPF). We concatenate the global features extracted from modified OSFA and MPF to obtain global features with richer detailed representations. Cross-entropy loss, triplet loss and center loss are combined to constrain our model. We evaluate the performance of our model on Market-1501, CUHK03_labeled and DukeMTMC. The results prove that our method is superior to the state-of-the-art approaches.

An efficient feature pyramid attention network for person re-identification

For person re-identification, occlusion, appearance similarity and background clutter have always been challenges. In order to effectively address the challenges, we propose an efficient feature pyramid attention network (FPA-Net), which combines visual features from different levels to focus on both detail features and information. Specifically, we embed a pair of attention mechanisms that complement each other in the backbone network to focus on the discriminant features of person areas. In addition, we designed a novel feature pyramid structure, which propagates the feature information from the cross-level through the top feature to the bottom feature and from the bottom feature to the top feature to supplement the detail information of the feature. Finally, we integrate features form different scales through a lightweight transition block to generate more discriminant features. Our method performed experimental analysis on four datasets: Market-1501, DukeMTMC-ReID, CUHK03(Detected) and MSMT17. A large number of experimental results prove that the performance of the method is significantly better than the existing state-of-the-art methods.

Multi-granularity Cross Transformer Network for person re-identification

Person re-identification (Re-ID) aims to retrieve the same person in the gallery. Transformers have been introduced to the Re-ID task due to their excellent ability to model long-range dependency. However, due to the properties of the global attention mechanism, they are less effective in capturing the discriminative local semantics of pedestrians compared to convolutional operations. To address this issue, we present a Multi-granularity Cross Transformer Network (MCTN) that progressively learns salient features of different local structures in a global context. Specifically, we first utilize a Multi-granularity Convolutional Layer (MCL) to investigate salient pedestrian features at various granularities. On this basis, we propose a Pyramidal Cross Transformer learning layer (PCT), which contains a pyramidal division of pedestrian image feature maps, differentiated feature extraction of different parts of pedestrians, and cross attention to exploring the local–global relationship of the feature map. It allows effective mining of local information in the global structure from a coarse-to-fine perspective. Furthermore, to enhance the interaction between low-level detailed features and high-level semantic features, a Hierarchical Aggregation Strategy (HAS) is introduced to fuse features learned by cross attention learning at different stages. Pedestrian features learned in shallow layers will serve as global priors for semantics learning in deep layers. We evaluate our method on four large-scale Re-ID datasets, and the experimental results reveal that the proposed method outperforms the state-of-the-art methods.

Dual-stream feature fusion network for person re-identification

Person re-identification (Re-ID) has made significant progress in recent years. However, it still faces numerous challenges in real scenarios. Although researchers have proposed various solutions, the issue of similar clothing colors remains an obstacle in improving the performance of person re-identification. To solve this issue, we propose a dual-stream feature fusion network (DSFF-Net) to extract discriminative features from pedestrian images in two color spaces. Specifically, a dual-stream network is designed to extract RGB global features, grayscale global features, and local features of pedestrian images to increase the richness of pedestrian representations. A channel attention module is designed to direct the network to focus on the salient features of pedestrians. An embedding mixed pooling is designed, which integrates the outputs of global average pooling (GAP) and global max pooling (GMP) to obtain more discriminative global features. Besides, it can also remove redundant information and increase the discrimination of pedestrian representations. A fine-grained local feature embedding fusion operation is designed to obtain more discriminative local features by embedding and fusing fine-grained local features of RGB and grayscale pedestrian images. Since the final pedestrian representation fuses both global features and fine-grained discriminative features in RGB and grayscale spaces, DSFF-Net increases the discriminative capability and richness of pedestrian representations. Moreover, we conduct extensive experiments on three datasets, Market-1501 DukeMTMC-Reid, and CUHK03, and our method achieves the Rank-1/mAP of 95.9%/89.1%, 89.0%/79.2%, and 81.2%/78.7%, respectively. Experimental results show that the performance of DSFF-Net is better than those of most of the state-of-the-art person Re-ID methods.

Attention-based mechanism and feature fusion network for person re-identification

Attention-based mechanism and feature fusion network for person re-identification

2D-SNet: A Lightweight Network for Person Re-Identification on the Small Data Regime

2D-SNet: A Lightweight Network for Person Re-Identification on the Small Data Regime

Attention-based mechanism and feature fusion network for person re-identification

Attention-based mechanism and feature fusion network for person re-identification

Pose-guided self and external attention feature matching and aggregation network for person re-identification

Traditional methods that use pose information for person re-identification (ReID) often focus only on relationships between different parts of the same sample and ignore the correlation between poses of different samples, which hinders further improvement in recognition accuracy. In view of this, this paper proposes a pose-guided self and external attention feature matching and aggregation net which contains a visual context self and external attention module and a pose-guided feature matching and aggregation module. It can divide global features into local features without strict spatial feature alignment, and enables the model to focus on pose correlation between different samples. Thus, it not only learns pose-related identity identification features, but also avoids interference from the samples with large pose changes. The visual context self and external attention module realizes feature embedding through a transformer-based image classification model ViT and a human pose estimation model. Also, it extracts encoder features and local features containing rich pose information by adding an external attention. The pose-guided feature matching and aggregation module obtains a learnable part semantic view through a transformer decoder and pose heat maps. Then, it matches and aggregates with local features, adaptively learns pose-related features, and enhances the robustness of the model to background and occlusion. In this paper, experiments are conducted based on three data sets, including Market-1501, DukeMTMC-reID and MSMT17. The Rank-1 values are 95.3%, 90.1%, and 82.5%, respectively, and the mAP values are 88.3%, 81.1%, and 64.1%, respectively. In conclusion, our method introduces an external attention into the ReID task, and the ReID model can obtain more accurate results by extracting pose-related identity identification features and avoiding interference from samples with large pose changes.

Improving Person Re-Identification with Distance Metric and Attention Mechanism of Evaluation Features

In the present study, we developed a person re-identification network called the Multiple Granularity Attention Cosine Network (MGAC). MGAC utilizes the Multiple Granularity Network (MGN), which combines global and local features and constructs an attention mechanism to add to MGN to form a Multiple Granularity Attention Network (MGA). With the attention mechanism, which focuses on important features, MGA assesses the importance of learned features, resulting in higher scores for important features and lower scores for distracting features. Thus, identification accuracy is increased by enhancing important features and ignoring distracting features. We performed experiments involving several classical distance metrics and selected cosine distance as the distance metric for MGA to form the MGAC re-identification network. In experiments on the Market-1501 mainstream dataset, MGAC exhibited high identification accuracies of 96.2% and 94.9% for top-1 and mAP, respectively. The results indicate that MGAC is an effective person re-identification network and that the attention mechanisms and cosine distance can significantly increase the person re-identification accuracy.

A novel person re-identification network to address low-resolution problem in smart city context

We argue that accurate person re-identification is a vital problem for urban public monitoring systems in the smart city context. Since images captured from different cameras have arbitrary resolutions resulting in resolution mismatch, this work proposes a model that takes arbitrary images and converts them to a pre-defined fixed resolution. The model then passes the images to a super-resolution network, producing high-resolution images. We employ a feedback network to generate more realistic super-resolution images, which are fed to the re-identification network to acquire a unique descriptor to disclose the person’s identity. We outperformed in all measures against other state-of-the-art methods.

An efficient multi-scale channel attention network for person re-identification

At present, occlusion and similar appearance pose serious challenges to the task of person re-identification. In this work, we propose an efficient multi-scale channel attention network (EMCA) to learn robust and more discriminative features to solve these problems. Specifically, we designed a novel cross-channel attention module (CCAM) in EMCA and placed it after different layers in the backbone. The CCAM includes local cross-channel interaction (LCI) and channel weight integration (CWI). LCI focuses on both the maximum pooling features and the average pooling features to generate channel weights through convolutional layers, respectively. CWI combines the two channel weights to generate richer and more discriminant channel weights. Experiments on four popular person Re-ID datasets (Market-1501, DukeMTMC-ReID, CUHK-03 (detected) and MSMT17) show that the performance of our EMCA is consistently significantly superior to the existing state-of-the-art methods.

AEA-Net:Affinity-supervised entanglement attentive network for person re-identification

Most existing person re-identification algorithms prioritize the extraction of effective and salient local features while neglecting the affinity between local and adjacent features. This phenomenon will cause misidentification when different people have similar local features. To address this issue, we introduce the AEA-Net, which emphasizes the affinity between the local features of a single image. Specifically, three important components are proposed. The affinity-supervised attention module (ASA) centers on adjacent features and utilizes the affinity between global and adjacent features to supervise the learning of attention. The affinity relationship module (AR) focuses on constructing relationship features between local and adjacent features to enhance the closeness between local features. The tangle hybrid loss (THL) makes the final predictions have a distinct weight profile. Extensive experiments quantitatively and qualitatively demonstrate that our method outperforms the state-of-the-art approaches.

Dynamic Weighting Network for Person Re-Identification.

Recently, hybrid Convolution-Transformer architectures have become popular due to their ability to capture both local and global image features and the advantage of lower computational cost over pure Transformer models. However, directly embedding a Transformer can result in the loss of convolution-based features, particularly fine-grained features. Therefore, using these architectures as the backbone of a re-identification task is not an effective approach. To address this challenge, we propose a feature fusion gate unit that dynamically adjusts the ratio of local and global features. The feature fusion gate unit fuses the convolution and self-attentive branches of the network with dynamic parameters based on the input information. This unit can be integrated into different layers or multiple residual blocks, which will have varying effects on the accuracy of the model. Using feature fusion gate units, we propose a simple and portable model called the dynamic weighting network or DWNet, which supports two backbones, ResNet and OSNet, called DWNet-R and DWNet-O, respectively. DWNet significantly improves re-identification performance over the original baseline, while maintaining reasonable computational consumption and number of parameters. Finally, our DWNet-R achieves an mAP of 87.53%, 79.18%, 50.03%, on the Market1501, DukeMTMC-reID, and MSMT17 datasets. Our DWNet-O achieves an mAP of 86.83%, 78.68%, 55.66%, on the Market1501, DukeMTMC-reID, and MSMT17 datasets.

Joint attribute soft-sharing and contextual local: a multi-level features learning network for person re-identification

Joint attribute soft-sharing and contextual local: a multi-level features learning network for person re-identification

An improved interaction-and-aggregation network for person re-identification

An improved interaction-and-aggregation network for person re-identification

Multi-feature fusion network for person reidentification

Multi-feature fusion network for person reidentification