Cross-modal Pedestrian Re-identification based on Spatially Enhanced Dual-stream Network

Abstract

In the current research on cross-modal pedestrian re-identification, the main difficulty lies in the low recognition accuracy caused by the difference between modalities, in order to solve this problem. In this paper, we propose a new spatially enhanced dual-stream network, which is called Multivariate Extended Network (DEN). This method can embed different learning features to reduce the gap between modalities. The network is composed of a spatial embedding module (CPM) and a multi-feature aggregation module (SEM), in which the spatial embedding module can embed diversified information to improve performance, and the multi-feature aggregation module can aggregate features at different stages to mine channel and spatial information, thereby improving the ability of the network to mine different embeddings at different levels.