A Color/Illuminance Aware Data Augmentation and Style Adaptation Approach to Person Re-Identification

Abstract

Person re-identification problems usually suffer from large subject appearance variations and limited training data. This paper proposes a novel physically motivated Color/Illuminance-Aware data-augmentation (CIADA) scheme and a style-adaptive fusion approach to address these issues. The CIADA scheme estimates the color/illuminance distribution from the training data via manifold learning and generates new samples under different color/illuminance perturbations to better capture objects’ appearance for mitigating the small-sample-size and color variation problems. A Color/Illuminance Aware Feature Augmentation (CIAFA) approach, which is applicable to state-of-the-art features and metric learning algorithms, is then proposed to integrate the features generated by the augmented samples for metric learning. A new Color/Illuminance-Aware Style Fusion (CIASF) scheme, which allows the learning and matching process to be performed independently on each pair of datasets generated for estimating a set of ‘local’ distance functions, is also proposed. A canonical correlation analysis-based weighting scheme is developed to fuse these local distances to an overall distance for recognition. This reduces the memory requirement and complexity over the original CIAFA. Experiments on common datasets show that the proposed methodologies substantially improve the performance of state-of-the-art subspace learning algorithms. It is applicable to both small and large datasets with hand-craft and deep features.