Interactive attack-defense for generalized person re-identification

Abstract

Generalized Person Re-Identification (GReID) aims to develop a model capable of robust generalization across unseen target domains, even with training on a limited set of observed domains. Recently, methods based on the Attack-Defense mechanism are emerging as a prevailing technology to this issue, which treats domain transformation as a type of attack and enhances the model’s generalization performance on the target domain by equipping it with a defense module. However, a significant limitation of most existing approaches is their inability to effectively model complex domain transformations, largely due to the separation of attack and defense components. To overcome this limitation, we introduce an innovative Interactive Attack-Defense (IAD) mechanism for GReID. The core of IAD is the interactive learning of two models: an attack model and a defense model. The attack model dynamically generates directional attack information responsive to the current state of the defense model, while the defense model is designed to derive generalizable representations by utilizing a variety of attack samples. The training approach involves a dual process: for the attack model, the aim is to increase the challenge for the defense model in countering the attack; conversely, for the defense model, the focus is on minimizing the effects instigated by the attack model. This interactive framework allows for mutual learning between attack and defense, creating a synergistic learning environment. Our diverse experiments across datasets confirm IAD’s effectiveness, consistently surpassing current state-of-the-art methods, and using MSMT17 as the target domain in different protocols resulted in a notable 13.4% improvement in GReID task average Rank-1 accuracy. Code is available at: https://github.com/lhf12278/IAD.