Unsupervised multi-source domain adaptation with graph convolution network and multi-alignment in mixed latent space

Abstract

This paper proposes an unsupervised multi-source domain adaptation algorithm with graph convolution network and multi-alignment in mixed latent space, which leverages domain labels, data structure, and category labels in a unified network but improves domain-invariant semantic representation by several innovations. Specifically, a novel data structure alignment is proposed to exploit the inherent properties of different domains while using current domain alignment and classification result alignment. Through this design, category consistency can be considered in both latent space, and domain and structure discrepancy between different source domains and the target domain can be eliminated. Moreover, we also use category alignment based on both CNN and GCN features to optimize category decision boundary. Experiment results show that the proposed method brings sufficient improvement especially for adaptation tasks with large shift in data distribution.