Multi-source Adaptation Research Articles

Multi-source adaptation learning with global and local regularization by exploiting joint kernel sparse representation

While the advantages of using information from multi-source domains for establishing an adaptation model have been widely recognized, how to boosting the robustness of the learning model has only recently received attention. For achieving a robust adaptation learning model for visual classification tasks, by exploiting multi-source adaptation regularization joint kernel sparse representation (ARJKSR), we propose a novel Multi-source Adaptation learning method with Global and Local Regularization (MAGLR), which aims to minimize a cost function that properly trades off the global and local learning costs so as to utilize both the local and global discriminative information of target domain. Specifically, we first learn the optimal ARJKSR of domain datasets, which jointly represents the datasets by a sparse linear combination of a self-expressive dictionary in some optimal reproduced kernel Hilbert space (RKHS) recovered by minimizing the inter-domain distribution discrepancy, whilst constraining the observations from domains to share their sparse representations. Thus, we simultaneously take into account correlations as well as coupling information among multiple source domains. Based on the ARJKSR, we then derive a robust label prediction matrix for unlabeled instances from the target domain based on the classical graph-based semi-supervised learning diagram, into which global and local regularization are incorporated. Furthermore, a multi-kernel regression way is exploited to extend MAGLR to out-of-sample data. The validity of our method is examined by several real-world visual classification tasks. Experimental results demonstrate the superiority of our method.

Multi-source adaptation joint kernel sparse representation for visual classification

Most of the existing domain adaptation learning (DAL) methods relies on a single source domain to learn a classifier with well-generalized performance for the target domain of interest, which may lead to the so-called negative transfer problem. To this end, many multi-source adaptation methods have been proposed. While the advantages of using multi-source domains of information for establishing an adaptation model have been widely recognized, how to boost the robustness of the computational model for multi-source adaptation learning has only recently received attention. To address this issue for achieving enhanced performance, we propose in this paper a novel algorithm called multi-source Adaptation Regularization Joint Kernel Sparse Representation (ARJKSR) for robust visual classification problems. Specifically, ARJKSR jointly represents target dataset by a sparse linear combination of training data of each source domain in some optimal Reproduced Kernel Hilbert Space (RKHS), recovered by simultaneously minimizing the inter-domain distribution discrepancy and maximizing the local consistency, whilst constraining the observations from both target and source domains to share their sparse representations. The optimization problem of ARJKSR can be solved using an efficient alternative direction method. Under the framework ARJKSR, we further learn a robust label prediction matrix for the unlabeled instances of target domain based on the classical graph-based semi-supervised learning (GSSL) diagram, into which multiple Laplacian graphs constructed with the ARJKSR are incorporated. The validity of our method is examined by several visual classification problems. Results demonstrate the superiority of our method in comparison to several state-of-the-arts.

Domain adaptive boosting method and its applications

Differences of data distributions widely exist among datasets, i.e., domains. For many pattern recognition, nature language processing, and content-based analysis systems, a decrease in performance caused by the domain differences between the training and testing datasets is still a notable problem. We propose a domain adaptation method called domain adaptive boosting (DAB). It is based on the AdaBoost approach with extensions to cover the domain differences between the source and target domains. Two main stages are contained in this approach: source-domain clustering and source-domain sample selection. By iteratively adding the selected training samples from the source domain, the discrimination model is able to achieve better domain adaptation performance based on a small validation set. The DAB algorithm is suitable for the domains with large scale samples and easy to extend for multisource adaptation. We implement this method on three computer vision systems: the skin detection model in single images, the video concept detection model, and the object classification model. In the experiments, we compare the performances of several commonly used methods and the proposed DAB. Under most situations, the DAB is superior.

L1-norm locally linear representation regularization multi-source adaptation learning

In most supervised domain adaptation learning (DAL) tasks, one has access only to a small number of labeled examples from target domain. Therefore the success of supervised DAL in this “small sample” regime needs the effective utilization of the large amounts of unlabeled data to extract information that is useful for generalization. Toward this end, we here use the geometric intuition of manifold assumption to extend the established frameworks in existing model-based DAL methods for function learning by incorporating additional information about the target geometric structure of the marginal distribution. We would like to ensure that the solution is smooth with respect to both the ambient space and the target marginal distribution. In doing this, we propose a novel L1-norm locally linear representation regularization multi-source adaptation learning framework which exploits the geometry of the probability distribution, which has two techniques. Firstly, an L1-norm locally linear representation method is presented for robust graph construction by replacing the L2-norm reconstruction measure in LLE with L1-norm one, which is termed as L1-LLR for short. Secondly, considering the robust graph regularization, we replace traditional graph Laplacian regularization with our new L1-LLR graph Laplacian regularization and therefore construct new graph-based semi-supervised learning framework with multi-source adaptation constraint, which is coined as L1-MSAL method. Moreover, to deal with the nonlinear learning problem, we also generalize the L1-MSAL method by mapping the input data points from the input space to a high-dimensional reproducing kernel Hilbert space (RKHS) via a nonlinear mapping. Promising experimental results have been obtained on several real-world datasets such as face, visual video and object.