Predictive Modeling With an Adaptive Unsupervised Broad Transfer Algorithm

Abstract

Deep-learning algorithms have produced promising results, however, domain adaptation remains a challenge. In addition, excessive training time and computing resource requirements need to be addressed. Deep-learning algorithms face a domain adaptation issue when the data distribution of a target domain differs from that of the source domain. The emerging concept of broad learning shows potential in addressing the domain adaptation and training time issues. An adaptive unsupervised broad transfer learning (AUBTL) algorithm is proposed to tackle the cross-domain problems. The proposed algorithm utilizes a sparse autoencoder and random orthogonal mapping to extract and augment the feature space. Then, it initializes the weights of a classifier by solving a ridge regression problem. The logit ranking strategy is applied to develop a transfer estimator to evaluate and sample data in the target domain for an adaptive transfer. Based on the sampled data, AUBTL optimizes the hyperparameter space. The performance of the AUBTL algorithm is validated with three benchmark datasets, including 20 transfer tasks. The computational results demonstrated the efficiency and accuracy of the proposed algorithm over other deep-learning algorithms considered in this research.