The Transfer Learning Based on Relationships between Attributes

Abstract

In practical engineering, small-scale data sets are usually sparse and contaminated by noise. It is difficult to guarantee a competitive generalization performance of regression model from such a data set. However, what is worth mentioning is that there are often a lot of incomplete relationships between attributes in practical engineering. The involvement of the relationships might be significant in improving the generalization performance of machine learning. So in this paper, we propose a transfer learning method based on the incomplete relationships between attributes, in which the incomplete relationships is reasoned to get complete relationships, and the complete relationships are then transferred to the regression learning to improve the generalization performance of the regression model. Finally the proposed method was applied to least squares support vector machine (LSSVM) and was evaluated on benchmark data sets. The experiment results show that the transfer learning can improve the generalization performance and prediction accuracy of the regression model.