Optimization-based multi-source transfer learning for modeling of nonlinear processes

Abstract

This work develops an optimization-based multi-source transfer learning scheme for modeling of nonlinear chemical processes. Specifically, a transfer learning neural network model for a target process with limited data is developed using the pre-trained model obtained with multiple source processes. Since the performance of transfer learning models depends on the quality of the pre-trained models, we propose a novel Bayesian optimization problem to optimize the selection of multi-source data for the pre-trained models by first deriving a generalization error bound for multi-source domain adaptation using Y-discrepancy distance. Subsequently, the optimization problem is formulated using the theoretical error bound to select the optimal set of multiple sources, which can provide a good initial guess of the weight parameters for transfer learning model. Finally, a simulation study of a chemical reactor process in Aspen Plus Dynamics is conducted to illustrate the effectiveness of the optimization-based multi-source transfer learning scheme.