Hybrid Neural Network/Algorithmic Approaches to System Identification

Abstract

Linear discrete-time models predominate in process system identification, but suffer from some drawbacks. An appealing alternative is to identify continuous-time linear models, expressed as differential equations or Laplace transforms. Two problems must be solved in a computationally feasible way for continuous-time transfer function identification: the model structure must be determined and, subsequently, values for parameters associated with the structural description must be estimated. Our approach to the identification of continuous-time models integrates two technologies. We use the nonlinear classification capabilities of neural networks for structure determination. For parameter estimation we use a nonlinear identification algorithm. A second neural network is employed to provide the algorithm initial conditions, thereby improving its convergence properties. Network training is greatly facilitated by the dynamic generation of examples—overparametrization and overfitting concerns are alleviated entirely. A system identifier targeted for petrochemical applications has been developed. Some details of the implementation are described and experimental results presented. These demonstrate that both accurate and efficient identification of continuous-time models is feasible.