Q-learning based model-free input-output feedback linearization control method⋆

Abstract

Input-output feedback linearization is a nonlinear control method that relies on a precise dynamical model. Combining Q-learning techniques, an input-output feedback linearization correction framework is presented to accomplish model-free feedback linearization of affine nonlinear systems in order to tackle the problem caused by the unknown dynamics model. This framework formulates a model reference tracking control problem that guides the input-output relationship of the nonlinear system into a linear relationship. Due to the two Lie derivative terms present in the feedback linearized controller, the controller is designed as a dual network structure. To overcome the issue of coupling in the dual-network controller, a model-free Q-learning method is presented to solve the unknown controller network weights. The proposed method is experimentally validated on a single-link flexible joint manipulator system, and the resultant linearized system exhibits dynamics similar to the desired linear system in a new tracking task, proving the effectiveness of the proposed method.