Learning Control For Linear Systems Research Articles

Data-driven robust iterative learning control of linear systems

We propose a data-driven robust iterative learning control (ILC) technique to multi-input-multi-output (MIMO) linear systems. Control of MIMO linear systems, particularly with strong cross-axis coupling, is challenging as modeling of a MIMO system can be complicated, time-consuming, and often requires a trade-off between robustness and performance. As such, limitations exist in current ILC techniques. The aim of this paper is to develop an efficient and easy-to-use data-driven ILC technique to output tracking of MIMO linear systems under random disturbance. Through the proposed technique, the complicated modeling process and the robustness-accuracy trade-off are avoided, and the up-to-now system dynamics is captured by constructing and updating the iteration gain using the input and output data in the last iteration. It is shown that monotonic convergence of the ILC algorithm is guaranteed, and an optimal gain can be obtained to maximize the convergence rate and minimize the residual tracking error. The proposed technique is illustrated through experiments on a three-input three-output piezoelectric actuator system, with comparison to the adaptive multi-axis inversion-based iterative control (A-MAIIC) technique. The experimental results show rapid convergence and improved formance of the proposed technique when the cross-axis coupling is strong.

A Note on State Parameterizations in Output Feedback Reinforcement Learning Control of Linear Systems

A Note on State Parameterizations in Output Feedback Reinforcement Learning Control of Linear Systems

Open-Closed-Loop Iterative Learning Control for Linear Systems With Iteratively Variable Trail Lengths

This paper addresses the open-closed-loop iterative learning control (ILC) issue for linear systems with iteratively variable trail lengths. Due to the varying trail lengths in iteration domain, some tracking information would be lost at the previous iterations. To compensate the absent information, an open-closed-loop ILC scheme composing of a feed-forward ILC part and a feedback control part is designed. The convergence of ILC tracking error in mathematical expectation sense is guaranteed by the feed-forward part. The tracking information of the current iteration is employed by feedback control part to compensate the missing tracking information at the previous iterations. To deal with the iteratively variable trail lengths, a modified tracking error at desired trail length is adopted in the designed ILC scheme. It is shown that the mathematical expectation of tracking error is convergent to zero. Two illustrative examples are carried out to show the effectiveness of the proposed ILC schemes.

Rectified fractional order iterative learning control for linear system with initial state shift

In this paper, a new rectifying action is combined into different proportional-α-order-derivative-type iterative learning control algorithms for a class of fractional order linear time-invariant systems. Unlike the existing fractional order iterative learning control techniques, the proposed algorithms allow the initial state value of a fractional order iterative learning control system at each iteration to shift randomly. By introducing the Lebesgue-p norm and using the method of fractional integration by parts and the generalized Young inequality of convolution integral, the tracking performances with respect to the initial state shift under the proposed algorithms are analyzed. These analyses show that the tracking errors are incurred by such a shift and improved by tuning the rectifying gain. Numerical simulations are performed to demonstrate the effectiveness of the proposed algorithms.

Learning control for linear systems under general data dropouts at both measurement and actuator sides: A Markov chain approach

This paper contributes to the convergence analysis of iterative learning control for linear systems under general data dropouts at both measurement and actuator sides. By using a simple compensation mechanism for the dropped data, the sample path behavior along the iteration axis is analyzed and formulated as a Markov chain first. Based on the Markov chain, the recursion of the input error is reformulated as a switching system, and then a novel convergence proof is established in the almost sure sense under mild design conditions. Illustrative examples are provided to verify the theoretical results.

Adaptive Iterative Learning Control for Linear Systems With Binary-Valued Observations.

This brief presents a novel adaptive iterative learning control (ILC) algorithm for a class of single parameter systems with binary-valued observations. Using the certainty equivalence principle, the adaptive ILC algorithm is designed by employing a projection identification algorithm along the iteration axis. It is shown that, even though the available system information is very limited and the desired trajectory is iteration-varying, the proposed adaptive ILC algorithm can guarantee the convergence of parameter estimation over a finite-time interval along the iterative axis; meanwhile, the tracking error is pointwise convergence asymptotically. Two examples are given to validate the effectiveness of the algorithm.

A convex optimization approach to robust iterative learning control for linear systems with time-varying parametric uncertainties

In this paper, we present a new robust iterative learning control (ILC) design for a class of linear systems in the presence of time-varying parametric uncertainties and additive input/output disturbances. The system model is described by the Markov matrix as an affine function of parametric uncertainties. The robust ILC design is formulated as a min–max problem using a quadratic performance criterion subject to constraints of the control input update. Then, we propose a novel methodology to find a suboptimal solution of the min–max optimization problem. First, we derive an upper bound of the worst-case performance. As a result, the min–max problem is relaxed to become a minimization problem in the form of a quadratic program. Next, the robust ILC design is cast into a convex optimization over linear matrix inequalities (LMIs) which can be easily solved using off-the-shelf optimization solvers. The convergences of the control input and the error are proved. Finally, the robust ILC algorithm is applied to a physical model of a flexible link. The simulation results reveal the effectiveness of the proposed algorithm.

A convex optimization design of robust iterative learning control for linear systems with iteration‐varying parametric uncertainties

AbstractIn this paper, a new robust iterative learning control (ILC) algorithm has been proposed for linear systems in the presence of iteration‐varying parametric uncertainties. The robust ILC design is formulated as a min‐max problem using a quadratic performance criterion subject to constraints of the control input update. An upper bound of the maximization problem is derived, then, the solution of the min‐max problem is achieved by solving a minimization problem. Applying Lagrangian duality to this minimization problem results in a dual problem which can be reformulated as a convex optimization problem over linear matrix inequalities (LMIs). Next, we present an LMI‐based algorithm for the robust ILC design and prove the convergence of the control input and the error. Finally, the proposed algorithm is applied to a distillation column to demonstrate its effectiveness.Copyright © 2010 John Wiley and Sons Asia Pte Ltd and Chinese Automatic Control Society

Robust iterative learning control for linear systems with multiple time-invariant parametric uncertainties

This article presents a novel robust iterative learning control algorithm (ILC) for linear systems in the presence of multiple time-invariant parametric uncertainties.The robust design problem is formulated as a min–max problem with a quadratic performance criterion subject to constraints of the iterative control input update. Then, we propose a new methodology to find a sub-optimal solution of the min–max problem. By finding an upper bound of the worst-case performance, the min–max problem is relaxed to be a minimisation problem. Applying Lagrangian duality to this minimisation problem leads to a dual problem which can be reformulated as a convex optimisation problem over linear matrix inequalities (LMIs). An LMI-based ILC algorithm is given afterward and the convergence of the control input as well as the system error are proved. Finally, we apply the proposed ILC to a generic example and a distillation column. The numerical results reveal the effectiveness of the LMI-based algorithm.

Novel adaptive learning control of linear systems with completely unknown time delays

A novel output-feedback adaptive learning control approach is developed for a class of linear time-delay systems. Three kinds of uncertainties: time delays, number of time delays, and system parameters are all assumed to be completely unknown, which is different from the previous work. The design procedure includes two steps. First, according to the given periodic desired reference output and the allowed bound of tracking error, a suitable finite Fourier series expansion (FSE) is chosen as a practical reference output to be tracked. Second, by expressing the delayed practical reference output as a known time-varying vector multiplied by an unknown constant vector, we combine three kinds of uncertainties into an unknown constant vector and then estimate the vector by designing an adaptive law. By constructing a Lyapunov-Krasovskii functional, it is proved that the system output can asymptotically track the practical reference signal. An example is provided to illustrate the effectiveness of the control scheme developed in this paper.

Adaptive learning control of linear systems by output error feedback

This paper addresses the problem of designing an output error feedback tracking control for single-input, single-output uncertain linear systems when the reference output signal is smooth and periodic with known period T. The considered systems are required to be observable, minimum phase, with known relative degree and known high frequency gain sign. By developing in Fourier series expansion a suitable unknown periodic input reference signal, an output error feedback adaptive learning control is designed which ‘learns’ the input reference signal by identifying its Fourier coefficients: bounded closed-loop signals and global exponential tracking of both the input and the output reference signals are obtained when the Fourier series expansion is finite, while global exponential convergence of the input and output tracking errors into arbitrarily small residual sets is achieved otherwise. The structure of the proposed controller depends only on the relative degree, the reference signal period, the high frequency gain sign and the number of estimated Fourier coefficients.

Model reference adaptive iterative learning control for linear systems

AbstractIn this paper, we propose a model reference adaptive control (MRAC) strategy for continuous‐time single‐input single‐output (SISO) linear time‐invariant (LTI) systems with unknown parameters, performing repetitive tasks. This is achieved through the introduction of a discrete‐type parametric adaptation law in the ‘iteration domain’, which is directly obtained from the continuous‐time parametric adaptation law used in standard MRAC schemes. In fact, at the first iteration, we apply a standard MRAC to the system under consideration, while for the subsequent iterations, the parameters are appropriately updated along the iteration‐axis, in order to enhance the tracking performance from iteration to iteration. This approach is referred to as the model reference adaptive iterative learning control (MRAILC). In the case of systems with relative degree one, we obtain a pointwise convergence of the tracking error to zero, over the whole finite time interval, when the number of iterations tends to infinity. In the general case, i.e. systems with arbitrary relative degree, we show that the tracking error converges to a prescribed small domain around zero, over the whole finite time interval, when the number of iterations tends to infinity. It is worth noting that this approach allows: (1) to extend existing MRAC schemes, in a straightforward manner, to repetitive systems; (2) to avoid the use of the output time derivatives, which are generally required in traditional iterative learning control (ILC) strategies dealing with systems with high relative degree; (3) to handle systems with multiple tracking objectives (i.e. the desired trajectory can be iteration‐varying). Finally, simulation results are carried out to support the theoretical development. Copyright © 2006 John Wiley & Sons, Ltd.

An analysis of learning control by backpropagation through time

The main objective of this paper is to indicate how the learning process of a neural control system by backpropagation through time (BTT) is influenced by the structure of the control system, the dynamics of the plant and the parameters of the learning process. Since the analysis of a linear system is far more tractable than the analysis of a nonlinear system, learning control of linear systems is pursued as a step towards the understanding of learning control of nonlinear systems. Very good control performance can be attained for linear control systems by BTT learning. Learning of a feedforward controller is enhanced by inclusion of a feedback controller. The attained control performance is not affected by the sensitivity model of the plant. Application of BTT to the control of a nonlinear musculoskeletal model of the human arm shows that both feedback and feedforward control are necessary for a good performance and that both control modes are effectively adapted in the learning process. A satisfactory control performance can still be achieved with drastically simplified sensitivity models during this learning process.

Iterative learning control: A survey and new results

AbstractLearning control is an iterative approach to the problem of improving transient behavior for processes that are repetitive in nature. In this article, we present some results on iterative learning control. A complete review of the literature is given first. Then, a general formulation of the problem is given. Next, we present a complete analysis of the learning control problem for the case of linear, time‐invariant plants and controllers. This analysis offers: (1) insight into the nature of the solution of the learning control problem by deriving sufficient convergence conditions; (2) an approach to learning control for linear systems based on parameter estimation; and (3) an analysis that shows that for finite‐horizon problems it is possible to design a learning control algorithm that converges, with memory, in one step. Finally, a time‐varying learning controller is given for controlling the trajectory of a nonlinear robot manipulator. A brief simulation example is presented to illustrate the effectiveness of this scheme.