Noisy-Output-Based Direct Learning Tracking Control With Markov Nonuniform Trial Lengths Using Adaptive Gains

Abstract

In this article, a noisy-output-based direct learning tracking control is proposed for stochastic linear systems with nonuniform trial lengths. The iteration-varying trial length is modeled using a Markov chain for demonstration of the iteration dependence. The effect of the noisy output is asymptotically eliminated using a prior given decreasing gain sequence in the learning algorithm. Two alternative adaptive gains are presented for improving the tracking performance and the convergence speed. Both the mean-square and almost-sure convergence are provided. Numerical simulations on a four-degree-of-freedom robot arm are presented to illustrate the effectiveness of the proposed scheme.