Gradient-based recursive maximum likelihood identification of Jump Markov Non-Linear Systems

Abstract

This paper deals with state inference and parameter identification in Jump Markov Non-Linear System. The state inference problem is solved efficiently using a recently proposed Rao-Blackwellized Particle Filter, where the discrete state is integrated out analytically. Within the RBPF framework, Recursive Maximum Likelihood parameter identification is performed using gradient ascent algorithms. The proposed learning method has the advantage over (online) Expectation Maximization methods, that it can be easily applied to cases where the probability density functions defining the Jump Markov Non-Linear System are not members of the exponential family. Two benchmark problems illustrate the parameter identification performance.