Stochastic Reachability Analysis of Hybrid Systems

Abstract

Stochastic reachability analysis (SRA) is a method of analyzing the behavior of control systems which mix discrete and continuous dynamics. For probabilistic discrete systems it has been shown to be a practical verification method but for stochastic hybrid systems it can be rather more. As a verification technique SRA can assess the safety and performance of, for example, autonomous systems, robot and aircraft path planning and multi-agent coordination but it can also be used for the adaptive control of such systems. Stochastic Reachability Analysis of Hybrid Systems is a self-contained and accessible introduction to this novel topic in the analysis and development of stochastic hybrid systems. Beginning with the relevant aspects of Markov models and introducing stochastic hybrid systems, the book then moves on to coverage of reachability analysis for stochastic hybrid systems. Following this build up, the core of the text first formally defines the concept of reachability in the stochastic framework and then treats issues representing the different faces of SRA: · stochastic reachability based on Markov process theory; · martingale methods; · stochastic reachability as an optimal stopping problem; and · dynamic programming. The book is rounded off by an appendix providing mathematical underpinning on subjects such as ordinary differential equations, probabilistic measure theory and stochastic modeling, which will help the non-expert-mathematician to appreciate the text. Stochastic Reachability Analysis of Hybrid Systems characterizes a highly interdisciplinary area of research and is consequently of significant interest to academic researchers and graduate students from a variety of backgrounds in control engineering, applied mathematics and computer science.