State constrained reachability for stochastic hybrid systems

Abstract

Many control problems can be formulated as driving a system to reach some target states while avoiding some unwanted states. We study this problem for systems with regime change operating in uncertain environments. Nowadays, it is a common practice to model such systems in the framework of stochastic hybrid system models. In this casting, the problem is formalized as a mathematical problem named state constrained stochastic reachability analysis. In the state constrained stochastic reachability analysis, this probability is computed by imposing a constraint on the system to avoid the unwanted states. The scope of this paper is twofold. First we define and investigate the state constrained reachability analysis in an abstract mathematical setting. We define the problem for a general model of stochastic hybrid systems, and we show that the reach probabilities can be computed as solutions of an elliptic integro-differential equation. Moreover, we extend the problem by considering randomized targets. We approach this extension using stochastic dynamic programming. The second scope is to define a developmental setting in which the state constrained reachability analysis becomes more tractable. This framework is based on multilayer modelling of a stochastic system using hierarchical viewpoints. Viewpoints represent a method originated from software engineering, where a system is described by multiple models created from different perspectives. Using viewpoints, the reach probabilities can be easily computed, or even symbolically calculated. The reach probabilities computed in one viewpoint can be used in another viewpoint for improving the system control. We illustrate this technique for trajectory design.