Abstract
This work develops asymptotically optimal controls for a class of discrete-time hybrid systems involving singularly perturbed Markov chains having weak and strong interactions. The state space of the underlying Markov chain is decomposed into a number of recurrent classes and a group of transient states. Using a hierarchical control approach, by aggregating the states in each recurrent class into a single state, a continuous-time quadratic limit control problem in which the resulting limit Markov chain has much smaller state space is derived. Using the optimal control for the limit problem, a control for the original problem is constructed, which is shown to be nearly optimal. Finally, a numerical example is given to demonstrate the effectiveness of the approximation scheme.
Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
