Abstract
We consider eight problems in which we maximize or minimize threshold probabilities in discounted Markov decision processes with bounded reward set. We show that such problems are classified to two equivalence classes and give a relationship between optimal values and optimal policies of problems in each equivalence class. Literatures relative to such problems deal with only first equivalence class (cf. White(1993), Wu and Lin(1999) and Ohtsubo and Toyonaga(2002)). We consider a problem of the second equivalence class in the same situation as Ohtsubo and Toyonaga and characterize optimal values in finite and infinite horizon cases, by using an argument of a dual problem. We also give two sufficient conditions for the existence of an optimal policy. Finally we give a relationship of optimal values between first and second equivalence classes.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.