Two adaptively stepped monotone algorithms for solving discrete dynamic programming equations (DPE) for discounted Markov decision processes are introduced. They are based on, and improve two existing algorithms of the author by adopting an extra line search procedure. The new algorithms remain convergent.
Read full abstract