Discrete-time Markov Decision Process Research Articles