The optimum stochastic control for a problem with random cost incursion times

Abstract

A sequential stochastic control problem is considered in which the performance criterion cost is incremented periodically at random times. Although these cost incursion times are unknown, they are governed by a known prior probability density function. The optimum Bayesian control decision strategy is obtained by solving the stochastic dynamic programming equation. As anticipated, the solution exhibits a type of separation principle.