Hybrid optimal impulse control

Abstract

This paper is concerned with an optimal impulse control problem under a hybrid diffusion (or, regime switching) model, where the state of the system consists of a number of diffusions coupled by a continuous-time finite-state Markov chain. The objective is to minimize the expected discounted cost from exerting the impulse control in the infinite horizon. Based on the dynamic programming principle (DPP), the value function of the hybrid optimal impulse control problem is shown to be the unique viscosity solution to the associated Hamilton–Jacobi–Bellman (HJB) equation, which is in the form of a coupled system of variational inequalities. Moreover, a verification theorem as the sufficient condition for optimality of a solution is also established. The optimal impulse control, indicates when and how it is optimal to intervene, is described by the obstacle part of the HJB equation. Finally, the general theoretical results are applied to an optimal cash management problem. The value function in closed-form and an explicit optimal policy are obtained, which exhibit clearly the effect of regime switching on the agent’s decision.