This article considers the optimal portfolio selection problem in a dynamic multi-period stochastic framework with regime switching. The risk preferences are of exponential (CARA) type with an absolute coefficient of risk aversion that changes with the regime. The market model is incomplete and there are two risky assets: tradable and non-tradable. In this context, the optimal investment strategies are time inconsistent. Consequently, the subgame perfect equilibrium strategies are considered. The utility indifference ask price of a contingent claim written on the risky assets is computed through an indifference valuation algorithm. By running numerical experiments, we examine how this price varies in response to changes in model parameters.