A Constructive Study of Markov Equilibria in Stochastic Games with Strategic Complementarities

Abstract

We study a class of infinite horizon, discounted stochastic games with strategic complementarities. In our class of games, we prove the existence of a Stationary Markov Nash equilibrium, as well as provide methods for constructing this least and greatest equilibrium via a successive approximation scheme. We also provide new results on computable equilibrium monotone comparative statics results relative to ordered perturbations of the space of stochastic games. Under slightly stronger assumptions, we prove the stationary Markov Nash equilibrium values form a complete lattice, with least and greatest equilibrium value functions being the uniform limit of these successive approximations starting from pointwise lower and upper bounds.