The multi-leader–follower game has many applications such as the bilevel structured market in which two or more enterprises, called leaders, have initiatives, and the other firms, called followers, observe the leaders’ decisions and then decide their own strategies. A special case of the game is the Stackelberg model, or the single-leader–follower game, which has been studied for many years. The Stackelberg game may be reformulated as a mathematical program with equilibrium constraints, which has also been studied extensively in recent years. On the other hand, the multi-leader–follower game may be formulated as an equilibrium problem with equilibrium constraints, in which each leader’s problem is an mathematical program with equilibrium constraints. However, finding an equilibrium point of an equilibrium problem with equilibrium constraints is much more difficult than solving a single mathematical program with equilibrium constraints, because each leader’s problem contains those variables which are common to other players’ problems. Moreover, the constraints of each leader’s problem depend on the other rival leaders’ strategies. In this paper, we propose a Gauss–Seidel type algorithm with a penalty technique for solving an equilibrium problem with equilibrium constraints associated with the multi-leader–follower game, and then suggest a refinement procedure to obtain more accurate solutions. We discuss convergence of the algorithm and report some numerical results to illustrate the behavior of the algorithm.