Extreme multistability (EM) is characterized by the emergence of infinitely many coexisting attractors or continuous families of stable states in dynamical systems. EM implies complex and hardly predictable asymptotic dynamical behavior. We analyze a model for pendulum clocks coupled by springs and suspended on an oscillating base and show how EM can be induced in this system by specifically designed coupling. First, we uncover that symmetric coupling can increase the dynamical complexity. In particular, the coexistence of multiple isolated attractors and continuous families of stable periodic states is generated in a symmetric cross-coupling scheme of four pendulums. These coexisting infinitely many states are characterized by different levels of phase synchronization between the pendulums, including anti-phase and in-phase states. Some of the states are characterized by splitting of the pendulums into groups with silent sub-threshold and oscillating behavior, respectively. The analysis of the basins of attraction further reveals the complex dependence of EM on initial conditions.