This paper proposes to leverage intelligent reflecting surface (IRS) backscatter to implement downlink communications for a multi-cell multiple-input multiple-output (MIMO) network, which represents a brand-new communication framework. In such a network, one active macro cell base station (MBS) is deployed for radiating energy signal, while each IRS acts as a small cell base station to realize its own information transmission by modulating and reflecting the signal from the MBS. Under this paradigm, we investigate two optimization problems, namely weighted sum rate maximization problem and max-min fairness problem, aiming at satisfying different communication requirements. To seek their optimal solutions, Lagrangian dual transform and alternate methods are employed to optimize the active beamforming vector at the MBS and the passive beamforming vectors at all the IRSs. Additionally, an element clustering scheme is developed to reduce computation and control complexity, in which each element cluster works like a unit and all clusters can collaborate to communicate with users. Extensive simulations are conducted to evaluate the achievable communication performance and to verify the feasibility of the proposed IRS backscatter enabled downlink multi-cell MIMO network.