In this paper, we investigate the topological interference management (TIM) for MIMO interference broadcast channels (IBC) under the fixed topology, where only topology information is needed to cancel the inter-cell interference (ICI). For the single user case, where the MIMO IBC network is reduced to the MIMO interference channel (IC) networks, we propose one novel TIM scheme by exploiting the solution to the corresponding SISO IC TIM based on topology information. And also, we present one theorem to characterize the achievable degrees of freedom (DoFs). For the multiple user case, assuming that each BS not only knows topology information but also knows the channel state information at transmitters (CSIT) within its own cell, we propose two novel TIM schemes, i.e., the virtual user compression-based scheme and the virtual base station extension-based scheme. For each scheme, we design transceivers to cancel both the ICI only based on the topology information by exploiting the solution to the corresponding SISO IC TIM and the multiple user interference (MUI) within its own cell based on the CSIT. Furthermore, we present one theorem to characterize the achievable DoF, respectively. Moreover, we prove that the DoF achieved by the virtual base station extension-based scheme is higher than or equal to that achieved by the virtual user compression-based scheme. Hence, the achievable DoF of MIMO IBC TIM is lower bounded by the optimal DoF attainable for the base station extension scheme. Furthermore, the numerical results show that our schemes can achieve significant performance gain against the traditional interference avoidance scheme.