Developmental synapse elimination is crucial for shaping mature neural circuits. In the neonatal mouse cerebellum, Purkinje cells (PCs) receive excitatory synaptic inputs from multiple climbing fibers (CFs) and synapses from all but one CF are eliminated by around postnatal day 20. Heterosynaptic interaction between CFs and parallel fibers (PFs), the axons of cerebellar granule cells (GCs) forming excitatory synapses onto PCs and molecular layer interneurons (MLIs), is crucial for CF synapse elimination. However, mechanisms for this heterosynaptic interaction are largely unknown. Here we show that deletion of AMPA-type glutamate receptor functions in GCs impairs CF synapse elimination mediated by metabotropic glutamate receptor 1 (mGlu1) signaling in PCs. Furthermore, CF synapse elimination is impaired by deleting NMDA-type glutamate receptors from MLIs. We propose that PF activity is crucial for CF synapse elimination by directly activating mGlu1 in PCs and indirectly enhancing the inhibition of PCs through activating NMDA receptors in MLIs.