Glycine can persistently potentiate or depress AMPA responses through differential actions on two binding sites: NMDA and glycine receptors. Whether glycine can induce long-lasting modifications in NMDA responses, however, remains unknown. Here, we report that glycine induces long-term potentiation (LTP) or long-term depression (LTD) of NMDA responses (Gly-LTP(NMDA) or Gly-LTD(NMDA)) in a dose-dependent manner in hippocampal CA1 neurons. These modifications of NMDA responses depend on NMDAR activation. In addition, the induction of Gly-LTP(NMDA) requires binding of glycine with NMDARs, whereas Gly-LTD(NMDA) requires that glycine bind with both sites on NMDARs and GlyRs. Moreover, activity-dependent exocytosis and endocytosis of postsynaptic NMDARs underlie glycine-induced bidirectional modification of NMDA excitatory postsynaptic currents. Thus, we conclude that glycine at different levels induces bidirectional plasticity of NMDA responses through differentially regulating NMDA receptor trafficking. Our present findings reveal important functions of the two glycine binding sites in gating the direction of synaptic plasticity in NMDA responses.