Adult behavior is commonly thought to be shaped by early-life experience, although episodes experienced during infancy appear to be forgotten. Exposing male rats during infancy to discrete spatial experience we show that these rats in adulthood are significantly better at forming a spatial memory than control rats without such infantile experience. We moreover show that the adult rats’ improved spatial memory capability is mainly based on memory for context information during the infantile experiences. Infantile spatial experience increased c-Fos activity at memory testing during adulthood in the prelimbic medial prefrontal cortex (mPFC), but not in the hippocampus. Inhibiting prelimbic mPFC at testing during adulthood abolished the enhancing effect of infantile spatial experience on learning. Adult spatial memory capability only benefitted from spatial experience occurring during the sensitive period of infancy, but not when occurring later during childhood, and when sleep followed the infantile experience. In conclusion, the infantile brain, by a sleep-dependent mechanism, favors consolidation of memory for the context in which episodes are experienced. These representations comprise mPFC regions and context-dependently facilitate learning in adulthood.