Memory formation is contingent on molecular and structural changes in neurons in response to learning stimuli-a process known as neuronal plasticity. The initiation step of mRNA translation is a gatekeeper of long-term memory by controlling the production of plasticity-related proteins in the brain. The mechanistic target of rapamycin complex 1 (mTORC1) controls mRNA translation, mainly through phosphorylation of the eukaryotic initiation factor 4E (eIF4E)-binding proteins (4E-BPs) and ribosomal protein S6 kinases (S6Ks). mTORC1 signaling decreases throughout brain development, starting from the early postnatal period. Here, we discovered that in mice, the age-dependent decrease in mTORC1 signaling occurs selectively in excitatory but not inhibitory neurons. Using a gene conditional knockout (cKO) strategy, we demonstrate that either up- or downregulating the mTORC1-4E-BP2 axis in GAD65 inhibitory interneurons, but not excitatory neurons, results in long-term object recognition and object location memory deficits. Our data indicate that the mTORC1 pathway in inhibitory but not excitatory neurons plays a key role in memory formation.