Sexual experience improves copulatory performance in male rats. Copulatory performance has been associated with dendritic spines density in the medial prefrontal cortex (mPFC) and nucleus accumbens (NAcc), structures involved in the processing of sexual stimuli and the manifestation of sexual behavior. Dendritic spines modulate excitatory synaptic contacts, and their morphology is associated with the ability to learn from experience. This study was designed to determine the effect of sexual experience on the density of different types or shapes of dendritic spines in the mPFC and NAcc of male rats. A total of 16 male rats were used, half of them were sexually experienced while the other half were sexually inexperienced. After three sessions of sexual interaction to ejaculation, the sexually-experienced males presented shorter mount, intromission, and ejaculation latencies. Those rats presented a higher total dendritic density in the mPFC, and a higher numerical density of thin, mushroom, stubby, and wide spines. Sexual experience also increased the numerical density of mushroom spines in the NAcc. In both the mPFC and NAcc of the sexually experienced rats, there was a lower proportional density of thin spines and a higher proportional density of mushroom spines. Results show that the improvement in copulatory efficiency resulting from prior sexual experience in male rats is associated with changes in the proportional density of thin and mushroom dendritic spines in the mPFC and NAcc. This could represent the consolidation of afferent synaptic information in these brain regions, derived from the stimulus-sexual reward association.