Repetition of a stimulus results in decreased responses in many cortical areas. This so-called adaptation or repetition suppression has been used in several human functional magnetic resonance imaging studies to deduce the stimulus selectivity of neuronal populations. We tested in macaque monkeys whether the degree of neural adaptation depends on the similarity between the adapter and test stimulus. To manipulate similarity, we varied stimulus size. We recorded the responses of single neurons to different-sized shapes in inferior temporal (IT) and prefrontal cortical (PFC) areas while the animals were engaged in a size or shape discrimination task. The degree of response adaptation in IT decreased with increasing size differences between the adapter and the test stimuli in both tasks, but the dependence of adaptation on the degree of similarity between the adapter and test stimuli was limited mainly to the early phase of the neural response in IT. PFC neurons showed only weak size-contingent repetition effects, despite strong size selectivity observed with the same stimuli. Thus, based on the repetition effects in PFC, one would have erroneously concluded that PFC shows weak or no size selectivity in such tasks. These findings are relevant for the interpretation of functional magnetic resonance adaptation data: they support the conjecture that the degree of adaptation scales with the similarity between adapter and test stimuli. However, they also show that the temporal evolution of adaptation during the course of the response, and differences in the way individual regions react to stimulus repetition, may complicate the inference of neuronal tuning from functional magnetic resonance adaptation.