Background: Recent findings indicate that leisure activity (LA) delays cognitive decline and reduces the risk of dementia. However, the association between LA and brain volume remains unclear. This study aimed to examine the association between LA variety and brain volume with a focus on the hippocampus and gray matter.Methods: Data were obtained from the baseline survey of the Neuron to Environmental Impact across Generations study, which had targeted community-dwelling older adults living in Niigata, Japan. We divided LAs into 10 categories, and counted the number of categories of activities in which the participants engaged. We classified them as follows: 0 (i.e., no activity), 1, 2, or ≥ 3 types. Brain volume was assessed through magnetic resonance imaging, and hippocampal and gray matter volumes were ascertained.Results: The sample size was 482. Multiple linear regression analysis showed that hippocampal and gray matter volumes were significantly greater among participants with ≥ 3 types of LAs than among their no-activity counterparts. Hippocampal volume was significantly greater among those who engaged in one type of LA than among those who engaged in no such activity. Sex-stratified analysis revealed that hippocampal volumes were significantly greater among males who engaged in ≥ 3 types of LAs and one type of LA. However, no such association was found among females.Conclusion: The present findings suggest that engaging in a wide range of LAs is related to hippocampal and gray matter volumes. Furthermore, there was a sex difference in the association between LA variety and brain volume.