Verbal short-term and long-term memory are crucial neuropsychological functions involved in core cognitive abilities. They constitute vital components of subjective well-being and academic achievement. To date, there is limited research on the association between regular physical activity and memory abilities during young adulthood. The Individual Alpha Peak Frequency (IAPF) contributes to various cognitive abilities and also appears to be sensitive to physical activity. Consequently, the IAPF has the potential to underlie the association between physical activity and verbal memory. We examined the direct relation of physical activity and verbal memory, and the potential indirect relation via IAPF in young adults. Regular physical activity was assessed via accelerometry on seven consecutive days in 115 participants (N=115, 48% female) aged 18-35 years (M=24.1, SD=3.8). In addition, verbal memory performance was assessed using an immediate and delayed free-recall task. Brain activity during rest was recorded with EEG, and IAPF was extracted for mediation analyses. Path analysis revealed pronounced sex differences in the association between physical activity, IAPF, and verbal memory performance. Exclusively in female participants, higher vigorous physical activity levels were associated with better recall performance. In contrast, no association of physical activity and memory was found in male participants. However, being more physically active was related to a higher IAPF exclusively in male participants. Physical activity shows differential associations between IAPF and verbal memory in male and female participants. However, the lack of a mediating role of IAPF suggests that this neurophysiological marker cannot explain these specific associations in young adults.