Mothers of offspring with autism spectrum disorders (ASD) could present mild forms of their children’s cognitive characteristics, resulting from prenatal brain exposure and sensitivity to testosterone (T). Indeed, their cognition is frequently characterized by hyper-systemizing, outperforming in tests that assess cognitive domains such as selective attention, and fine motor and visuospatial skills. In the general population, all these start to decline around the mid-forties. This study aimed to characterize whether middle-aged women who are biological mothers of individuals with ASD had better performance in the aforementioned cognitive skills than mothers of normative children (in both groups n = 22; mean age = 45), using the standardized Stroop and mirror-drawing tests. We also examined the role of T in their performance in the aforementioned tests. ASD mothers outperformed controls in both tests, giving more correct answers and making fewer mistakes. In addition, they presented higher T levels, which have been associated with better cognitive performance. Cognitive decline in specific skills with aging could be delayed in these middle-aged women, corresponding to a cognitive endophenotype, T playing an important role in this process.