FreeSurfer software was employed to measure cortical thickness and subcortical structural volumes. Axonal connections, indexed by fractional anisotropy, (FA) were measured with diffusion tensor imaging, and functional connectivity with resting state fMRI. Compared to men, CAIS women displayed a "female" pattern by having thicker parietal and occipital cortices, lower FA values in the right corticospinal, superior and inferior longitudinal tracts, and corpus callosum. Their functional connectivity from the amygdala to the medial prefrontal cortex, was stronger and amygdala-connections to the motor cortex weaker than in control men. CAIS and control women also showed stronger posterior cingulate and precuneus connections in the default mode network. Thickness of the motor cortex, the caudate volume, and the FA in the callosal body followed, however, a "male" pattern. Altogether, these data suggest that testosterone modulates the microstructure of somatosensory and visual cortices and their axonal connections to the frontal cortex. Testosterone also influenced functional connections from the amygdala, whereas the motor cortex could, in agreement with our previous reports, be moderated by processes linked to X-chromosome gene dosage. These data raise the question about other genetic factors masculinizing the human brain than the SRY gene and testosterone. Hum Brain Mapp 38:1801-1814, 2017. © 2017 Wiley Periodicals, Inc.