There is little quantitative information about the relationship between root traits and the extent of arbuscular mycorrhizal fungi (AMF) colonization. We expected that ancestral species with thick roots will maximize AMF habitat by maintaining similar root traits across root orders (i.e., high root trait integration), whereas more derived species are expected to display a sharp transition from acquisition to structural roots. Moreover, we hypothesized that interspecific morphological differences rather than soil conditions will be the main driver of AMF colonization. We analyzed 14 root morphological and chemical traits and AMF colonization rates for the first three root orders of 34 temperate tree species grown in two common gardens. We also collected associated soil to measure the effect of soil conditions on AMF colonization. Thick-root magnoliids showed less variation in root traits along root orders than more-derived angiosperm groups. Variation in stele:root diameter ratio was the best indicator of AMF colonization within and across root orders. Root functional traits rather than soil conditions largely explained the variation in AMF colonization among species. Not only the traits of first order but the entire structuring of the root system varied among plant lineages, suggesting alternative evolutionary strategies of resource acquisition. Understanding evolutionary pathways in belowground organs could open new avenues to understand tree species influence on soil carbon and nutrient cycling.