Identifying the ecological forces that structure root-associated microbial communities is an essential step toward more sustainable agriculture. Legumes are widely utilized as model plants to study selective forces and their functioning in plant-microbial interactions owing to their ability to establish mutualism with rhizobia. Root nodules act as symbiotic organs to optimize the cost-benefit balance in this mutualistic relationship by modulating the number of nodules. However, it is not known whether the number of nodules is related to the structure of root-associated bacterial communities. Here, the root-associated bacterial communities of soybean grown in native soil by means of soybean cultivars with super- or normal nodulation were investigated across four developmental stages. We compared ecological processes between communities and found decreased relative importance of neutral processes for super-nodulating soybean, although the overall structures resembled those of normal-nodulating soybean. We identified the generalist core bacterial populations in each root-associated compartment, that are shared across root-associated niches, and persist through developmental stages. Within core bacterial species, the relative abundances of bacterial species in the rhizosphere microbiome were linked to host-plant functional traits and can be used to predict these traits from microbes using machine learning algorithms. These findings broaden the comprehensive understanding of the ecological forces and associations of microbiotas in various root-associated compartments and provide novel insights to integrate beneficial plant microbiomes into agricultural production to enhance plant performance.