Human-induced disturbances to ecosystems cause a direct loss of biodiversity, and also alter the inherent processes that shape ecosystems even after the main disturbance has ceased. Therefore, is it important to understand the ongoing consequences of past and present land use practices on both above- and belowground components of agroecosystems. Our study takes a detailed investigation of what shapes communities in semi-natural grasslands under long-term management as either pastures or meadows. We investigated the relative importance of land use (land management (LM) and land use intensity (LUI)) and abiotic conditions (soil, topographic, climatic) across five grassland sites in central Germany in explaining species occurrence patterns of vascular plants and soil fungi. Analyses included a hierarchical joint-species distribution modeling approach to uncover the role of possible drivers shaping the local communities. Our results show that abiotic factors are of particularly high importance compared to LM and LUI for both vascular plant and soil fungal communities. In general, the relative importance of explanatory variables was similar across both taxon groups, however, for plant communities, local climate conditions were more important, while for fungal communities the soil variables (e.g., soil acidity and fertility including soil carbon and potassium concentrations) played a more prominent role. Species-specific responses to the respective variables showed some similarity across the taxon groups, however less so than expected given the long legacy of past LM. Here we found that approximately 50% of the plant and fungi species had clear LM preferences and responses to LUI. More plant species were positively related to pasture than meadow management, while the opposite was found for fungal species. Our findings advance the understanding of how abiotic conditions and human land use impact local species communities in managed semi-natural grasslands, aiding further research and policy development for conserving multitrophic diversity within these biodiversity rich habitats. Our results highlight the importance of controlling for soil and climate in studying the impact of land use, and of considering the environmental context at both small and larger spatial grains when making land management and biodiversity conservation decisions. In so doing, the complexity of ecological processes within managed systems are accounted for and prioritized, promoting both conservation and ecological functioning of the agroecosystem. Plant data is archived on PANGAEA (Kautzner, Auge, Roscher, Baessler & Slabbert, 2020; https://doi.org10.1594/PANGA EA.919343) and the soil microbial data on the National Center for Biotechnology Information (NCBI) Sequence Read Archive (SRA) under the accession PRJNA563995 (Kautzner, Baessler, Auge, Roscher & Wubet, 2020)