Livestock grazing may affect small mammalian herbivore-soil microbe interactions and their association with the structure and functions of the ecosystem. However, the role of factors such as vegetation and soil nutrients in regulating these impacts is not clear. Here we conducted a 9-year experiment in temperate steppe to study how Brandt’s vole (Lasiopodomys brandtii) affects the soil microbial community under different livestock grazing intensities. This experiment contained 12 field enclosures with three livestock grazing intensities: control (CK), light grazing (LG), and moderate grazing (MG). We found that vole activity does not significantly change soil microbial diversity under non-grazing conditions. However, under livestock grazing conditions, vole activity led to a significant reduction in soil bacterial diversity and an increase in fungal diversity, demonstrating the impacts of livestock grazing on rodents-soil microbe interactions. The activity of voles significantly altered soil bacterial community composition, with changes primarily attributed to variations in the relative abundance of the phyla Actinobacteria, Bacteroidetes, Firmicutes, Gemmatimonadetes, and Proteobacteria. The soil fungal community remained relatively stable despite vole activity, which can be attributed to the richness of fungal colonies in mycelium and their low sensitivity to changes in external conditions. Vole activity also influenced soil microbial functional groups, and the variations in these groups were further amplified by livestock grazing. Furthermore, the shift in the microbial community composition and diversity induced by vole activity were mainly associated with the reduction of plant aboveground biomass. Overall, our study suggested that livestock grazing enhanced the changes in the soil microbial community induced by rodents, underscoring the importance of managing livestock grazing regimes for grassland conservation.