Glyphosate (N-(phosphonomethyl)glycine) is broad-spectrum herbicide that is extensively used worldwide, but its effects on the soil microbiome are inconsistent. To provide a sound scientific basis for herbicide re-review and registration decisions, we conducted a four-year (2013–2016) study in which we consecutively applied glyphosate to a wheat (Triticum aestivum L.)–field pea (Pisum sativum L.)–canola (Brassica napus L.)–wheat crop rotation at five sites in the Canadian prairies. The glyphosate rates were 0, 1, 2, 4 and 8 kg ae ha−1, applied pre-seeding and post-harvest every year. The wheat rhizosphere was sampled in the final year of the study and analysed for microbial biomass C (MBC), the composition and diversity of the microbiome, and activities of β-glucosidase, N-acetyl-β-glucosiminidase, acid phosphomonoesterase and arylsulphatase. Glyphosate did not affect MBC, the composition and diversity of prokaryotes and fungi, and the activities of three of the four enzymes measured in the wheat rhizosphere. The one effect of glyphosate was a wave-like response of N-acetyl-β-glucosaminidase activity with increasing application rates. The experimental sites had much greater effects, driven by soil pH and organic C, on the soil microbiome composition and enzyme activities than glyphosate. Soil pH was positively correlated with the relative abundance of Acidobacteriota but negatively correlated with that of Actinobacteriota and Basidiomycota. Soil organic C was positively correlated with the relative abundances of Proteobacteriota and Verrucomicrobiota, but negatively correlated with the relative abundance of Crenachaeota. The activity of acid phosphomonoesterase declined with increasing relative abundance of Acidobacteriota, but increased with that of Actinobacteriota and Basidiomycota. The activity of N-acetyl-β-glucosaminidase also increased with increasing relative abundance of Actinobacteriota but decreased with that of Mortierellomycota. β-glucosidase activity also decreased with increasing relative abundance of Mortierellomycota. The core fungal species observed in at least 90% of the samples were Humicola nigrescens, Gibberella tricincta and Giberella fujikuroi. Therefore, this multi-site study on the Canadian prairies revealed no significant effects of 4-year applications of glyphosate applied at different rates on most soil microbial properties despite differences in the properties among sites. However, it is important to keep evaluating glyphosate effects on the soil microbiome and its functioning because it is the most widely used herbicide worldwide.