Herbivores drive shifts in plant species composition by interacting with vegetation through defoliation, trampling and nutrient addition: urine and faeces. As herbivore effects on vegetation accumulate over time, they might spillover to other trophic levels, but how and when this happens is poorly understood. Since it is methodologically demanding to measure biodiversity across spatial gradients, an alternative approach is to assess it through biodiversity indices of vascular plants. We employed the Index of biodiversity relevance developed for Swedish flora which provides an estimated number of organisms associated with a plant species, allowing the quantification of trophic community size. Values from this index were coupled with vegetation data from a network of 96 fenced and paired grazed plots across Fennoscandia. We analysed the role herbivory has on plant richness and diversity, and on the number of organisms that interact with the vegetation according to the index values. We also explored how herbivores influence the competitive effects of tall shrubs on other plants since the dominance of a vegetation type links directly to biodiversity. Plant diversity had no clear response to grazing. Overall vegetation and the vegetation subgroups herbs and non‐fruit shrubs had higher biodiversity index values in fenced plots, indicating a higher number of plant–host interactions. Herb cover was negatively related to shrubs in both treatments but with a faster decline in the absence of herbivores. This study highlights the importance of maintaining herbivore populations in the Arctic to conserve the vegetation structure and biodiversity of the tundra. This method of coupling biodiversity indexes with vegetation data provides complementary information to the plant diversity, especially when methodological or time constraints prevent complete field inventories.