Abstract Lantana camara L. (Verbenaceae) is recognised as a problematic invasive alien plant species in many parts of the world. To eradicate or control this global invader, we need to understand the drivers of its spread and impacts and the potential for native recovery after the invader has been removed. Here, we tested for species associations between L. camara and native plant species and large herbivores in Queen Elizabeth National Park, Uganda. We inventoried 40,100‐m2 nested plots spread over a 1 × 1‐km grid cell in the park's savanna landscape, with 11 plots located in uninvaded areas. Most of the plots (30 of 40) had been affected by fire. Lantana camara covered 29 (73%) plots, 11 (38%) of which were in open grassland. Of the large herbivores that frequented areas free of L. camara, the Ugandan kob Adenota kob thomasi Sclater tended to avoid the areas invaded. The floristic composition of invaded areas differed significantly from that of noninvaded areas, with several palatable species rare or absent from L. camara‐invaded areas. Practical implication: These observations indicate the presence of potential recovery constraints that will need to be overcome after L. camara has been removed. Sustained efforts will be needed to suppress the invader and subsequently enrich and bolster native recovery.