Herbivorous reef fishes control algal growth and are critical for maintaining reef health. Grazing effects vary due to community composition, so a diverse herbivore community is important for preventing phase shifts from coral to algal-dominated reefs. However, herbivore communities and grazing effects vary spatially, resulting in non-uniform distribution of algal mitigation across the seascape. Therefore, understanding how habitat influences herbivore communities is essential for predicting the spatial distribution of these species' ecological services. This study used underwater visual surveys (n = 5455) to examine how habitat influences spatial patterns of herbivorous fish densities and species richness in the Florida Keys and Dry Tortugas, Florida. Herbivorous fishes were ubiquitous, and communities were dominated by small herbivores such as damselfishes (Pomacentridae), gobies (Gobiidae), surgeonfishes (Acanthuridae), and small- to medium-bodied parrotfishes (subfamily Scarinae). A suite of factors influenced herbivorous fish communities but boosted regression tree results showed that habitat relief, depth, and spatial location within the Florida Keys and Dry Tortugas were the most important factors. In general, herbivore occurrence, density, and species richness increased as percent of low relief hardbottom habitat (<0.2 m high) decreased. In addition, density and occurrence of herbivores generally increased at shallower depths. Spatial location influenced the density of herbivores with potential hotspots predominantly located in the Upper Keys and the Dry Tortugas Bank. These data provide a valuable understanding of the spatial distribution of herbivorous reef fishes, and aid management decisions regarding the protection and sustainability of herbivore resources and the ecosystems that rely on them.