Livestock grazing is often used as a land management tool to maximize vegetation diversity in grassland ecosystems worldwide. Prior research has shown that cattle grazing benefits native annual forb species in California's coastal prairies, but drought and increasing aridity may alter this relationship. In 2016 and 2017, we resurveyed the vegetation structure, native annual forb cover, and native annual forb richness in ten grazed and ungrazed prairies that were originally measured in 2000 and 2001 along a 200-km gradient from Monterey to Sonoma counties in California. We found that grazed prairies continued to have significantly lower vegetation height and thatch depth than ungrazed prairies, and that shrub encroachment over the 15-year period was significantly greater in ungrazed prairies. Furthermore, grazed prairies continued to have greater native annual forb richness (4.9 species per site) than ungrazed sites (3.0 species per site), but native annual forb richness declined by 2.8 species per site in grazed prairies and 0.1 species per site in ungrazed prairies between survey periods. We suggest that severe drought and increasing aridity may be driving declines in native annual forb richness in grazed prairies. The species we recorded only in earlier surveys were disproportionately wetland-associated and had higher average specific leaf area than species that remained through the second survey period. Finally, the cover of native annual species increased regardless of whether prairies were grazed, suggesting that the high precipitation in 2017 may have benefitted the native annual forb species that persisted at sites between surveys. Our study shows that weather conditions affect the outcomes of land management strategies.