At present, the relationship between the diversity distribution patterns of different taxonomic levels of plants and climatic factors is still unclear. This paper explored the diversity pattern of vascular plant families, genera, and species in China at the municipal scale. It also studied the effects of accumulated temperature ≥ 10°C, annual precipitation, and hydrothermal base which reflect the effect of hydrothermal resources on the plant diversity pattern. The results showed that: There were extremely significant correlations among the diversities of plant families, genera, and species, and the interpretation degree of diversity between adjacent the taxonomic levels was more than 90%. The diversity pattern of plant families was mainly affected by dominant climatic state indicators such as the maximum value of accumulated temperature, annual precipitation, and hydrothermal base, and the gradient range of the hydrothermal base, which showed a clear latitudinal gradient law. The diversity pattern of plant species was found to be mainly dependent on the climatic heterogeneity indicators, being closely related to the heterogeneity indicators and sum indicators of the hydrothermal base. It was also affected by the range of precipitation gradient range. Plant genus and its diversity pattern are not only significantly affected by heterogeneity and sum indicators but also closely related to climate state indicators. In comparison with the humidity index in vegetation ecological studies, the related indicators of the hydrothermal base proposed in this paper excelled at revealing the relationship between climate and diversity patterns of plant families, genera, and species, and could effectively solve the species-area relationship issue in arid and low-temperature areas. The results of this paper have presented important theoretical and practical values for comprehensively understanding the correlation between climate and diversity of plant families, genera, and species, clarifying the impact of climate difference and climate change on plant diversity.