Spontaneous vegetation is an important component of urban biodiversity and an excellent agent for exploring the mutual feedback mechanism between urbanization and urban ecosystems. Rapid urbanization has had a significant impact on the composition, structure, and distribution patterns of urban spontaneous vegetation diversity. Studying the diversity distribution patterns and causes of urban plant communities is beneficial for understanding the formation and maintenance mechanisms of plant diversity in specific urban habitats. This study selected five cities in different climate subregions of Heilongjiang Province as research targets and conducted field research using uniform sampling and typical sampling methods. The composition, distribution pattern, and driving factors of spontaneous vegetation were analyzed. The results showed the following: (1) A total of 633 examples of spontaneous vegetation were recorded, belonging to 93 families and 341 genera, mainly consisting of herbaceous plants and native plants. (2) The diversity index and similarity index of spontaneous vegetation in gravel-type abandoned land habitats are higher than those in other habitat types, while the diversity index of spontaneous vegetation in trees and shrubs is lower, and there is no significant difference in regards to different habitats. (3) Urban population density is a key factor affecting the diversity of native plants, while woody plant coverage, patch area, and landscape trait index are key factors affecting non-native plants. (4) The results of canonical correspondence analysis (CCA) showed that the total explanatory power of environmental characteristic factors in regards to the distribution pattern of spontaneous vegetation was 7.5%. The closest distance between adjacent patches, the coverage of woody plants in patches, the distance from the city edge, the patch area, and the surface impermeability of the buffer zones were key factors affecting the distribution of dominant species in spontaneous vegetation communities. The research results will provide an important reference for the conservation of urban biodiversity and the construction of low-maintenance urban green space plant landscapes in Heilongjiang Province.