It’s of great challenge to address for heavy metal-contaminated soil. Once the farmland is contaminated with heavy metals, the microbial ecology of the plant rhizosphere will change, which in turn impacts crop productivity and quality. However, few studies have explored the effects of heavy metals on plant rhizosphere microbes in farmland and the role that plant cultivation plays in such a phytoremediation practice. In this study, the impacts of comfrey (Symphytum officinale L.) cultivation and the stresses of cadmium/zinc (Cd/Zn) on rhizosphere soil microflora were examined. Microbial DNA was collected from soils to evaluate the prevalence of bacteria and fungi communities in rhizosphere soils. High-throughput 16 S rRNA sequencing was used to determine the diversity of the bacterial and fungal communities. The results showed that growing comfrey on polluted soils reduced the levels of Cd and Zn from the vertical profile. Both the comfrey growth and Cd/Zn stresses affected the community of rhizosphere microorganisms (bacteria or fungi). Additionally, the analysis of PCoA and NMDS indicated that the cultivation of comfrey significantly changed the bacterial composition and structure of unpolluted soil. Comfrey cultivation in polluted and unpolluted soils did not result in much variance in the fungi’s species composition, but the fungal compositions of the two-type soils were noticeably different. This work provided a better understanding of the impacts of Cd/Zn stresses and comfrey cultivation on rhizosphere microbial community, as well as new insight into phytoremediation of heavy metal-contaminated soils.