Ammonia oxidation is a crucial process in global nitrogen cycling, which is catalyzed by the ammonia oxidizers. Emergent plants play important roles in the freshwater ecosystem. Therefore, it is meaningful to investigate the effects of emergent macrophytes on the abundance and community composition of ammonia oxidizers. In the present study, two commonly found emergent macrophytes (Zizania caduciflora and Phragmitas communis) were obtained from freshwater lakes and the abundance and community composition of the ammonia-oxidizing prokaryotes in the rhizosphere sediments of these emergent macrophytes were investigated. The abundance of the bacterial amoA gene was higher in the rhizosphere sediments of the emergent macrophytes than those of bulk sediments. Significant positive correlation was found between the potential nitrification rates (PNRs) and the abundance of bacterial amoA gene, suggesting that ammonia-oxidizing bacteria (AOB) might play an important role in the nitrification process of the rhizosphere sediments of emergent macrophytes. The Nitrosotalea cluster is the dominant ammonia-oxidizing archaea (AOA) group in all the sediment samples. Analysis of AOB group showed that the N. europaeal cluster dominated the rhizosphere sediments of Z. caduciflora and the bulk sediments, whereas the Nitrosospira cluster was the dominant AOB group in the rhizosphere sediments of P. communis.