Rhizo-box experiments were conducted to analyze the phyto-microbial remediation potential of a grass (Lolium multiflorum L.) and a crop (Glycine max L.) combined with exogenous strain (Pseudomonas sp.) for polycyclic aromatic hydrocarbons (PAHs) contaminated soils. The dynamics of bacterial community composition, abundances of 16 S rDNA and ring hydroxylating dioxygenases (RHDα) genes, and removal of PAHs were evaluated and compared on four culture stages (days 0, 10, 20, and 30). The results showed that 8.65%–47.42% of Σ12 PAHs were removed after 30 days of cultivation. Quantitative polymerase chain reaction (qPCR) analysis indicated that treatments with soybean and ryegrass rhizosphere markedly increased the abundances of total bacteria and PAH-degraders, especially facilitated the growth of gram-negative degrading bacteria. Flavobacterium sp. and Pseudomonas sp. were the main and active strains in the control soil. However, the presence of plants and/or exogenous Pseudomonas sp. changed the soil bacterial community structure and modified the bacterial diversity of PAH-degraders. On the whole, this study showed that the high molecular weight PAHs removal efficiency of phyto-microbial remediation with ryegrass was better than those of remediation with soybean. Furthermore, the removals of PAHs strongly coincided with the abundance of PAH-degraders and bacterial community structure.