Green roofs and walls play an important role in promoting biodiversity, reducing the urban heat island effect and providing ecosystem services in urban areas. However, the conditions on green walls/roofs (low nutrient and organic matter content, drought, high temperatures) are often unfavorable for plant growth. Arbuscular mycorrhizal fungi (AMF) can improve the growth and development of plants under stress conditions as they can increase nutrient and water uptake. In a 6-month pot experiment, we investigated the effect of AMF inoculation on the growth and NPK uptake of Festuca ovina L. and Trifolium medium L., which are used for green roofs and walls. Two variants of mycorrhizal inoculation were used in the experiment: a commercial mycorrhizal inoculant AM Symbivit (Symbiom Ltd., Lanskroun, Czech Republic) and a mycorrhizal inoculant collected from calcareous grassland in the Silesia region (Poland). Funneliformis mosseae was the most abundant species in the roots of F. ovina and T. medium with IM inoculum. In the CM variant, a dominance of F. mosseae was observed in the roots of F. ovina. In contrast, Archaeosporaceae sp. node 317 dominated in the roots of T. medium. Both inoculations had a positive effect on the increase in dry weight of the shoots of T. medium, but only the commercial inoculum had a positive effect on the growth of F. ovina. Both inoculations improved the P uptake by the roots and the P and K uptake into the shoots of T. medium. In addition, both inoculations improved the K uptake by the roots of F. ovina and the N, P and K uptake into the shoots. In conclusion, both AMF communities included in the inoculations had a positive effect on plant growth and nutrient uptake, but the effect depends on the plant and the mycorrhizal fungus species.