In arid and semiarid regions, variations in “islands of fertility” accompanied by discontinuous vegetation is frequently observed. However, the effects of vegetation patches on soil, including the influence of canopy size, are not fully understood, particularly under conditions of severe grazing. We examined the effects of patches of mound-forming shrub, Caragana microphylla, and the plant’s canopy size on these islands of fertility in a heavily grazed Mongolian grassland. In 11 patches with various canopy sizes (32.5–180 cm in diameter), we compared the chemical properties of soils among three microsites: Mound, Below, and Around, which were inside, below, and outside of C. microphylla mounds, respectively. Total carbon (C) and most essential elements for the plants were more concentrated in Mound, but total nitrogen (N) and nonlimiting elements, such as exchangeable sodium (Na), did not significantly differ among microsites. Larger canopies more strongly affected the enrichment of total C and most essential elements, including total N, in Mound. These results suggest that C. microphylla patches substantially enrich total C and most essential elements and that the extent of enrichment was intensified with canopy size. However, under severe grazing, total N may be relatively more affected by the redistribution of resources through grazing, particularly when the canopy size is small.