Winter planting is promising for improving the utilization rate of fallow paddy fields in southern China by establishing arbuscular mycorrhizal fungi (AMF) communities. However, the effects of different winter forage crops on AMF community construction remain unknown. The AMF community establishment of different winter planting forage crops were conducted in oat, rye, Chinese milk vetch, and ryegrass, with winter fallow as a control. The AMF colonization rate, soil AMF spore density, community structure and diversity, and soil physicochemical properties were determined. The results showed that the total nitrogen and available nitrogen in winter Chinese milk vetch were 11.11% and 16.92% higher than those in winter fallow (P < 0.05). After planting winter forage crops, the AMF spore density in winter oat, rye, Chinese milk vetch, and ryegrass soil were 127.90%, 64.37%, 59.91%, and 73.62% higher than that before planting, respectively (P < 0.05). Claroideoglomus was the dominant AMF genus in the soil of winter planting oat, rye, and ryegrass. The average membership function value of winter Chinese milk vetch was the highest, indicating that it had the best comprehensive effect on soil physicochemical properties, AMF community structure and diversity, and fresh forage yield. Winter forage crops could increase the spore pool of soil AMF and improve the soil AMF community structure and diversity. Winter Chinese milk vetch in paddy field had the best comprehensive effect on soil physicochemical properties and soil AMF community according to the comprehensive evaluation. These findings provide a theoretical basis for sustainable development and utilization of the southern rice paddy ecosystem.