The mineralization of soil organic carbon (SOC) is a critical process in the soil carbon cycle. This study aimed to investigate the vertical distribution characteristics and mineralization dynamics of SOC in soils and their aggregates across different steppe types in the Loess Plateau (LP). Soil profiles from three steppe types under varying precipitation gradients were selected: meadow steppe (MS), typical steppe (TS), and desert steppe (DS). A 60-day controlled laboratory incubation study was conducted for carbon mineralization and the influence of climatic and soil properties on SOC mineralization was analyzed. The results showed that the SOC content and cumulative mineralization (CM) in 1–2 mm aggregates were higher than in other particle sizes; SOC content and CM followed the order MS > TS > DS and both decreased significantly with increasing soil depth. Correlation analysis revealed that precipitation significantly affected aggregate mineralization (p < 0.001) and that mineralization in the 1–2 mm aggregates was more closely related to mean annual precipitation (MAP), SOC, and water-soluble organic carbon (SWOC). Precipitation primarily controlled SOC mineralization in the 0–50 cm soil layer, while SOC mineralization in the 50–100 cm layer was influenced by soil-related carbon content. Structural Equation Modeling indicated that precipitation influences the mineralization of organic carbon in topsoil indirectly through its direct impact on SOC. In the context of global warming, the SOC turnover rate in high-precipitation areas (MS) was faster than in low-precipitation areas (TS, DS), necessitating greater attention to soil carbon dynamics in these regions.