Long-term afforestation strongly changes the soil’s physicochemical and biological properties. However, the underlying mechanism of different tree species driving change in soil nutrients is still unclear in the long-term dryland plantations of the Loess Plateau, China. In this study, samples of surface soil (0–20 cm) and woody litter were collected from five plantations (≥50 years) of Caragana korshinskii, Armeniaca sibirica, Populus hopeiensis, Platycladus orientalis, and Pinus tabulaeformis and a natural grassland, and tested for the carbon, nitrogen, phosphorus, and potassium contents, as well as the soil sucrase (SC), urease (UE), and alkaline phosphorus (ALP) activities. We found that soil nutrients, enzyme activities, and the litter’s chemical properties obviously varied among five tree species. C. korshinskii significantly increased the soil’s TC, organic carbon (OC), total nitrogen (TN), available nitrogen (AN), and available potassium (AK) by 28.42%, 56.08%, 57.41%, 107.25%, and 10.29%, respectively, and also increased the soil’s available phosphorus (AP) by 18.56%; while P. orientalis significantly decreased soil TN (38.89%), TP (30.58%), AP (76.39%), TK (8.25%), and AK (8.33%), and also decreased soil OC (18.01%) and AN (1.09%), compared with those in grassland. The C. korshinskii plantation had higher quality litter and soil enzyme activities than the P. orientalis plantation. Moreover, 62.2% of the total variation in soil nutrients was explained by the litter’s chemical properties and soil enzyme activities, and the litter phosphorus (LP) and soil ALP had a more significant and positive impact on soil nutrients. Therefore, tree species, LP, and soil ALP were key factors driving soil nutrient succession in dryland plantations. The significantly positive nitrogen–phosphorus coupling relationship in the “litter–enzyme–soil” system revealed that the improving nitrogen level promoted the phosphorus cycle of the plantation ecosystem. Our results suggest that leguminous tree species are more suitable for dryland afforestation through the regulation of litter quality and soil enzyme activities.