A better understanding of the response of soil respiration to land-use conversion has important practical implications for ecological restoration in degraded regions. In this study, in situ soil respiration was monitored in a typical land-use sequence on a ridge slope in Wangdonggou watershed of the Loess Plateau, China, during a three-year period from 2011 to 2013. The land-use conversion sequences included cropland (control), apple orchard, grassland, and woodland. The results clearly showed that soil respiration and temperature sensitivity (Q10) varied significantly with land-use conversion. Soil respiration was decreased by 10% after conversion of cropland to orchard, and increased by 7–46% after conversion of cropland to grassland and woodland. Q10 was increased by 19% after conversion of cropland to woodland, and decreased by 9–26% after conversion of cropland to grassland and orchard. Soil respiration increased linearly with soil organic carbon (SOC) storage and fine root biomass (<2mm). The results indicated that root biomass and SOC storage were the major factors influencing Q10 after conversion of cropland to non-natural ecosystem, and substrate quality or root system adaptability may be the real reason for the difference in Q10 after conversion of cropland to natural grassland ecosystem. Although soil temperature and moisture significantly influenced soil respiration among the four typical land-use types, their difference derived from land-use conversions could not well explain the difference in soil respiration among land-use conversions. In conclusion, the increases in SOC storage and fine root biomass were the major factors influencing soil respiration among land-use conversions. Thus, conversion of cropland to natural grassland seemed to be the most effective integrated small watershed management to increase soil carbon storage and decrease CO2 concentration in the loess regions of China.