The Jemma Subbasin (JS) has a major soil erosion problem emanating from deforestation, overgrazing, and agricultural expansion, including farming of unproductive fringed lands and steep slope terrains. This study was conducted to assess runoff and estimate the subsequent sediment yields in the JS using the Soil and Water Assessment Tool (SWAT) model. The overall efficiency of the SWAT model to accurately estimate the sediment yields in the JS was evaluated by the values of its calibration (R2 = 0.66) and validation (R2 = 0.63), respectively. The findings of the SWAT model revealed that barren land was not only the most susceptible land use type to soil erosion, but also had the highest sediment loads followed by agricultural and grazing lands. In particular, the highest soil erosion coupled with significant sediment yields is attributed to the crop-growing period particularly in the months of July and August in which the cultivated lands were extremely vulnerable to soil erosion resulting from heavy rainfall. Consequently, sediment yields were all significantly greater in the agricultural fields of the lower, middle, and upper parts of the subbasin. This is because those agricultural lands were mainly composed of undulated and moderately steep slope terrains so that they had the highest soil erosion values. However, due to the dense vegetation cover and the associated root density, forestlands were the least erosion vulnerable land use type which in turn resulted in minimal soil loss. Furthermore, the SWAT model showed that the maximum upland sediment yield was estimated to be 3,685.14 tons/ha whereas the average upland annual sediment yield was predicted to be 78.1 tons/ha; however, the sediment yield can be doubled due to climate projection scenario. As a result of the effective implementation of cover (c) and conservation practice (p), the SWAT model predicted that the sediment yields can be reduced by 44.28 % and 35.92 % for RCP8.5 and RCP4.5, respectively. Effective designing and executing of proper soil and water management measures are crucial in the study subbasin so as to minimize the serious soil erosion challenges that can be accelerated by climate and land use land cover (LULC) changes for the long-term sustainability of the degraded landscape of the JS which is categorized by subsistence farming.