In order to understand the mechanism of dust aerosol influence on regional climate change, it is crucial to quantify the radiative forcing effect of dust aerosols. However, studies on the direct radiative forcing of dust aerosols over long time series in China are still lacking. The direct radiative forcing effect of dust aerosols in China over the past 20 years was simulated and evaluated based on the WRF-Chem (Weather Research and Forecasting model coupled to Chemistry) model in conjunction with remote sensing satellites and ground-based observations. The results showed that dust aerosols exhibited an obvious inter-annual positive radiative forcing effect (about 0.38 W m−2) on net radiation at the top of the atmosphere, mainly in northwest China and the North China Plain, while at the atmosphere dust aerosols presented negative radiative forcing effects on shortwave radiation and positive effects on longwave radiation, with a value of 1.54 W m−2 of net radiative forcing, showing a warming effect. Dust aerosols have a net radiative forcing value of −1.16 W m−2 at the surface, indicating a cooling effect, with a positive forcing effect on longwave radiation and a negative forcing effect on shortwave radiation, both of which coincide with the geographical distribution of dust aerosol concentrations. In terms of inter-monthly variations, at both the atmosphere and top of the atmosphere, the dust aerosols net radiative forcing values showed an increasing trend, with March (−0.20 W m−2 and 0.68 W m−2) < April (0.48 W m−2 and 1.44 W m−2) < May (0.94 W m−2 and 2.42 W m−2). Meanwhile, at the surface, the dust aerosols net radiative forcing values displayed a decreasing trend, with March (−0.88 W m−2) > April (−0.96 W m−2) > May (−1.48 W m−2).