The sea ice albedo can amplify global climate change and affect the surface energy in the Arctic. In this paper, the data from Visible and Infra-Red Radiometer (VIRR) onboard Fengyun-3C satellite are applied to derive the Arctic sea ice albedo. Two radiative transfer models, namely, 6S and FluxNet, are used to simulate the reflectance and albedo in the shortwave band. Clear sky sea ice albedo in the Arctic region (60°~90°N) from 2016 to 2019 is derived through the physical process, including data preprocessing, narrowband to broadband conversion, anisotropy correction, and atmospheric correction. The results are compared with aircraft measurements and AVHRR Polar Pathfinder-Extended (APP-x) albedo product and OLCI MPF product. The bias and standard deviation of the difference between VIRR albedo and aircraft measurements are −0.040 and 0.071, respectively. Compared with APP-x product and OLCI MPF product, a good consistency of albedo is shown. And analyzed together with melt pond fraction, an obvious negative relationship can be seen. After processing the 4-year data, an obvious annual trend can be observed. Due to the influence of snow on the ice surface, the average surface albedo of the Arctic in March and April can reach more than 0.8. Starting in May, with the ice and snow melting and melt ponds forming, the albedo drops rapidly to 0.5–0.6. Into August, the melt ponds begin to freeze and the surface albedo increases.