In corrosion environment, corrosion ions can easily penetrate from the surface into the inside of the concrete due to the porous structure of the surface; in this case, concrete can inevitably suffer from the damage. In this study, an attempt to use nano SiO2 (NS) and silica fume (SF) modifying cement mortar as a Surface Protection Material (SPM) was made, in order to promote penetration resistance of the whole system. SPM was coated on the surface of matrix, and then interfacial bond strength between matrix and SPM was measured; shrinkage consistency was also considered; the chloride penetrability of the system was examined as well. To reveal the mechanism, effect of NS and SF on pore structure, Interfacial Transition Zone (ITZ), hydration process, and compressive strength of SPM were investigated. The results show that matrix coated with SPM on the surface has a good integrity, with excellent interfacial bond strength and little difference in shrinkage, and chloride diffusion coefficient of the system was considerably declined, in comparison with the matrix, showing an excellent penetration resistance. The mechanism behind is that SPM, which was modified with SF-NS, shows the excellent impermeability, and this kind of material existing on the surface can noticeably obstruct the chloride ions penetrating into the inside. In cement hydration process, SF and NS can not only consume a large amount of CH to form dense C-S-H, but also exert the grading filling effect, resulting in the decline in porosity, the increase in density, the improvement in microstructure of ITZ, and the enhancement in mechanical performance. The findings can provide useful experience for the design of the cement-based materials servicing in high corrosion environment.