As an inherent attribute of asphalt pavement, texture durability is the essential reason for the change in skid resistance. However, different scale texture deterioration behavior remains unclear by tire wearing at present. To explore the influence of the durability of multi-scaled textures on skid resistance, nine pavement specimens were tested using the Harbin polishing and dynamic friction integrated experimental machine (HPFM). The pavement anti-skid texture tester (PATT-II) was used for high-precision texture scanning and reconstruction. The results show that the texture richness and skid resistance of the three types of pavements in 300 min polishing are ranked as Open-graded Friction Coarse (OGFC) > Stone Mastic Asphalt (SMA) > Asphalt Concrete (AC), while SMA presents the best durability, determined by the material skeleton structure of asphalt mixture. The macro-texture deterioration occurs slightly at first and then tends to stabilize in 300 min polishing. The micro-texture deterioration behavior is the same as the μHPFM, increasing rapidly at the beginning, then slowly decreasing, and finally remaining constant. This deterioration is caused by the asphalt damage and continuously wearing aggregate surface. The 2D-PSD deterioration behavior is more significant with a smaller texture scale in 300min polishing, and the most considerable contribution wavelength in the microscopic scale range is 0.15 mm–0.3 mm, which is determined by the adhesion characteristics and molecular mechanism between a mineral mixture and asphalt material. The influence of pavement texture on the dynamic friction coefficient is significantly different under different water film thicknesses, the micro-texture and macro-texture play the main roles in boundary and mixed lubrication, respectively.