Granite is very widely distributed in the world, but granite is an acidic aggregate with poor adhesion to asphalt. In untreated asphalt mixtures, asphalt pavement water damage and loose disease are more prominent, affecting the service life of the pavement and service level. Enhancing the road performance of granite asphalt mixture generally improves the adhesion properties of asphalt and granite. Qingchuan rock asphalt, anti-stripping agent KH5, aliphatic amine anti-stripping agent AJ-1 and two groups of the composite anti-stripping agents were used to modify the asphalt and analyze the effect of different anti-stripping agents on the improvement of asphalt-granite aggregate adhesion properties based on the surface free energy (SFE) theory. Second, the effect of anti-stripping agents on the rheological properties of asphalt were analyzed by rheological tests, and the modification effect of granite asphalt mixture road performance was evaluated by Marshall tests. The aging of asphalt and asphalt mixture was simulated by thermal oxygen aging, and the durability of different anti-stripping agents was investigated by comparing the performance of asphalt and asphalt mixtures before and after aging. The results showed that Qingchuan rock asphalt can effectively enhance the high-temperature stability and anti-aging properties of asphalt mixes, but the low temperature performance was relatively poor. KH5 and AJ-1 can make up for the lack of low temperature performance of rock asphalt, but the water stability of asphalt mixes decreases after aging. All five groups of anti-stripping agents improve the adhesion of granite-asphalt and the water stability of the asphalt mixture to some extent. Considering the aging effect, the order of granite-asphalt mixture water stability is: KH/RAMA > AJ/RAMA > RAMA > KHMA > AJMA.