To improve the water damage resistance performance of a tuff asphalt mixture, a tuff mixture with cement and a liquid anti-stripping agent was used as the research object, and limestone and tuff mixtures without additives were selected as contrast samples. Through an improved boiling test and a water stability test before and after aging, the modification effect of the tuff mixture with additives of different types and contents on water damage resistance was evaluated to obtain the appropriate type and content of additives. On this basis, the other road performance measures of the selected mixture were further evaluated by immersion rutting and beam bending tests to verify the modification effect of the additive on the tuff mixture. Results showed that adding the appropriate cement content to the tuff mixture provided excellent resistance to the water damage effect. An optimal content of 2% cement additive in the mixture was obtained, and its high-temperature anti-rutting and low-temperature bending performance were also verified. Adhesion between tuff aggregates and asphalt polymer under water conditions was significantly improved and close to that of limestone aggregates. The modification effect of water stability after mixture aging was better than that of the anti-stripping agent. The residual stability and freeze–thaw splitting strength ratio of 2% cement content mixture were increased by about 21.5% and 16.7%, respectively, compared with those of the tuff mixture control.