The autonomous surface vehicle (ASV) is supposed to be able to adapt unknown environments without human interference. This paper investigates the problem of trajectory tracking control for ASVs in the present of parameter uncertainties, disturbances, input quantization and actuator saturation. The neural network (NN) approximation and an adaptive sliding mode control (SMC) strategy are combined for the ASVs with a priori unknown upper bound of parameter uncertainties, external disturbances and saturation errors. The NN is adopted to approximate the unknown continuous uncertainties and disturbances in the system. The adaptive law for the SMC parameter can guarantee no overestimation of the robust control parameter with respect to unknown upper bounds of the NN approximation errors and the saturation error. By adding the NN approximation into the adaptive SMC laws, the robust control parameter and the chattering can be reduced. Uniformly ultimately bounded (UUB) for sliding variables and tracking errors can be guaranteed by Lyapunov proof. Simulation examples are given to illustrate the improved performance with the proposed approach. The comparisons on the proposed control method with other algorithms are given by using the integrated absolute error (IAE) and integrated time absolute error (ITAE).