The precise trajectory tracking control of hypersonic vehicles plays a crucial role in secure flight. To address this challenge, this article develops an optimal neural control framework with prescribed performance constraints for height-velocity control tasks with disturbances. To this end, the control-oriented error model is firstly established and transformed into an affine nonlinear form to provide a foundation for the design of controller. Then, in order to balance performance constraints and convergence speed, a performance-constraint function is introduced to convert the constrained tracking error into an unconstrained one. After that, an improved sliding mode compensation observer is proposed by combining low-fidelity approximation data with high-fidelity compensation model for eliminating disturbances. The developed control scheme is organized by an adaptive dynamic programming (ADP) algorithm based on the actor-critic policy structure to achieve the near-optimal control strategy. Meanwhile, the designed neural network (NN) weight updating laws are provided to obtain the solution of Hamiltonian-Jacobi-Bellman (HJB) equation rapidly without high calculation consumption. Finally, the stability conditions of the closed-loop system are performed and ensure the entire framework is semi-global uniformly ultimately bounded (SGUUB), two simulation cases verify the effectiveness and superiority of the proposed approach.