The mathematic description of the trajectory of robot manipulators with the optimal trajectory tracking problem is formulated as an optimal control problem, and a parametric approach is proposed for the optimal trajectory tracking control problem. The optimal control problem is first solved as an open loop optimal control problem by using a time scaling transform and the control parameterization method. Then, by virtue of the relationship between the optimal open loop control and the optimal closed loop control along the optimal trajectory, a practical method is presented to calculate an approximate optimal feedback gain matrix, without having to solve an optimal control problem involving the complex Riccati-like matrix differential equation coupled with the original system dynamics. Simulation results of 2-link robot manipulator are presented to show the effectiveness of the proposed method.