The compliance of series elastic actuators (SEAs) is significant for ensuring safe human–machine interaction. However, in practical applications, the SEA is inevitably encountered with unknown disturbances, such as parameter uncertainties, unmodeled dynamics, and environmental interferences. In this paper, a robust dynamic surface control scheme is presented to address the high-precision trajectory tracking problem of the SEA. Firstly, a reduced-order extended state observer (RESO) with only link-side position measurements is designed to estimate the unknown lumped disturbance and unmeasurable system states. Based on the estimated values from the RESO, a robust dynamic surface controller is proposed for the trajectory tracking of the SEA. Additionally, the finite-time filter is introduced to overcome the “explosion of complexity” in the backstepping controller, and the filtering error in the dynamic surface controller is reduced compared with the conventional first- and second-order filters. The stability of the closed-loop system is guaranteed by the Lyapunov theory. Finally, the effectiveness and superiority of the proposed control algorithm are verified through simulations and experiments.