Underactuated systems are widely applied in industry, construction, manufacturing, etc., and the complex working environment puts forward higher demands for safety and transient performance. Hence, it is necessary to consider how to simultaneously ensure actuated and unactuated motion constraints by fewer control inputs, especially when systems suffer from model uncertainties, unavailable velocities, etc. Unfortunately, it is still a significant challenge to overcome in real applications and theoretical analysis. Additionally, most existing studies merely consider the specific control objects and few general methods are applicable to a class of underactuated systems. To this end, we design a new adaptive output-feedback controller for a class of uncertain underactuated systems. Compared with existing methods only handling actuated constraints, an important merit of this article is that by introducing the elaborately designed coupling term composed of actuated and unactuated constraints together, all state variables are kept within the preset time-variant ranges and converge to their desired values. Furthermore, a new Lyapunov function candidate is utilized to provide a theoretical guarantee. As far as we know, without the need of exact model knowledge and velocity feedback, this article provides the first solution to achieve accurate motion control and state constraints for both actuated and unactuated variables, which is meaningful both theoretically and practically. Meanwhile, the asymptotic stability of the equilibrium point for the closed-loop system is proven by utilizing Lyapunov techniques and Barbalat’s lemma. For verification, the presented controller is applied to underactuated overhead and rotary cranes, respectively, together with detailed theoretical analysis and experimental validations.