This paper presents an arbitrary Lagrangian-Eulerian (ALE) formulation based on the consistent corotational method for the geometric nonlinear dynamic analysis of planar curved viscoelastic beams subjected to moving loads. In the ALE description, the beam nodes can be moved in arbitrarily specified ways to describe the moving loads’ material positions accurately. The pure deformation and the deformation rate of the element are measured in a curvilinear coordinate system fixed on a curved reference configuration that follows the rotation and translation of a corotational frame. Based on Hamilton’s principle, the global elastic force vector, the global internal damping force vector, the global inertia force vector, and the global external damping force vector are derived using the same shape functions to ensure the consistency and independence of the element. Then, a standard element can be embedded within the element-independent framework. An accurate two-node curved element and the Kelvin-Voigt model are introduced in this framework to consider the axial deformation, bending deformation, shear deformation, rotary inertia, and viscoelasticity of the beam. Three examples are given to verify the validity, computational efficiency, and versatility of the presented formulation. The effect of internal damping, external damping, the inertia force of a moving mass, and the moment of inertia of the mass on the dynamic response of the beam are investigated. Moreover, the driving force for a prescribed motion of a mass along the beam is investigated.