Abstract In order to analyze and study the dynamic characteristics of the 3D blade tip rotor, an aeroelastic dynamic model for a complex 3D blade tip rotor is established based on mechanics principles. The theory of medium deformation beam or large deformation beam is adopted as the blade structural dynamic model, and the quasi-steady and unsteady aerodynamic models (ONERA model) are adopted as the aerodynamic model. The rotor dynamics, aeroelastic stability and rotor loads of three-dimensional blade tip and rectangular blade tip are compared by examples. The analysis shows that both the forward and backward sweep angles have a certain effect on the rotor blade frequency, but the downward dihedral angle has little effect. The 3D tip configuration has the greatest influence on torsion mode frequency, followed by lagging mode frequency, which has little impact on flapping frequency. Reasonable design of forward and backward sweep angles and downward dihedral angles of 3D tip configuration can effectively reduce rotor loads, increase damping margin for aeroelastic stability, and improve stability.