The absorbing boundary conditions play a key role in numerical simulations. The complex frequency-shifted perfectly matched layer (CFS-PML), one of the absorbing boundary conditions, has attracted widespread attention because it can efficiently attenuate near-grazing incident waves and evanescent waves. In practical application, the distinct boundary reflections still exist using the CFS-PML in a thin PML region. To further enhance the absorbing performance, we have developed a novel unified high-order unsplit CFS-PML technique. The high-order CFS-PML combined with the discontinuous Galerkin (DG) method is applied to solve the second-order seismic wave equation on an unstructured mesh. In this work, we establish a unified framework for high-order unsplit CFS-PML formulations. The classical CFS-PML is the first-order form of our proposed unsplit high-order approach. By using auxiliary variables and auxiliary ordinary differential equations (AODEs), a higher-order CFS-PML formulation can be reduced to a first-order CFS-PML formula. For an Nth-order AODE CFS-PML, it will lead to (2N-1) additional variables and (2N-1) auxiliary differential equations. Taking second- and third-order as examples, we have derived the high-order unsplit AODE CFS-PML expressions in detail. The DG method can effectively deal with complex geological structures, such as caves, cracks, faults, etc., which yields more accurate numerical solutions. We incorporate the high-order unsplit AODE CFS-PML technique into the DG method to approximate seismic wave equations. Their strengths are combined to calculate the propagating wavefield in more complex finite models and obtain better results. In addition, the stability conditions of the second- and third-order CFS-PMLs are provided. We perform the high-order unsplit CFS-PML implementation for seismic wave modeling in several models. The isotropic and anisotropic examples prove that the high-order unsplit CFS-PML enjoys better absorbing performance than the classical CFS-PML. The numerical result for the graben model certifies the feasibility and flexibility of our proposed high-order CFS-PML combined with the DG method.