A new fast multipole dual boundary element method (FMDBEM) is developed to analyze multiple crack propagations. To evaluate accurately the stress fields around the crack tip, a variable-order asymptotic element (VAE) is first proposed to express the singular behavior. This VAE is also suitable for the V-notches with different opening angles, requiring only minor adjustments of stress exponents. Then the VAE is introduced into the FMDBEM framework, where several singularity problems of integrals are solved. Finally, the FMDBEM with VAEs, combined with an adaptive scheme, is used to determine the crack propagation paths. Numerical examples show that the present method is accurate and easy to implement making it an appealing tool for analyzing large complex structures that include randomly distributed cracks and notches.