In order to improve the accuracy of stress intensity factors (SIFs) calculated by traditional boundary element methods (BEM), the multi-domain wavelet boundary element method (WBEM) is proposed. Firstly, by adjusting the nodes of the B-spline wavelet element on the interval, crack-tip elements are constructed. Since B-spline wavelet on the interval (BSWI) has excellent compact support characteristics and is particularly suitable for describing solution domains with large gradient changes, the constructed crack-tip can reduce the numerical oscillation effect near the crack tip. Secondly, the crack-tip elements are implemented into WBEM. And the combination of WBEM and multi-domain technology can effectively handle interface cracks. Thirdly, the crack problem solving strategy based on multi-domain WBEM can directly evaluate the SIFs of cracks. Finally, several numerical examples involving homogeneous media and bi-material models are given to verify that the proposed method is simple and highly accurate.