There has been a longstanding doubt that the conversion efficiency of high harmonics in solids is much lower than expected at such a high level of electron density. To address this issue, we revisit the dynamical process of high harmonic generation (HHG) in solids in terms of wavelet interference. We find that the constructive interference among the wavelets has intrinsic consistency with the phase matching of coupled waves in nonlinear optics, which we call Bloch-wave phase matching. Our analysis indicates that most of the wavelets are out of phase and coherently canceled out during the solid HHG process, leading to only a small fraction of excited electrons effectively contributing to HHG. Consequently, the conversion from the excited electron to HHG is fairly low. Moreover, a Bloch-wave phase-matching scheme is proposed and a nearly 3 orders of magnitude enhancement of solid HHG can be achieved by engineering the crystal structures. Our Letter addresses a longstanding doubt and provides a novel idea and theoretical guidance for realizing efficient all-solid-state tabletop ultraviolet light sources.