We theoretically set up a 4 × 4 magneto-optical matrix to investigate the transmittances induced by the forward and backward left hand circularly polarized (LCP) waves impinging the 4 μm thickness Weyl semimetal (WSM) material at normal incidence. Because of the different effective permittivity of the two LCP waves in WSM induced by the non-zero off-diagonal term, the two waves experience blocking transmission, bidirectional transmission and unidirectional transmission with the increase of the wavelength, respectively. Based on the wide wavelength of the unidirectional transmission, the broadband optical isolator can be realized. The threshold wavelength of the optical isolator can be regulated by changing the wavelength where the parallel component of the diagonal element is identical to the off-diagonal term. It is also found that the Fermi energy, tilt degree of Weyl cones and Weyl node separation reveal simple and available approaches to achieve the regulation. We believe that the adjustable broadband compact optical isolator can perform a significant role in fiber-optic communication system.