Stray light from line-structured light vision sensors easily interferes with the center extraction accuracy of a structured light strip. In this paper, a high-accuracy calibration technique using polarized beam splitting simultaneous imaging is proposed. First, two polarization component images with different polarization directions are obtained through a single measurement. The method overcomes problems related to stray light and errors caused by the shaking of the instruments. Therefore, false polarization information can be avoided in this way. Second, an image fusion algorithm is used to improve the imaging quality of the light bar. Experiments are performed to show that the light strips no longer have local overexposure, and the calibration accuracy of the system is improved.