The polarization state of light waves significantly affects the quality of holographic recordings. This paper quantitatively analyzes the impact of different polarization states of signal and reference beams on the quality of holographic recordings in PQ/PMMA photopolymer systems during the holography process. By deriving the light field distribution of the interference between two light waves of different polarization states and introducing the interference fringe contrast and the modulation of the refractive index of the photopolymer, we established the relationship between the diffraction efficiency of PQ/PMMA photopolymer holographic gratings and the angle between polarization directions. Based on this relationship, simulations and experiments were conducted. The experimental results demonstrated that as the angle between the polarization directions increased, the diffraction efficiency of the material decreased, with the efficiency dropping to 24.69% of its original value when the angle increased from 0° to 50°. When the angle increased to 60°, the influence of polarization characteristics became gradually significant, and at 90°, it was entirely dominated by polarization characteristics. The photoinduced birefringence properties of the PQ/PMMA prepared in the measurement experiment were studied, and the polarization characteristics of the reconstructed light under polarization direction angles of 0°, 60°, and 90° were investigated. The results indicated that at a polarization direction angle of 60 degrees, the material exhibited a significant response to the polarization information of the signal light. Finally, holographic recordings of objects at different polarization direction angles were conducted, and the reconstructed images were used to visually reflect the impact of the polarization direction angle on the quality of holographic recordings.