In the rapidly evolving field of optical information security, single-pixel imaging (SPI) has emerged as a promising technique for hidden information transmission. However, traditional SPI methods face significant challenges, including the need for excessive modulation patterns and the vulnerability of encrypted information during transmission. Furthermore, the field lacks efficient methods to reconstruct both plaintext and ciphertext images from the same set of single-pixel measurements. Here, we propose a novel and efficient encryption strategy for Fourier single-pixel imaging (FSPI) that addresses these critical challenges. Our approach integrates two key innovations: a two-step Fourier-total variation conjugate gradient descent (F-TVCGD) method and a dual-key decryption mechanism. The F-TVCGD method significantly reduces the number of modulation patterns required for image reconstruction, enhancing efficiency and minimizing data redundancy. Our dual-key mechanism enables the reconstruction of both plaintext and ciphertext images from a single set of single-pixel measurements using different decryption keys, significantly enhancing security without compromising efficiency. The incorporation of Fourier symmetric patterns improves the convergence robustness of the symmetric gradient descent (SGD) algorithm, leading to superior performance under challenging conditions such as sparse sampling and noise attacks. Numerical simulations and optical experiments validate our method's improvements in both accuracy and security compared to traditional approaches. Our findings demonstrate that the proposed F-TVCGD and SGD strategies effectively address the challenges of excessive modulation patterns and information vulnerability in FSPI.