The frequency down-conversion system based on microwave photonics has been widely employed in radar, electronic warfare, and satellite communication systems. In this paper, we propose an image rejection frequency down-conversion system, wherein the phase modulator and phase shifter are integrated on thin film lithium niobate platform. The working principle is elucidated through the establishment of a theoretical model. Subsequently, the system successfully down-converts a 40 GHz radio frequency (RF) signal to a 5 GHz intermediate frequency signal, achieving an image rejection ratio of approximately 30 dB. Simultaneously, varying degrees of image rejection are observed for different RF signals. The system maintains robust image rejection performance across varying RF and image signal power, as well as different levels of input optical power.