The relationship between the bipolar resistive switching and the polarization reversal is investigated at various temperatures in the Au/BiFeO3/SrRuO3 structure. It is found that the polarization-induced barrier variation in the Au/BiFeO3 and BiFeO3/SrRuO3 junctions decreases with decreasing temperature. This explains why the resistance-switching ratio decreases with decreasing temperature below 323 K and gives evidence that the polarization modulates the resistance state of the Au/BiFeO3/SrRuO3 structure. Besides, the oxygen vacancies migration and/or the carrier trapping/detrapping mechanisms are also suggested to play a very important role in the resistive switching behavior in this structure as the temperature goes above 323 K.