Polarization sensitivity has been a major issue in Brillouin scattering-based optical fiber sensing systems. Randomization of the polarization state of the pump is one of the ways to circumvent the problem. However, there could exist a residual degree of polarization (DOP) for the pump after polarization randomization, and hence, a model to characterize the polarization evolution in Brillouin scattering with a partially polarized pump is essential for the performance evaluation. In this work, a comprehensive theoretical model to characterize the beam variation with the partially polarized pump wave and Stokes wave is proposed, which is based on a set of stochastic differential equations (SDEs). The polarized part of the pump wave and the Stokes wave, as well as the total powers of the waves, are incorporated in the coupled SDE simultaneously, which enables the comprehensive simulation of the polarization evolution in the fiber. It is revealed in the study that the DOPs of the pump wave and the Stokes wave affect the gain stability and should be reduced simultaneously by polarization scrambling to ensure a fixed Brillouin gain without fluctuations.