Summary In this study, we analyzed the impacts of errors in background force models and observed non-gravitational forces on the pseudo-observations (pre-fits) during gravity field recovery based on the GRACE satellite gravity mission. To reduce these effects, we introduced the stochastic parameters into the functional model of the variational equation integration approach to absorb this type of noise contribution. Simultaneously, the prior variances of observed orbits and K-Band range rates used in traditional method are re-estimated with least-square variance component estimation (LS-VCE) after considering these stochastic parameters. To improve the computing efficiency, a modified method of the calculation of sensitivity matrices related to the introduced stochastic parameters is proposed. Compared to the method of variation of constants widely used in the precise orbit determination and gravity field recovery, the modified method decreases the computational time of these matrices by about four times. Furthermore, an efficient LS-VCE algorithm is derived in a more generalized case. The efficient algorithm only costs 1% of the time of the unoptimized method. With the GRACE data, we analyzed the benefits of these refinements in gravity field recovery, and the results show that these improvements can mitigate the impacts of errors in background force models and accelerometer data on recovered gravity field models, especially in the high degree signals. Furthermore, the quality of results has less dependence on parameterization.