We study an isoperimetric problem described by a functional that consists of the standard Gaussian perimeter and the norm of the barycenter. The second term is in competition with the perimeter, balancing the mass with respect to the origin, and because of that the solution is not always the half-space. We characterize all the minimizers of this functional, when the volume is close to one, by proving that the minimizer is either the half-space or the symmetric strip, depending on the strength of the barycenter term. As a corollary, we obtain that the symmetric strip is the solution of the Gaussian isoperimetric problem among symmetric sets when the volume is close to one. As another corollary we obtain the optimal constant in the quantitative Gaussian isoperimetric inequality.