We compute the perturbative expansion of the two- and four-point functions of color charges in the Color Glass Condensate framework considering the quartic correction to the McLerran–Venugopalan (MV) model of Gaussian color charge fluctuations. Expressions for these correlators in the perturbative expansion for small and large non-Gaussian color charge fluctuations are derived for arbitrary orders in perturbation theory. We explicitly show that the perturbative series does not converge at higher orders as expected. We apply the Borel–Padé resummation method to our problem to construct a convergent series. It is shown that the fully non-perturbative solution can be described by the Borel–Padé approximants constructed from the first few terms of the perturbative series for small non-Gaussian fluctuations.