The Marcus and Pekar partitions are common, alternative models to describe the non-equilibrium dielectric polarization response that accompanies instantaneous perturbation of a solute embedded in a dielectric continuum. Examples of such a perturbation include vertical electronic excitation and vertical ionization of a solution-phase molecule. Here, we provide a general derivation of the accompanying polarization response, for a quantum-mechanical solute described within the framework of a polarizable continuum model (PCM) of electrostatic solvation. Although the non-equilibrium free energy is formally equivalent within the two partitions, albeit partitioned differently into "fast" versus "slow" polarization contributions, discretization of the PCM integral equations fails to preserve certain symmetries contained in these equations (except in the case of the conductor-like models or when the solute cavity is spherical), leading to alternative, non-equivalent matrix equations. Unlike the total equilibrium solvation energy, however, which can differ dramatically between different formulations, we demonstrate that the equivalence of the Marcus and Pekar partitions for the non-equilibrium solvation correction is preserved to high accuracy. Differences in vertical excitation and ionization energies are <0.2 eV (and often <0.01 eV), even for systems specifically selected to afford a large polarization response. Numerical results therefore support the interchangeability of the Marcus and Pekar partitions, but also caution against relying too much on the fast PCM charges for interpretive value, as these charges differ greatly between the two partitions, especially in polar solvents.