Large water Cherenkov detectors have been successfully used for decades in high- and low-energy particle physics. Nevertheless, detecting neutrons remains a challenge for such detectors since a neutron capture on a hydrogen atom doesn't release a sufficient amount of gamma energy to be observed efficiently. The use of gadolinium in the form of soluble salts has been explored extensively to remedy this issue, as gadolinium exhibits both a very large neutron capture cross section and a subsequent high-energy gamma cascade. However, in order for large gadolinium-loaded detectors to operate stably over long time periods, water optical transparency must be maintained by in situ purification. New methods have been developed involving band-pass molecular filtering. While these methods are very successful, they are expensive and consume considerable power and space as they seek to minimize loss of gadolinium while removing other impurities. For smaller detectors where some gadolinium loss can be tolerated, a less expensive way to do this is very desirable. In this paper, we describe the design, development and testing of a system used to purify the gadolinium-loaded water in the 26-ton ANNIE neutrino detector.