As compared to alkali-activated geopolymers with phosphoric acid which may be used in high concentrations resulting in disposal concerns, acid-based geopolymers may have superior properties. A novel green method of converting waste ash to a geopolymer for use in adsorption applications such as water treatment is presented here. We use methanesulfonic acid, a green chemical with high acid strength and biodegradability to form geopolymers from coal and wood fly ashes. The geopolymer is characterized for its physico-chemical properties and tested for heavy metal adsorption. The material specifically adsorbs iron and lead. The geopolymer is coupled to activated carbon forming a composite, which adsorbs silver (precious metal) and manganese (hazardous metal) significantly. The adsorption pattern complies with pseudo-second order kinetics and Langmuir isotherm. Toxicity studies show while activated carbon is highly toxic, the geopolymer and the carbon-geopolymer composite have relatively less toxicity concerns.