In this study, a new red mud/fly ash composite material (RFCM) for phosphate removal was prepared by granulation and activation methods, using bauxite residue (red mud, RM) as the main raw material, adding with some fly ash and a few adhesives. The effects of different types of RM and adhesives on RFCM for phosphate removal were discussed. It was found that RFCM prepared from sintering red mud and cement waste performed better on phosphate removal than that prepared from Bayer red mud and common industrial adhesives. After calcination activated at appropriate temperature around 800-900℃, the specific surface area of RFCM increased, and new substances with hydroxyl (-OH) appeared on the surface of RFCM, which were the functional groups for phosphate removal. Mechanism of RFCM for phosphate removal was speculated as a combination of physical adsorption, chemical adsorption and chemical precipitation, which mainly depended on ligand exchange and chemical reaction. This research will provide a potential application of bauxite residue in environmental remediation.