Research studies have modified traditional substances to seek fast-acting removal of phosphorus in constructed wetlands (CWs) and ecological dams, rather than develop a brand-new nano-adsorbent. This work synthesized FeCa-based layered double hydroxide (FeCa-LDH) with a chemical co-precipitation method, and the performance, mechanism and factors of phosphorus removal were investigated. FeCa-LDH showed a marked ability to adsorb phosphorus from waste water, with a removal efficiency of 94.4% and 98.2% in CWs and ecological dams, respectively. Both FTIR and XPS spectrum evidenced that FeCa-LDH removed phosphorus via electrostatic and hydrogen-bonding adsorption, as well as a coordination reaction and interlayer anion exchange. FeCa-LDH showed a higher capacity to remove phosphorus in alkaline and neutral waste water than in acid conditions. Co-occurrence anions, which influenced the efficiency of the phosphorus removal capacity are considered in the sequence below: CO32− ≈ HCO3− > SO42− > NO3−. Innovatively, FeCa-LDH was not affected by the low-temperature limitation for CWs, and phosphorus removal efficiency at 5 °C was almost equal to that at 25 °C. These results cast a new idea on the construction, application and phosphorus removal performance of CWs and ecological dams.