Acid mine drainage (AMD) contamination poses a severe environmental threat and is a significant risk to human health. There is an urgent need to develop environmentally sustainable and technically viable solutions for water contamination caused by heavy metals. In this study, steel slag (SS) was used as a secondary resource to concurrently remove Fe(II), Cu(II), and Zn(II) from AMD. Because of the loose and porous structure, abundant functional groups, fast sedimentation velocity, and excellent solid-liquid separation, SS showed exceptional removal performance for heavy metal ions. The adsorption kinetic data of Fe(II), Cu(II), and Zn(II) showed good regression with the pseudo-second-order model. Besides, the adsorption of Fe(II) by SS conformed to the Freundlich model, whereas the adsorption of Cu(II) and Zn(II) followed the Langmuir model, with the maximum adsorption amounts of Cu(II) and Zn(II) being 170.69 and 155.98 mg/g. Furthermore, competitive adsorption was observed among Fe (II), Cu (II), and Zn (II) in a multi-component system, with the adsorption priority being Fe (II) > Cu (II) > Zn (II). The removal mechanism of Fe(II), Cu(II), and Zn(II) in AMD by SS mainly includes electrostatic attraction, chemical precipitation, and surface complexation. Interestingly, the leached concentrations of Fe(II), Cu(II), and Zn(II) from the spent slag after calcination were all within the detection limit of the Chinese emission standard, demonstrating excellent environmental stability. Theoretically, this renders it a viable candidate for use as an additive in construction materials. Meaningfully, the work offers a practical approach for energy-efficient and eco-friendly heavy metal ions adsorption, and the secondary utilization of SS also contributes to the sustainable development of the steel industry. It is beneficial to implement the development concepts of clean production and efficient utilization of industrial solid waste.