Excessive ammonium (NH4+) and phosphate (PO43−) in aquatic environments can cause serious eutrophication. Agricultural waste is an efficient adsorbent for nutrients removal and has good potential for comprehensive utilisation of resources. In this study, two Chinese medicinal herbal residues, Rhizoma Typhonium Gigantei (ZB) and Radix Glycyrrhizae Preparata (ZG), were implemented to simultaneously remove NH4+ and PO43− from water. Parameters such as adsorbent dosage, solution pH, contact time and initial concentration that influenced the adsorption process onto adsorbents, along with removal mechanism and practical performance were investigated. The microstructure of ZB was irregular with numerous spherical particles, while ZG displayed an uneven flaky structure with few rough grooves. The nutrients adsorption was significantly influenced by pH. The maximum adsorption capacity by ZB was 91.84 N mg g−1 and 71.81 P mg g−1. In addition, the maximum adsorption capacity recorded by ZG was 100.86 N mg g−1 and 89.51 P mg g−1 (pH, 8.0; dosage, 0.2 g L−1; initial concentration, 60 mg L−1; and contact time, 180 min, for both the herbal residues). The adsorption of NH4+ and PO43− was well described by the pseudo-second-order and intra-particle diffusion models, respectively. The Langmuir isotherm model is the best fit model for the adsorption equilibrium data, suggesting monolayer adsorption of NH4+ and PO43− by the two adsorbents. In addition, NH4+ was predominantly adsorbed by electrostatic attraction, ion exchange and complexation, whereas PO43− was predominantly adsorbed by intra-particle diffusion and ligand exchange. Practical application analysis demonstrated that ZG could remove and recover more NH4+ and PO43− from swine wastewater than ZB. Therefore, ZG exhibited a more significant potential to simultaneously remove and recover NH4+ and PO43− from wastewater.