Identifying potential sources of soil potentially toxic elements (PTEs) and developing source-oriented health risk assessments in typical mining cities are key for pollution prevention and risk management. To this end, a case study was conducted to explore the pollution characteristics, potential sources, and human health risks of PTEs in Daye City, China. Indices, including the pollution factor (PF), pollution load index (PLI), and geo-accumulation index (Igeo), were applied to assess PTE pollution. Cd had the highest value among the detected PTEs, and 82.93% of the sampling sites had moderate pollution levels, with the highest mean Igeo value for Cd (2.30). Four potential sources were determined. Cr and Ni originated mainly from natural sources. Zn (91.5%) was exclusively and then Cd (33.1%) was moderately derived from industrial activities. The mixed source of various mineral exploitation smelting, and coal-fired traffic emissions leaded to the accumulation of As, Cd, and Pb. Cu was associated with Cu-related mining and smelting activities. The probabilistic health risk assessment indicated that the non-carcinogenic risks for populations were negligible. Overall, this work provides scientific information for environmental managers to manage soil PTE pollution through the effective management of anthropogenic sources with limited resources and costs.