Evaluating heavy metal pollution in tea plantation soil and conducting potential health risk assessments are crucial for ensuring the safety of tea consumers. However, soil heavy metal pollution levels and dietary exposure risk remain poorly understood, and there is no consensus on how soil physicochemical properties affect heavy metal concentrations. In this study, seventy-three soil samples and corresponding tea leaves from main tea-producing regions in Anxi County were analyzed for arsenic (As), chromium (Cr), lead (Pb) and copper (Cu) concentrations. The results showed that mean concentrations of As, Cr, Cu and Pb in the soil did not exceed respective risk screening values in China (GB 15618-2018). The concentrations of As, Cr, Cu and Pb in the tea leaves were within limiting values of the Chinese National Food Safety Standard, and the bioaccumulation factor of heavy metals in descending order was Cu > Pb > As > Cr. The hazard index values of heavy metals indicated no potential human health risk. Soil pH, EAl, EA and AP were the main controlling factors for heavy metal in soil and tea leaves. Cu and Pb concentrations in tea leaves were positively correlated with soil Cu and Pb concentrations. These results provide a scientific basis for effective monitoring and management in tea plantations and for controlling potential risks in tea leaves.