The accumulation of heavy metals (HMs) in soil has become a pressing global concern due to their persistent and non-degradable nature, resulting in the accumulation of toxic levels in the environment. In recent years, human activities have significantly altered land use patterns, leading to a marked increase in soil HM levels and subsequent land degradation. This research focused on four distinct land use patterns (vegetable fields (VGF), woodland (WDL), cultivated land (CVL), and wasteland (WSL)) commonly found in the Taojia River Basin, Hunan, China, which is facing severe HM pollution. Soil samples were collected from three different depths (0–10 cm, 10–20 cm, and 20–30 cm) to investigate HM distribution and intensity (cadmium (Cd), lead (Pb), copper (Cu), nickel (Ni), and zinc (Zn)), comprehensive soil pollution index, and their relationship with soil microbial and enzymatic activities. The results revealed that the Cd content exceeded the national standard for soil environmental quality, whereas concentrations of other HMs did not exceed the national standard across the four land use patterns. Most soil HMs were concentrated in the surface layer, with Cu, Pb, and Zn concentrations gradually decreasing with increasing soil depth. Conversely, Ni and Cd concentrations tended to increase with greater soil depth. There were significant positive correlations among HMs, indicating homogeneity among them. The pollution index across the HMs ranked as Cd > Ni > Zn > Cu and Pb, with land uses following the order of VGF (2.70) > CVL (2.12) > WSL (1.72) > WDL (1.63). Soil microbial and enzymatic activity was not the primary factor influencing HM concentration. The specific impacts of land use changes on soil HMs depend on management practices, local conditions, and the distribution characteristics of the HMs involved.