In response to long-lasting high levels of metallic trace elements (MTEs) in urban soils, we expect soil invertebrates inhabiting urban environments to have evolved detection and avoidance and/or tolerance mechanisms to MTE pollution. In this study, I used artificial soils with concentrations of lead, zinc, copper, chromium and nickel that reflect pollution levels in the soils of Parisian parks. Using choice experiments, I compared habitat preference (i.e., the occurrence of individuals in the polluted vs. unpolluted soil) and health status (i.e., body mass maintenance, mobility, mortality) between three species of endogeic earthworms—Aporrectodea caliginosa, Aporrectodea icterica and Allolobophora chlorotica—originating either from urban or rural grasslands. This study highlights a clear avoidance of MTE-polluted soils in all three species, as well as MTE-induced health impairments, especially in A. chlorotica. Interestingly, earthworm response to MTE exposure only slightly differed between earthworms of urban and rural origin, suggesting the absence of widespread acclimatization or adaptation mechanisms to MTE pollution in cities. As a consequence, MTE pollution is expected to significantly shape earthworm spatial distribution in both urban and rural environments and, as a consequence, affect ecosystem functioning.