To study the feasibility of using magnetic techniques for monitoring soil pollution in Shanghai, magnetic properties and heavy metals in the topsoils in an urban site (Songnan Town) and a less-urbanized agricultural site (Luojing Town) in Baoshan District, Shanghai, were studied. Compared with the background, magnetic signals of the urban topsoils are extremely enhanced with magnetic susceptibility ( χ lf) from 127.3–1959 × 10 − 8 m 3 kg − 1 ; while those of the agricultural topsoils are only slightly increased. However, both the urban and agricultural topsoils contain few pedogenic SP grains, as indicated by their low χ fd% (< 3.6%). Ratios of χ arm/SIRM, χ arm/ χ lf and SIRM/ χ lf indicate that the grain size of magnetic minerals in the urban topsoils is significantly coarser than that in the background and the agricultural topsoils. Furthermore, the urban topsoils show low coercivity and magnetic soft behaviors, as indicated by higher SOFT%, lower HARD%, higher IRM 300 mT/SIRM (close to 1) and lower IRM − 200 mT /SIRM (close to − 1). It suggests that the urban topsoils have received some coarse ferrimagnetic particles. Heavy metals are highly enriched in the magnetic fractions of the topsoils. Geochemical properties of the magnetic fraction of the urban topsoils are significantly different from those of the agricultural topsoils, further indicating that the extra magnetic minerals accumulated in the urban topsoils are neither inherited from soil parent materials nor from pedogenic processes, but originate from anthropogenic activities. The significant correlations between heavy metals and χ lf, χ arm, SIRM, SOFT and HIRM of the topsoils in the district indicate that the magnetic techniques can be used for monitoring soil pollution in Shanghai. The soils with χ lf from 39–50 × 10 − 8 m 3 kg − 1 in the district are tentatively defined as “slightly polluted soils”; those with χ lf > 50 × 10 − 8 m 3 kg − 1 are defined as “polluted soils”.