In soil with extremely high contents of Cd (101.87), Pb (26,526.44), and Zn (17,652.63 mg kg−1), we aimed to test the phytostabilization capacity of purslane (Portulaca oleracea) with the use of various soil improvers, both organic (biochar, compost, insect frass) and inorganic (lime and zeolite). Thus, in a 60-day pot experiment, we amended this heavily contaminated soil with the five materials at two rates, 2% and 4%, resulting in 11 treatments (control plus five materials × two rates) replicated 10 times. We found that soil extractions of Cd with DTPA (diethylenetriaminepentaacetic acid) were not affected by any of the amendments, as there was no recorded significant reduction in soil Cd. In the case of Pb, there were even significant increases in its extractability with added biochar, and so was the case for compost at 4%. The reason may be the formation of organometallic complexes with organic substances of low molecular weight eluted by the organic amendments. Similarly, Zn extractability increased significantly compared to the control in the compost and frass treatments. As for purslane shoots, Cd decreased from 61 μg kg−1 fresh weight (FW) at control to 39 at biochar 4%, but the reduction was non-significant. As for Pb, it decreased with biochar but not significantly, while it exhibited a significant decrease in all other treatments. However, in all cases the content of Pb in purslane was well above the European regulation limit of 0.100 mg kg−1 FW (fresh weight) for vegetables and fresh herbs, while Cd fell below the regulation limit of 50 μg kg−1 FW at biochar 4%, compost 4%, and frass 2% and 4% (with control being 62.5 μg kg−1 FW). We conclude that in heavily contaminated soils, although biochar, along with compost and frass, was not entirely unsuccessful, the tested amendments did not reduce satisfactorily toxic elements to sufficiently low levels both in soil and in the test plant (here, purslane) in order to achieve phytostabilization. However, further research is necessary to identify exact mechanisms and to elucidate the role of different biochars.