This study explores the use of activity-based protein profiling to study protein tyrosine phosphatases. With the discovery of allosteric SHP2 inhibitors, this enzyme family has resurfaced as interesting drug targets. Therefore, we envisioned that previously described direct electrophiles and quinone methide-based traps targeting phosphatases could be applied in competitive activity-based protein profiling assays. This study evaluates three direct electrophiles, specifically, a vinyl sulfonate, a vinyl sulfone, and an α-bromobenzylphosphonate as well as three quinone methide-based traps as activity-based probes. For all these moieties it was previously shown that they could selectively engage in assays with purified or overexpressed phosphatases in bacterial lysates. However, this study demonstrates that probes based on these moieties all suffer from unspecific labelling. Direct electrophiles were either unspecific or not activity-based, while quinone methide-based traps showed dependence on phosphatase activity but also resulted in unspecific labelling due to diffusion after activation. This phenomenon, termed 'bystander' labelling, occurred even with catalytically inactive SHP2 mutants. We concluded that alternative strategies or chemistries are needed to apply activity-based protein profiling in phosphatase research. Moreover, this study shows that quinone methide-based designs have limited potential in probe and inhibitor development strategies due to their intrinsic reactivity.