Polycarboxylate superplasticizer (PCE) is a crucial raw material used for preparing concrete. However, there has always been a compatibility issue between PCE and different types of cementitious materials due to their varying qualities. In concrete raw materials, the types and contents of sulfates have a significant impact on compatibility, and it is well-established that a competitive adsorption exists between PCE and sulfate ions solubilized in the interstitial solution of cement paste, which may cause a loss of the dispersing properties. However, previous studies focused on the effect of sulfate on the compatibility between PCE and cement, and there was a lack of research on silica fume. In this study, the workability of fresh cement and cement-silica fume paste and the mechanical properties of harden mortar were evaluated in the presence of different concentrations of five types of sulfates (Na2SO4, K2SO4, MgSO4, KAl(SO4)2, and CaSO4·2H2O) added in aqueous solution. The results show that soluble sulfates have a more adverse effect on the compatibility between PCE and cement-based materials with or without silica fume than slightly sulfate. And the effects of different sulfates on saturation points of PCE in cementitious materials and the mechanical properties of cement and cement-silica fume mortar are various. Finally, it is important to note that a high sulfate content in the solution can lead to salt precipitation of PCE, which is highly undesirable.