Heparan sulphate (HS) can act as a co-receptor on the cell surface and alterations in this process underpin many pathological conditions. We have previously described the usefulness of mimics of HS (glycomimetics) in protection against β-glycerophosphate-induced vascular calcification and in the restoration of the functional capacity of diabetic endothelial colony-forming cells in vitro. This study aims to investigate whether our novel glycomimetic compounds can attenuate glycated low-density lipoprotein (g-LDL)-induced calcification by inhibiting RAGE signalling within the context of critical limb ischemia (CLI). We used an established osteogenic in vitro vascular smooth muscle cell (VSMC) model. Osteoprotegerin (OPG), sclerostin and glycation levels were all significantly increased in CLI serum compared to healthy controls, while the vascular calcification marker osteocalcin (OCN) was down-regulated in CLI patients vs. controls. Incubation with both CLI serum and g-LDL (10 µg/mL) significantly increased VSMC calcification vs. controls after 21 days, with CLI serum-induced calcification apparent after only 10 days. Glycomimetics (C2 and C3) significantly inhibited g-LDL and CLI serum-induced mineralisation, as shown by a reduction in alizarin red (AR) staining and alkaline phosphatase (ALP) activity. Furthermore, secretion of the osteogenic marker OCN was significantly reduced in VSMCs incubated with CLI serum in the presence of glycomimetics. Phosphorylation of cyclic AMP response element-binding protein (CREB) was significantly increased in g-LDL-treated cells vs. untreated controls, which was attenuated with glycomimetics. Blocking CREB activation with a pharmacological inhibitor 666-15 replicated the protective effects of glycomimetics, evidenced by elevated AR staining. In silico molecular docking simulations revealed the binding affinity of the glycomimetics C2 and C3 with the V domain of RAGE. In conclusion, these findings demonstrate that novel glycomimetics, C2 and C3 have potent anti-calcification properties in vitro, inhibiting both g-LDL and CLI serum-induced VSMC mineralisation via the inhibition of LDLR, RAGE, CREB and subsequent expression of the downstream osteogenic markers, ALP and OCN.