The structure of zwitterion has great impact on the separation properties of zwitterionic hydrophilic stationary phases. To better understand the role of anionic groups of zwitterions, a novel carboxybetaine-based zwitterionic monolithic column was first prepared through thermo-initiated copolymerization of functional monomer (3-acrylamidopropyl)-dimethyl-(2-carboxymethyl) ammonium (CBAA) and crosslinker ethylene dimethacrylate (EDMA) within 100 μm ID capillary. The optimal poly(CBAA-co-EDMA) monolithic column exhibited satisfactory mechanical and chemical stability, good repeatability, high column efficiency (96,000 plates/m), and excellent separation performance for different classes of polar compounds (i.e., phenols, monophosphate nucleotides, urea and allantoin). A comparative study was then performed among three zwitterionic hydrophilic stationary phases containing different anionic groups, i.e. poly(CBAA-co-EDMA) (carboxybetaine), poly(2-{2-(methacryloyloxy) ethyldimethylammonium}ethyl n-butyl phosphate-co-EDMA) (phosphocholine), and poly(N,N-dimethyl-N-(3-methacrylamidopropyl)-N-(3-sulfopropyl) ammonium betaine-co-EDMA) (sulfobetaine) using benzoic acid derivatives, amine compounds, nucleobases and nucleosides as model analytes. The carboxybetaine-based monolithic column exhibited much higher positive zeta-potential and hydrophilicity, which endows it with a stronger retention capacity for acidic and neutral compounds, but sulfobetaine-based monolithic column exhibited much higher selectivity and retention capacity for the amines. Moreover, their enrichment efficiencies for N-glycopeptides were also evaluated based on their different hydrophilicity, and it was observed that the poly(CBAA-co-EDMA) monolithic material captured 4-8 times more N-glycopeptides compared to the other two materials.