Inspired by the charge-governed protein channels located in the cell membrane, a series of polyether ether ketone-based polymers with side chains containing ionically cross-linkable quaternary ammonium groups and acidic groups have been designed and synthesized to prepare monovalent cation-selective membranes (MCEMs). Three acidic groups (sulfonic acid, carboxylic acid, and phenolic hydroxyl) with different acid dissociation constant (pKa) were selected to form the ionic cross-linking structure with quaternary ammonium groups in the membranes. The ionic cross-linking induced the nanophase separation and constructed ionic channels, which resulted in excellent mechanical performance and high cation fluxes. Interesting, the cation flux of membranes increased as the ionization of acidic groups increase, but the selectivity of MCEMs did not follow the same trend, which was mainly dependent on the affinity between the functional groups and the cations. Carboxyl group-containing MCEMs exhibited the best selectivity (9.01 for Li+/Mg2+), which was higher than that of the commercial monovalent cation-selective CIMS membrane. Therefore, it is possible to prepare stable MCEMs through a simple process using ionically cross-linkable polymers, and tuning acidic groups in the membranes provided an attractive approach to improving the cation flux and selectivity of MCEMs.