Poor alkali resistance and low ionic conductivity are the crux of the matter that hinder the commercialization applications of anion exchange membranes (AEMs). Here, we designed and synthesized a range of poly(phenylene oxide) (PPO)-based AEMs with benzyl free side-chain type. After that, the influences of different cationic functional groups, such as quaternary ammonium, imidazole and piperidine, on the membrane performances were examined systemically. The introduction of ether bond-containing side chains to build micro-phase separation structures enhanced the conductivity of AEMs (64 mS·cm−1 at 80 °C). At the same time, the side-chain without benzyl structures effectively avoids the influence of electron withdrawing groups on PPO main chains. Moreover, the steric hindrance effect of the benzene ring can further alleviate the attack of OH−, thereby improving the alkali resistance of the membrane. Molecular dynamics simulations revealed that a well-developed hydrogen bonding network was formed between ether linkages and water molecules in the side-chain structures, which enhanced the electrical conductivity of the membrane. Meanwhile, the prepared membranes owned a good water uptake and a certain dimensional stability. These results provide a basis for the subsequent enhancement of membrane performances.