Heterochromatin de-condensation in companion gametic cells is conserved in both plants and animals. In plants, microspore undergoes asymmetric pollen mitosis (PMI) to produce a vegetative cell (VC) and a generative cell (GC). Subsequently, the GC undergoes pollen mitosis (PMII) to produce two sperm cells (SC). Consistent with heterochromatin de-condensation in the VC, H3K9me2, a heterochromatin mark, is barely detected in VC. However, how H3K9me2 is differentially regulated during pollen mitosis remains unclear. Here, we show that H3K9me2 is gradually evicted from the VC since PMI but remain unchanged in the GC and SC. ARID1, a pollen-specific transcription factor that facilitates PMII, promotes H3K9me2 maintenance in the GC/SC but slows down its eviction in the VC. The genomic targets of ARID1 mostly overlaps with H3K9me2 loci, and ARID1 recruits H3K9 methyltransferase SUVH6. Our results uncover that differential pattern of H3K9me2 between two cell types is regulated by ARID1 during pollen mitosis.