Sox21 is thought to function as a counteracting partner of SoxB1 (Sox1, 2, 3) genes and is involved in cell fate determination. In this study, we comparatively analyzed the expression patterns and conserved cis-regulatory elements of the duplicated sox21 genes in zebrafish. In embryogenesis, sox21b is predominantly expressed in the telencephalon, hypothalamus, mesencephalon and lens, and sox21a is solely expressed in the midbrain-hindbrain boundary, olfactory placode and lateral line, while both genes are expressed in the hindbrain, spinal cord and ear. In adult, sox21a is expressed in the brain, skin, ovary and intestine, while sox21b is expressed in the brain and testis. Interestingly, all 16 pan-vertebrate conserved non-coding elements (CNEs) are asymmetrically preserved in the sox21b locus, whereas two fish-specific elements are kept in the sox21a locus, and this is correlated with increased evolutionary rate of the sox21a protein sequence. Transient transgenic reporter analysis revealed that six sox21b CNEs and two sox21a CNEs drove green fluorescent protein (GFP) expression in tissues correlated with the partitioning of expression in two orthologues. These results indicate that sox21a and sox21b have reciprocally lost expression domains of the ancestral gene reflected by degeneration of certain CNEs in their genomic loci and provide clear evidence for evolution of the duplicated sox21 genes by subfunctionalization. In addition, our data suggest that some CNEs-based regulatory pathways have been predominantly preserved in the sox21b locus.