Epigenetic modifications undergo drastic erasure and reestablishment after fertilization. This reprogramming is required for proper embryonic development and cell differentiation. In mammals, some histone modifications are not completely reprogrammed and play critical roles in later development. In contrast, in nonmammalian vertebrates, most histone modifications are thought to be more intensively erased and reestablished by the stage of zygotic genome activation (ZGA). However, histone modifications that escape reprogramming in nonmammalian vertebrates and their potential functional roles remain unknown. Here, we quantitatively and comprehensively analyzed histone modification dynamics during epigenetic reprogramming in Japanese killifish, medaka (Oryzias latipes) embryos. Our data revealed that H3K27ac, H3K27me3, and H3K9me3 escape complete reprogramming, whereas H3K4 methylation is completely erased during cleavage stage. Furthermore, we experimentally showed the functional roles of such retained modifications at early stages: (i) H3K27ac premarks promoters during the cleavage stage, and inhibition of histone acetyltransferases disrupts proper patterning of H3K4 and H3K27 methylation at CpG-dense promoters, but does not affect chromatin accessibility after ZGA; (ii) H3K9me3 is globally erased but specifically retained at telomeric regions, which is required for maintenance of genomic stability during the cleavage stage. These results expand the understanding of diversity and conservation of reprogramming in vertebrates, and unveil previously uncharacterized functions of histone modifications retained during epigenetic reprogramming.