In eukaryotes, heterochromatin plays a critical role in organismal development and cell fate acquisition, through regulating gene expression. The evolutionarily conserved lysine-specific demethylases, Lsd1 and Lsd2, remove mono- and dimethylation on histone H3, serving complex roles in gene expression. In the fission yeast Schizosaccharomyces pombe, null mutations of Lsd1 and Lsd2 result in either severe growth defects or inviability, while catalytic inactivation causes minimal defects, indicating that Lsd1 and Lsd2 have essential functions beyond their known demethylase activity. Here, we show that catalytic mutants of Lsd1 or Lsd2 partially assemble functional heterochromatin at centromeres in RNAi-deficient cells, while the C-terminal truncated alleles of Lsd1 or Lsd2 exacerbate heterochromatin formation at all major heterochromatic regions, suggesting that Lsd1 and Lsd2 repress heterochromatic transcripts through mechanisms both dependent on and independent of their catalytic activities. Lsd1 and Lsd2 are also involved in the establishment and maintenance of heterochromatin. At constitutive heterochromatic regions, Lsd1 and Lsd2 regulate one another and cooperate with other histone modifiers, including the class II HDAC Clr3 and the Sirtuin family protein Sir2 for gene silencing, but not with the class I HDAC Clr6. Our findings explore the roles of lysine-specific demethylases in epigenetic gene silencing at heterochromatic regions.