Two-dimensional materials have attracted considerable research attention recently due to their extraordinary physical and chemical properties. In this paper, we systematically investigate the electronic structure of ultrathin tetragonal CoSe films with different thicknesses that are isostructural to two-dimensional high-temperature superconductor FeSe using high-resolution angle-resolved photoemission spectroscopy, scanning tunneling microscopy, and ab initio calculation. Interestingly, the nonsymmorphic symmetry of the CoSe monolayer protects both exotic saddle band degeneracy and Dirac points, realizing two-dimensional Dirac fermions. Our temperature and film-thickness-dependent measurements reveal momentum-dependent electron-phonon coupling in CoSe films, which is enhanced with reduced film thickness. Moreover, the electronic states in the CoSe monolayer strongly couple to high-frequency phonons in the $\mathrm{SrTi}{\mathrm{O}}_{3}$ substrate, similar to the situation in the FeSe monolayer. Our results not only present a platform to investigate the electronic properties in close vicinity of the high-temperature superconductor FeSe monolayer, but also shed light on the understanding of the coupling between two-dimensional materials and substrates beneath.