We study lattice fermions from the viewpoint of spectral graph theory (SGT). We find that a fermion defined on a certain lattice is identified as a spectral graph. SGT helps us investigate the number of zero eigenvalues of lattice Dirac operators even on the non-torus and non-regular lattice, leading to understanding of the number of fermion species (doublers) on lattices with arbitrary topologies. The procedure of application of SGT to lattice fermions is summarized as follows: (1) One investigates a spectral graph corresponding to a lattice fermion. (2) One obtains a matrix corresponding to the graph. (3) One finds zero eigenvalues of the matrix by use of the discrete Fourier transformation (DFT). (4) By taking an infinite-volume and continuum limits, one finds the number of species. We apply this procedure to the known lattice fermion formulations including Naive fermions, Wilson fermions and Domain-wall fermions, and reproduce the known fact on the number of species. We also apply it to the lattice fermion on the discretized fourdimensional hyperball and discuss the number of fermion species on the bulk. In the end of the paper, we discuss the application of the analysis to lattice fermions on generic lattices with arbitrary topologies, which could lead to constructing a new theorem regarding the number of species.