In this paper, we obtain the existence--uniqueness of solution to the second-order linear Fredholm integro-differential equation (FIDE) with Dirichlet boundary condition by hybridizable discontinuous Galerkin (HDG) method. A key property of these methods is to eliminate all internal degrees of freedom and to construct a linear system that only includes globally coupled unknowns at the element interfaces. After designing and implementing HDG algorithm, we provide some necessary and sufficient conditions based on the stabilization parameter and kernel function to guarantee the existence-uniqueness of the approximate solution. Then, some numerical examples are carried out to assess the performance of the present method. When comparing with existing some methods in literature, the experimental studies verify the reliability and feasibility of the HDG method for the problem under consideration.