A class of interval Cohen-Grossberg neural networks with time-varying delays and infinite distributed delays is investigated. By employing H-matrix and M-matrix theory, homeomorphism techniques, Lyapunov functional method, and linear matrix inequality approach, sufficient conditions are established for the existence, uniqueness, and global robust exponential stability of the equilibrium point and the periodic solution to the neural networks. Our results improve some previously published ones. Finally, numerical examples are given to illustrate the feasibility of the theoretical results and further to exhibit that there is a characteristic sequence of bifurcations leading to a chaotic dynamics, which implies that the system admits rich and complex dynamics.