In this paper, a dynamic two-stage Cournot duopoly game with R&D efforts is built. Then, the local stability of the equilibrium points are discussed, and the stability condition of the Nash equilibrium point is also deduced through Jury criterion. The complex dynamical behaviors of the built model are investigated by numerical simulations. We found that the unique route to chaos is flip bifurcation, and the increase of adjusting speed will cause the system to lose stability and produce more complex dynamic behavior. In addition, we also found the phenomenon of multistability in the given model. Several kinds of coexistence of attractors are shown. In particular, we found that boundary attractors can coexist with internal attractors, which also aggravates the complexity of the system. At last, the chaotic state in the built system has been successfully controlled.