The dynamic behavior of first-order autonomous space invariant cellular neural networks (CNNs) is investigated. It is shown that complex dynamics may occur in very simple CNN structures, described by two-dimensional templates that present only vertical and horizontal couplings. The bifurcation processes are analyzed through the computation of the limit cycle Floquet's multipliers, the evaluation of the Lyapunov exponents and of the signal spectra. As a main result a detailed and accurate two-dimensional bifurcation diagram is reported. The diagram allows one to distinguish several regions in the parameter space of a single CNN. They correspond to stable, periodic, quasi-periodic, and chaotic behavior, respectively. In particular it is shown that chaotic regions can be reached through two different routes: period doubling and torus breakdown. We remark that most practical CNN implementations exploit first order cells and space-invariant templates: so far only a few examples of complex dynamics and no complete bifurcation analysis have been presented for such networks.