In biological system models, gene expression levels are typically described by regulatory feedback mechanisms. Many studies of gene network models focus on dynamical interactions between components, but often overlook time delays. Here we present an extended model for gene regulatory networks with time delayed negative feedback, which is described by delay differential equations. We analyze nonlinear properties of the model in terms of chaos and compare the conditions with the benchmark homogeneous gene regulatory network model. Chaotic dynamics depend strongly on the inclusion of time delays, but the minimum motifs that show chaos differ when both original and extended models are considered. Our results suggest that, for a particular higher order extension of the gene network, it is possible to observe chaotic dynamics in a two-gene system without adding any self-inhibition. This finding can be explained as a result of modification of the original benchmark model induced by previously unmodeled dynamics. We argue that the inclusion of additional parameters in regulatory gene circuit models substantially enhances the likelihood of observing non-periodic dynamics.