This paper builds on the theory of nonlinear generalized functions begun in Nigsch & Vickers (Nigsch, Vickers 2021 Proc. R. Soc. A 20200640 (doi:10.1098/rspa.2020.0640)) and extends this to a diffeomorphism-invariant nonlinear theory of generalized tensor fields with the sheaf property. The generalized Lie derivative is introduced and shown to commute with the embedding of distributional tensor fields and the generalized covariant derivative commutes with the embedding at the level of association. The concept of a generalized metric is introduced and used to develop a non-smooth theory of differential geometry. It is shown that the embedding of a continuous metric results in a generalized metric with well-defined connection and curvature and that for C 2 metrics the embedding preserves the curvature at the level of association. Finally, we consider an example of a conical metric outside the Geroch-Traschen class and show that the curvature is associated to a delta function.