We report the multi-scale geometric analysis of Lagrangian structures in forced isotropic turbulence and also with a frozen turbulent field. A particle backward-tracking method, which is stable and topology preserving, was applied to obtain the Lagrangian scalar field φ governed by the pure advection equation in the Eulerian form ∂tφ + u · ∇φ = 0. The temporal evolution of Lagrangian structures was first obtained by extracting iso-surfaces of φ with resolution 10243 at different times, from t = 0 to t = Te, where Te is the eddy turnover time. The surface area growth rate of the Lagrangian structure was quantified and the formation of stretched and rolled-up structures was observed in straining regions and stretched vortex tubes, respectively. The multi-scale geometric analysis of Bermejo-Moreno & Pullin (J. Fluid Mech., vol. 603, 2008, p. 101) has been applied to the evolution of φ to extract structures at different length scales and to characterize their non-local geometry in a space of reduced geometrical parameters. In this multi-scale sense, we observe, for the evolving turbulent velocity field, an evolutionary breakdown of initially large-scale Lagrangian structures that first distort and then either themselves are broken down or stretched laterally into sheets. Moreover, after a finite time, this progression appears to be insensible to the form of the initially smooth Lagrangian field. In comparison with the statistical geometry of instantaneous passive scalar and enstrophy fields in turbulence obtained by Bermejo-Moreno & Pullin (2008) and Bermejo-Moreno et al. (J. Fluid Mech., vol. 620, 2009, p. 121), Lagrangian structures tend to exhibit more prevalent sheet-like shapes at intermediate and small scales. For the frozen flow, the Lagrangian field appears to be attracted onto a stream-surface field and it develops less complex multi-scale geometry than found for the turbulent velocity field. In the latter case, there appears to be a tendency for the Lagrangian field to move towards a vortex-surface field of the evolving turbulent flow but this is mitigated by cumulative viscous effects.