We study the class of non-holonomic power series with integer coefficients that reduce, modulo primes, or powers of primes, to algebraic functions. In particular we try to determine whether the susceptibility of the square-lattice Ising model belongs to this class, and more broadly whether the susceptibility is a solution of a differentially algebraic equation. Initial results on Tutte's nonlinear ordinary differential equation (ODE) and other simple quadratic nonlinear ODEs suggest that a large set of differentially algebraic power series solutions with integer coefficients might reduce to algebraic functions modulo primes, or powers of primes. Since diagonals of rational functions are well-known to reduce, modulo primes, or powers of primes, to algebraic functions, a large subset of differentially algebraic power series with integer coefficients may be viewed as a natural ‘nonlinear’ generalisation of diagonals of rational functions. Here we give several examples of series with integer coefficients and non-zero radius of convergence that reduce to algebraic functions modulo (almost) every prime (or power of a prime). These examples satisfy differentially algebraic equations with the encoding polynomial occasionally possessing quite high degree (and thus difficult to identify even with long series). These examples shed important light on the very nature of such differentially algebraic series. Additionally, we have extended both the high- and low-temperature Ising square-lattice susceptibility series to 5043 coefficients. We find that even this long series is insufficient to determine whether it reduces to algebraic functions modulo 3, 5, etc. This negative result is in contrast to the comparatively easy confirmation that the corresponding series reduce to algebraic functions modulo powers of 2. Finally we show that even with 5043 terms we are unable to identify an underlying differentially algebraic equation for the susceptibility, ruling out a number of possible differentially algebraic forms.