We discuss various aspects of the dimensional reduction of gravity with the Einstein–Hilbert action supplemented by a lowest-order deformation formed as the Riemann tensor raised to powers two, three or four. In the case of R2 we give an explicit expression, and discuss the possibility of extended coset symmetries, especially for reduction on an n-torus to three dimensions. Then we start an investigation of the dimensional reduction of R3 and R4 by calculating some terms relevant for the coset formulation, aiming in particular towards in three dimensions and an investigation of the derivative structure. We emphasize some issues concerning the need for the introduction of non-scalar automorphic forms in order to realize certain expected enhanced symmetries.