Direct numerical simulations of channel flow and temporal boundary layer at a Reynolds number $Re_{\tau } = 1500$ are used to assess the scale-by-scale mechanisms of wall turbulence. From the peak of turbulence production embedded at the small scales of the near-wall region, spatially ascending reverse cascades are generated that move through self-similar eddies growing in size with the wall distance. These fluxes are followed by spatially ascending forward cascades through detached eddies thus reaching sufficiently small scales where eventually scale energy is dissipated. This phenomenology is shared by both boundary layer and channel flow and is recognized as a robust physical feature characterizing wall turbulence in general. Specific features related to the flow configuration are indeed identified in the outer region. In particular, the central region of channels is characterized by a generalized Richardson energy cascade where large scales are in equilibrium with small scales at different wall distances through a combined forward cascade and spatial flux. On the contrary, the interface region of boundary layers is characterized by an almost two-dimensional physics where spatially ascending reverse cascades sustain long and wide interface structures with a forward cascade that survives only in the wall-normal scales. The overall scenario consists in a variety of scale motions that while protruding from the turbulent core towards the external region, squeeze at the interface thus sustaining vertical shear in a thin layer. The observed multidimensional physics sheds light on the complex interactions between outer entrainment and near-wall self-sustaining mechanisms with possible repercussions for theories.