We take up the study of integrable structures behind non-planar contributions to scattering amplitudes in $$ \mathcal{N}=4 $$ super Yang-Mills theory. Focusing on leading singularities, we derive the action of the Yangian generators on color-ordered subsets of the external states. Each subset corresponds to a single boundary of the non-planar on-shell diagram. While Yangian invariance is broken, we find that higher-level Yangian generators still annihilate the non-planar on-shell diagram. For a given diagram, the number of these generators is governed by the degree of non-planarity. Furthermore, we present additional identities involving integrable transfer matrices. In particular, for diagrams on a cylinder we obtain a conservation rule similar to the Yangian invariance condition of planar on-shell diagrams. To exemplify our results, we consider a five-point MHV on-shell function on a cylinder.