We develop a first-principles-based generalized mode-coupling theory (GMCT) for the tagged-particle motion of glassy systems. This theory establishes a hierarchy of coupled integro-differential equations for self-multi-point density correlation functions, which can formally be extended up to infinite order. We use our GMCT framework to calculate the self-nonergodicity parameters and the self-intermediate scattering function for the Percus-Yevick hard-sphere system based on the first few levels of the GMCT hierarchy. We also test the scaling laws in the α- and β-relaxation regimes near the glass-transition singularity. Furthermore, we study the mean-square displacement and the Stokes-Einstein relation in the supercooled regime. We find that qualitatively our GMCT results share many similarities with the well-established predictions from standard mode-coupling theory, but the quantitative results change, and typically improve, by increasing the GMCT closure level. However, we also demonstrate on general theoretical grounds that the current GMCT framework is unable to account for violation of the Stokes-Einstein relation, underlining the need for further improvements in the first-principles description of glassy dynamics.