Advancing electrochemical energy storage devices relies on versatile analytical tools capable of revealing the molecular mechanisms behind the function and degradation of battery materials in situ. The nuclear magnetic resonance phenomenon plays a pivotal role in fundamental studies of energy materials and devices because of its exceptional sensitivity to local environments and the dynamics of many electrochemically relevant elements. The jelly roll architecture is one of the most energy-dense and, therefore, most popular concepts implemented in pouch, prismatic, and cylindrical Li- and Na-ion cells. Such widely commercialized designs, however, represent a significant obstacle for a range of powerful in situ magnetic resonance-based methodologies due to negligible radio frequency electromagnetic field penetration through conductive metal casings and current collectors. In this work, we introduce an experimental setup that enables direct RF wave transmission through the cell terminals and current collectors, and provides efficient excitation and detection of NMR signals. An RF adapter designed as a plug-and-play device effectively turns the battery cell into an NMR probe that can be tuned to a broad range of Larmor frequencies. Due to its exceptional sensitivity, versatility, and multinuclear capability, the proposed methodology is suitable for fundamental research and industrial high-throughput screening applications. In situ NMR lineshapes provide a direct quantitative description of the chemical environments of electrochemically active elements and enable new metrics for the accurate assessment of state-of-charge (SoC) and state-of-health (SoH). Specifically, in commercial pouch cells based on lithium cobalt oxide, lithium nickel manganese cobalt oxide, and sodium nickel iron manganese oxide chemistries, 7Li and 23Na NMR data unambiguously show electrochemical transformations between intercalated and metallic forms of charge carrier ions, and reveal anisotropic magnetic properties of the electrode coating.