The macroscopic forcing method (MFM) of Mani and Park [1] and similar methods for obtaining turbulence closure operators, such as the Green's function-based approach of Hamba [2], recover reduced solution operators from repeated direct numerical simulations (DNS). MFM has already been used to successfully quantify Reynolds-averaged Navier–Stokes (RANS)-like operators for homogeneous isotropic turbulence and turbulent channel flows. Standard algorithms for MFM force each coarse-scale degree of freedom (i.e., degree of freedom in the RANS space) and conduct a corresponding fine-scale simulation (i.e., DNS), which is expensive. We combine this method with an approach recently proposed by Schäfer and Owhadi [3] to recover elliptic integral operators from a polylogarithmic number of matrix–vector products. The resulting Fast MFM introduced in this work applies sparse reconstruction to expose local features in the closure operator and reconstructs this coarse-grained differential operator in only a few matrix–vector products and correspondingly, a few MFM simulations. For flows with significant nonlocality, the algorithm first “peels” long-range effects with dense matrix–vector products to expose a more local operator. We demonstrate the algorithm's performance for the eddy diffusivity and eddy viscosity operators, which correspond to the unclosed parts of the ensemble-averaged transport equations, excluding the analytically known, closed parts of such equations. However, the algorithm can also be applied to the full operators. We focus on scalar transport in a laminar channel flow and momentum transport in a turbulent channel flow. For these problems, we recover eddy diffusivity- and eddy viscosity-like operators, respectively, at 1% of the cost of computing the exact operator via a brute-force approach for the laminar channel flow problem and 13% for the turbulent one. Applying these operators to compute the averaged fields of interest has visually indistinguishable behavior from the exact solution. Our results show that a similar number of simulations are required to reconstruct the operators to the same accuracy under grid refinement. Thus, the accuracy corresponds to the physics of the problem, not the numerics, so long as the grid is sufficiently refined. We glean that for problems in which the RANS space is reducible to one dimension, eddy diffusivity, and eddy viscosity operators can be reconstructed with reasonable accuracy using only a few simulations, regardless of simulation resolution or degrees of freedom.