Stimulated Brillouin scattering (SBS) is often an unwanted loss mechanism in both active and passive fibers. Highly multimode excitation of fibers has been proposed as a novel route toward efficient SBS suppression. Here, we develop a detailed, quantitative theory which confirms this proposal and elucidates the physical mechanisms involved. Starting from the vector optical and scalar acoustic equations, we derive appropriate nonlinear coupled mode equations for the signal and Stokes modal amplitudes and an analytical formula for the SBS (Stokes) gain with applicable approximations, such as the neglect of shear effects. This allows us to calculate the exponential growth rate of the Stokes power as a function of the distribution of power in a highly multimode signal. The peak value of the gain spectrum across the excited modes determines the SBS threshold—the maximum SBS-limited power that can be sent through the fiber. The theory shows that the peak SBS gain is greatly reduced by highly multimode excitation due to gain broadening and relatively weaker intermodal SBS gain. The inclusion of exact vector optical modes in the calculation is crucial in order to capture the incomplete intermodal coupling due to mismatch of polarization patterns of higher-order modes. We demonstrate that equal excitation of the 160 modes of a commercially available, highly multimode circular step index fiber raises the SBS threshold by a factor of 6.5 and find comparable suppression of SBS in similar fibers with a D-shaped cross section. Published by the American Physical Society 2024