GeV and TeV emission from the forward shocks of supernova remnants (SNRs) indicates that they are capable particle accelerators, making them promising sources of Galactic cosmic rays (CRs). However, it remains uncertain whether this γ-ray emission arises primarily from the decay of neutral pions produced by very-high-energy hadrons, or from inverse-Compton and/or bremsstrahlung emission from relativistic leptons. By applying a semi-analytic approach to non-linear diffusive shock acceleration, and calculating the particle and photon spectra produced in different environments, we parameterize the relative strength of hadronic and leptonic emission. We show that even if CR acceleration is likely to occur in all SNRs, the observed photon spectra may primarily reflect the environment surrounding the SNR: the emission is expected to look hadronic unless the ambient density is particularly low (with proton number density ≲0.1 cm−3) or the photon background is enhanced with respect to average Galactic values (with radiation energy density u rad ≳ 10 eV cm−3). We introduce a hadronicity parameter to characterize how hadronic or leptonic we expect a source to look based on its environment, which can be used to guide the interpretation of current γ-ray observations and the detection of high-energy neutrinos from SNRs.