Luminescent solar concentrators (LSCs) are all-photonic, semitransparent solar devices with great potential in the emerging fields of building-integrated photovoltaics and agrivoltaics. Over the past decade, particularly with the advent of quantum dot (QD) LSCs, tremendous progress has been made in terms of photovoltaic efficiency and device size by increasing solar spectral coverage and suppressing reabsorption losses. Despite these advances in LSC design, the effects of environmental conditions such as rain, dust, and dirt deposits, which are ubiquitous in both urban and agricultural environments, on LSC performance have been largely overlooked. Here, we address these issues by systematically investigating the environmental effects on the solar harvesting and waveguiding capability of state-of-the-art QD-LSCs, namely, the presence of airborne pollutants (dust), water droplets, and dried deposits. Our results show that dust is unexpectedly insignificant for the waveguiding of the concentrated luminescence and only reduces the LSC efficiency through a shadowing effect when deposited on the outer surface, while dust accumulation on the inner LSC side increases the output power due to backscattering of transmitted sunlight. Water droplets, on the other hand, do not dim the incident sunlight, but are detrimental to waveguiding by forming an optical interface with the LSC. Finally, dried deposits, which mimic the evaporation residues of heavy rain or humidity, have the worst effect of all, combining shading and waveguide losses. These results are relevant for the design of application-specific surface functionalization/protection strategies real LSC modules.