The e-vector orientation of linearly polarized light represents an important visual stimulus for many insects. Especially the detection of polarized skylight by many navigating insect species is known to improve their orientation skills. While great progress has been made towards describing both the anatomy and function of neural circuit elements mediating behaviors related to navigation, relatively little is known about how insects perceive non-celestial polarized light stimuli, like reflections off water, leaves, or shiny body surfaces. Work on different species suggests that these behaviors are not mediated by the “Dorsal Rim Area” (DRA), a specialized region in the dorsal periphery of the adult compound eye, where ommatidia contain highly polarization-sensitive photoreceptor cells whose receptive fields point towards the sky. So far, only few cases of polarization-sensitive photoreceptors have been described in the ventral periphery of the insect retina. Furthermore, both the structure and function of those neural circuits connecting to these photoreceptor inputs remain largely uncharacterized. Here we review the known data on non-celestial polarization vision from different insect species (dragonflies, butterflies, beetles, bugs and flies) and present three well-characterized examples for functionally specialized non-DRA detectors from different insects that seem perfectly suited for mediating such behaviors. Finally, using recent advances from circuit dissection in Drosophila melanogaster, we discuss what types of potential candidate neurons could be involved in forming the underlying neural circuitry mediating non-celestial polarization vision.