Eye size affects many aspects of visual function, but eyes are costly to grow and maintain. The allometry of eyes can provide insight into this trade-off, but this has mainly been explored in species that have two eyes of equal size. By contrast, animals possessing larger visual systems can exhibit variable eye sizes within individuals. Spiders have up to four pairs of eyes whose sizes vary dramatically, but their ontogenetic, static, and evolutionary allometry has not yet been studied in a comparative context. We report variable dynamics in eye size across 1,098 individuals in 39 species and 8 families, indicating selective pressures and constraints driving the evolution of different eye pairs and lineages. Supplementing our sampling with a recently published phylogenetically comprehensive dataset, we confirmed these findings across more than 400 species; found that ecological factors such as visual hunting, web building, and circadian activity correlate with eye diameter; and identified significant allometric shifts across spider phylogeny using an unbiased approach, many of which coincide with visual hunting strategies. The modular nature of the spider visual system provides additional degrees of freedom and is apparent in the strong correlations between maximum/minimum investment and interocular variance and three key ecological factors. Our analyses suggest an antagonistic relationship between the anterior and posterior eye pairs. These findings shed light on the relationship between spider visual systems and their diverse ecologies and how spiders exploit their modular visual systems to balance selective pressures and optical and energetic constraints.