Visual pigments are essential for converting light into electrical signals during vision. Composed of an opsin protein and a retinal-based chromophore, pigments in vertebrate rods (Rh1) and cones (Rh2) have different spectral sensitivities, with distinct peak absorption wavelengths determined by the shape and composition of the chromophore binding pocket. Despite advances in understanding Rh1 pigments such as bovine rhodopsin, the molecular basis of spectral shifts in Rh2 cone opsins has been less studied, particularly the E122Q mutation, which accounts for about half of the observed spectral shift in these pigments. In this study, we employed molecular modeling and quantum mechanical techniques to investigate the molecular mechanisms behind the spectral difference in blue-shifted Rh2-1 (absorption peak = 467 nm, 122Q) and green-shifted Rh2-4 (absorption peak = 505 nm, 122E) zebrafish cone opsins. We modeled the pigments 3D structures based on their sequences and conducted all-atom molecular dynamics simulations totaling 2 microseconds. Distance analysis of the trajectories identified three key sites: E113, E181, and E122. The E122Q mutation, previously known, validates our findings, while E181 and E113 are newly identified contributors. Structural analysis revealed key features with differing values that explain the divergent spectral sensitivities of Rh2-1 and Rh2-4: 1) chromophore atom fluctuations and C5-C6 torsion angle, 2) binding pocket volume, 3) hydration patterns, and 4) E113-chromophore interaction stability. Quantum mechanics further confirms the critical role of residue E181 in Rh2-1 and E122 in Rh2-4 for their spectral behavior. Our study provides new insights into the molecular determinants of spectral shifts in cone opsins, and we anticipate that it will serve as a starting point for a broader understanding of the functional diversity of visual pigments.