This study aims to investigate the various responses of the optical characteristics to He-ion irradiation at different fluences and energies in Nd,Y:CaF2 crystals. Through optical absorption and photoluminescence spectra, we observe that electrons excited by He-ion irradiation are trapped by anionic vacancies, He ions and Nd3+ to form F-centers, He atoms and Nd2+, respectively. At an energy of 5 MeV, F-centers decrease with increasing fluence, whereas at a fluence of 1×1013 ions/cm2, increasing the energy promotes Nd2+ formation, and a further increase in the fluence based on an energy of 16 MeV can significantly promote Nd2+ production. After the irradiation, the electrons from F-centers are also captured by Nd3+, leading to the decay of F-centers and an increase in Nd2+ with time. In addition, the growth of CaF2 dendrites with multiple morphologies on the surface by high-energy irradiation was observed. It was explained by the surface recrystallization between the escape of F and surface metallization due to high-energy irradiation. This research provides significant insights into the conditions of irradiation modulating defect generation and evolution, as well as laying the groundwork for future applications of radiation-exposed crystals as radiation dosimeters and lasers.