The beam dynamics optimization study of Rhodotron electron accelerator for irradiation sterilization is introduced in this paper. The Rhodotron accelerator acceleration principle and the RF field distribution in the coaxial resonant cavity are described in detail. Beam dynamics in the Rhodotron accelerator are analyzed from both transverse and longitudinal directions. Beam dynamics of two kinds of Rhodotron electron accelerators with maximum beam energy of 10 MeV and 40 MeV were optimized based on multi-objective genetic algorithm. The key parameters of Rhodotron accelerators are determined, and the influence of some parameters on the overall acceleration effect is quantitatively analyzed. This paper provides some references for the research, manufacture, installation, and commissioning of this type of accelerator.