High-speed electromagnetic actuator (HEA) is the key component of Electronic fuel injection system (EFIS) of diesel engine, its dynamic performances have a significant impact on the control accuracy and flexible control law of fuel injection. In order to obtain the higher dynamic response speed, lower power consumption, higher safety and reliability, a novel HEA with permanent magnet (NPMHEA) was proposed based on the principle of parallel magnetic circuit in this paper. Then the simulation models of HEA coupling of magnetic field, electric circuit and mechanical motion were developed by the method of time-stepping finite element, and their precisions were verified by experiment. By the comparative analysis, influence rules of key parameters on the dynamic performances of HEA have been established. In addition, the multi-objective optimization of NPMHEA based on response surface methodology and Genetic algorithm (GA) was carried out and the Pareto optimal solution set was obtained. It is concluded that there are contradictions between objectives for the Pareto optimal solutions; considering the whole performances, the optimal solution is determined for which the peak current, the peak pulse and the hold current reduce by 20.5 %, 7.8 % and 43.9 %, respectively, and the actuation response speed quickens by 11.9 %, significantly reducing the power consumption and coil loss and improving the dynamic response speed of HEA. It decisively provides certain theoretical guidance for the design and optimization of HEA.