This paper presents a study on the characterization of the moderate energy impact response between the elastic-plastic plate and the elastic-plastic sphere. An equivalent contact stiffness is proposed to substitute the linear contact stiffness, and a universal analytical expression is presented according to the intensive FE simulations for different material combinations under moderate impact energy. Then, a modified characterization diagram is suggested using the analytical expression. The modified diagram is validated by the FE simulations and experimental results. The results show the modified diagram can predict the maximum impact force and the response type in a fast and simple way.