In this work, to investigate the metal doping on the third-order nonlinear optical properties of NiO thin films under femtosecond pulsed laser excitation, pure NiO and 2w,4w,6w,8w Zn doped-NiO nanofilms were prepared by DC-RF co-sputtering technique. Then, the nonlinear absorption properties and nonlinear refractive properties of the five samples were investigated using the femtosecond laser at a wavelength of 515 nm. The experimental results show that the nonlinear absorption and nonlinear refractive properties of NiO are enhanced by the doped metal as well as the effect of defects. In addition, by varying the pump light intensity, we observed the transition of nonlinear absorption from the coexistence of saturated absorption and reverse saturated absorption to reverse saturated absorption. We established a multi-energy level system to interpret the nonlinear absorption and nonlinear refractive results, which broadens the application of NiO thin films in the field of nonlinear optics.