A partial perpendicular anisotropy and a reproducible inverted minor hysteresis loop with a negative remanence were observed in Ta/NiFe/Ta. The minor inverted hysteresis loop appears only when the magnetic field is perpendicular to the film plane normal or deviates at several degrees from the normal of the film plane. This phenomenon is ascribed to the antiferromagnetic-like coupling between the co-existent minor magnetic moment with perpendicular anisotropy at the Ta/NiFe interface and major magnetic moment with in-plane anisotropy in the bulk of NiFe layer.