Abstract The normalizer problem of integral group rings has been studied extensively in recent years due to its connection with the longstanding isomorphism problem of integral group rings. Class-preserving Coleman automorphisms of finite groups occur naturally in the study of the normalizer problem. Let G G be a finite group with a nilpotent subgroup N N . Suppose that G / N G\hspace{-0.0em}\text{/}\hspace{-0.0em}N acts faithfully on the center of each Sylow subgroup of N N . Then it is proved that every class-preserving Coleman automorphism of G G is an inner automorphism. In addition, if G G is the product of a cyclic normal subgroup and an abelian subgroup, then it is also proved that every class-preserving Coleman automorphism of G G is an inner automorphism. Other similar results are also obtained in this article. As direct consequence, the normalizer problem has a positive answer for such groups.