The problem of in-orbit cooperative target enclosing involving N thrust-limited satellites under collision avoidance and maneuver amplitude constraints is studied. In order to find global optimal trajectories for target enclosing task with all constraints above, by integrating the collision threat and maneuver boundaries into a novel nonlinear cost functional, the studied target enclosing problem is described as a nonlinear nonzero-sum differential game. Further, to avoid iterative calculations caused by traditional nonlinear-game-solving methods, an approximate solution which can be constructed directly is designed. Then the approximate Nash equilibrium strategies can be educed by the constructive approximate solution for the proposed nonzero-sum game. Analysis shows that the proposed control strategies can asymptotically approach the exact one and can ensure a zero-error tracking of the enclosing configuration. Simulation results illustrate lower time costs and better enclosing accuracy while the collision avoidance and maneuver amplitude constraints are satisfied simultaneously.