In this paper, we studied the output characteristics of optical soliton in a passively mode-locked ytterbium (Yb)-doped fiber laser by numerical simulation. The structure of the passively mode-locked Yb-doped fiber laser was studied by modeling and analysis. The influence of the inter-cavity average group velocity dispersion on pulse width, pulse peak power and single pulse energy of optical soliton and self-similar pulse was investigated. Simulation results were very instructive for the practical application of the passiavely mode-locked Yb-doped fiber lasers.