In this paper different flow patterns of an annular jet with a stepped-conical nozzle as well as the transition between these patterns are numerically investigated as a function of the swirl number S which is the ratio of tangential momentum flux to axial momentum flux. The Reynolds number of the jet based on the axial velocity and the nozzle hydraulic diameter is 180. The 3D Navier Stokes equations are solved using the direct numerical simulation. Four different flow patterns are identified and their associated flow structures are discussed. Starting from an annular jet at zero swirl, spinning vortices around the central axis originate with increasing swirl. As the swirl is further increased, the onset of vortex breakdown occurs, followed by jet attachment to the nozzle. Decreasing the swirl number back from this flow pattern, the Coanda effect near the nozzle outlet creates a wall jet. This wall jet remains till the decreasing swirl number equals to zero, showing hysteresis in flow patterns between an increase and a subsequent decrease in swirl. The determined flow states are experimentally validated. Potential applications related to these flow patterns and their hysteretic behavior are also briefly discussed.