Flow structures of non-swirling and swirling particle-laden turbulence are modeled using the large eddy simulation. Four-way coupling to reveal the interaction mechanism of gas to particle, particle to gas and particle-particle collisions is adopted by a new proposed subgrid scale (SGS) particle kinetic energy-granular temperature model. Evolution of particle vortices, particle coherent structures and particle dynamics are predicted numerically, and comparisons are also conducted. Predictions are in good agreement with experimental measurements. For non-swirling flows, the typical coherent structures, and larger vortices at downward region of gas flow are dominantly. However, particle transport characteristics are significantly different, distinctly coherent structures and more vortices have not been generated in additions to fewer ones at far distance from entrance. Meanwhile, fewer coherent structures and vortices that dispersed at corner recirculation are observed for swirling flow. Compared to gas flow, the number of particle vortices is less and Reynolds stress and kinetic energy transport behaviors of particle flow are relatively independent due to inertia. Gas fluctuations of shear stresses are approximately twice greater than those of particle in non-swirling flows. A novelty finding is that turbulent fluctuations and instantaneous gas vortices of non-swirling flow are stronger than swirling case.