The authors (Hou and Yin, 2017 [9]; Hou et al., 2018 [10]) proved that the 2D and 3D irrotational compressible Euler equations with critical time depending damping admit global classical solutions. In this paper, we will study this problem with non-zero vorticity and show the global existence of smooth solutions to the 2D and 3D compressible Euler equations with critical time depending damping. They used the Lorentz vector field and their method fails in the presence of the vorticity. The main ingredients in this paper are the auxiliary energies which will make up for the loss of the Lorentz vector field and the improved decay estimates of the energy which can be achieved by a new multiplier.