Air-to-ground (A2G) communication based on Unmanned aerial vehicle (UAV) is an important part of the future communication system. In this paper, an A2G channel model with UAV three-dimensional (3D) wobbles (pitch, roll, and yaw) based on the geometry-based stochastic model (GBSM) is proposed. On this basis, the UAV’s internal vibration is modeled as a sinusoidal random process, and the UAV wobble caused by the atmospheric flow is modeled as the uniform distribution random process. We derive the channel temporal correlation function (CF) with UAV 3D wobbles, analyze the variation of the temporal CF with different carrier frequencies, and amplitudes of the wobble angles. It is found that, even if the UAV wobbles slightly, the channel temporal correlation will be significantly affected. Numerical results show that the channel CF will decrease rapidly with the increase of the amplitudes of wobble angles and the carrier frequency. Therefore, the coherence time of millimeter wave (mmWave) band is significantly less than that of sub-6 GHz band. The consistency of simulation results and measurement results in published papers ensures the availability of the proposed model. For the MUAVs scenario, when the distance between different UAVs is much greater than the wavelength, the A2G channels between different UAVs and user equipment (UE) on the ground are not correlated to each other, and the temporal auto-correlation function (ACF) of each UAV is the same as that of the SUAV scenario. This work contributes to the theoretical exploration and system design of A2G communication based on UAV.