We deploy an unmanned aerial vehicle (UAV) equipped with a large-scale uniform planar array (UPA) to serve multiple ground users in millimeter-wave band. Particularly, the practical UAV jitter is carefully considered, which may affect the beam gains and impact the communication quality. To provide a stable service, we first model the attitude change of the UPA caused by UAV jitter. Then, an optimization problem is formulated to maximize the minimum achievable rate of the users by optimizing the position and robust hybrid beamforming of the UAV. To solve the non-convex problem with highly coupled variables, a two-stage optimization strategy is developed. The first stage aims to decouple the beamforming from the original problem and design the UAV deployment under the assumption of an ideal beam pattern. The second stage aims to design robust hybrid beamforming with the obtained UAV position. Specifically, we first design analog beamforming for wide beams to cover the potential jitter angle range for each user via a chirp sequence-inspired method. Then, with equivalent channel estimation, we design digital beamforming by combining zero-forcing and water-filling power allocation algorithms. Extensive simulation results show the performance superiority of the proposed solution compared to the benchmark algorithms.