The crosswind responses of tall slender structures play an important role for the wind-resistant design, and they can be significantly influenced by the wind fields. There was a prevailing belief that the aeroelastic response of tall-slender structures was mostly observed under low-turbulent suburban flow. Nevertheless, aeroelastic response of tall-slender structures with substantially higher height and aspect ratio in high-turbulent urban flow may occur, remains unverified in the absence of empirical evidence. Moreover, the aeroelastic instability of vortex resonance and galloping of square-section tall-slender structures should be carefully addressed, especially the combined vortex resonance and galloping may occur. From these particular standpoints, this study aims to discuss the impacts of wind fields on the wind-induced vibrations in crosswind direction of square-sectioned tall-slender structures with aspect ratio 12, 16 and 20 through pivot model tests. The findings demonstrate the crosswind response of the model with λ = 12 is suppressed when it is in urban flow since the turbulence intensity profile is significantly large. Due to the sufficient height and slenderness, aeroelastic effects can occur for the aeroelastic models with λ = 16 and 20 in both suburban and urban flows. The combined vortex resonance and galloping effects are observed for the aeroelastic models with λ = 16 and 20 when they are low damped, even in urban flow. Thus, the attention should be paid to the crosswind response under urban flow for wind-resistant design of tall-slender structures with large aspect ratios and heights in practice.