Urban green spaces (UGS) play a critical role in mitigating the urban heat island (UHI) effect and addressing climate change challenges through their cooling effects. Expanding green space and optimizing its layout are key strategies in urban planning. However, with limited land resources, maximizing cooling efficiency becomes crucial. While previous studies have yet to reach a consensus on the optimal UGS size threshold for achieving maximum cooling efficiency, this study employs high-resolution remote sensing imagery to extract 25,594 UGS patches in Xi’an and explores the scale dependency of UGS cooling effects. Results show that 54.20% of the patches exhibit a “cooling island effect”, reducing surface temperatures by 0.10 ± 0.13 °C to 1.66 ± 1.15 °C. A nonlinear relationship was observed between cooling intensity and UGS size, influenced by vegetation coverage and edge complexity. Further analysis reveals that medium-sized UGS have the highest cooling efficiency. These UGS were categorized into five functional zones to explore the dominant factors affecting cooling efficiency in each zone, and corresponding strategies for improvement were proposed. These findings provide insights into optimizing UGS layout and refining the cooling efficiency thresholds.