Numerous studies have shown that the cooling efficiency (CE) of urban trees varies by cities with different climate backgrounds, and recent research further indicated that there may be large within-city variations in CE. However, how such within-city variations differ across cities, and their relations to the local percent of urban tree canopy (Ptree) remain poorly understood. This study aims to fill this gap based on a comparison study across 118 cities with different biomes and climates in the continental USA. We used the tree canopy layer of the National Land Cover Dataset (NLCD) 2011 to measure urban tree canopy (UTC), and calculated land surface temperature (LST) based on Landsat thermal bands. We found: 1) CE had larger within-city and cross-city spatial variations in cities located in arid and semi-arid biomes. 2) CE was related to Ptree in nonlinear ways in >90 % of the study cities. In most cities (approximately 70 %), CE had an L-shaped relationship with Ptree, showing that CE first declined quickly with the increase of Ptree, but then gradually dropped in a slower way or became relatively stable after Ptree reached a certain threshold. 3) While there was no significant difference in the types of CE-Ptree relationship among biomes and climates, the threshold of Ptree in CE-Ptree nonlinear ways was smaller in arid cities. The results of this threshold linking cooling benefits and current UTC can serve as a useful tool to prioritize locations for urban planting to maximize cooling benefits.