City parks can cool the surrounding environment and mitigate the urban heat island (UHI) effect, considerable improving the city’s adaptability to climate. In this study, 20 city parks in Nanjing, China, were considered, and four indexes for quantifying the cooling benefits from a cumulative impact perspective were proposed. These indexes are park cooling area (PCA), park cooling efficiency (PCE), park cooling intensity (PCI), and park cooling gradient (PCG). The results reveal the following: first, city parks have a positive impact on the surrounding thermal environment. The factors park area (PA), park perimeter (PP), landscape shape index (LSI), and normalized difference vegetation index (NDVI) determine cooling benefits. Second, PA and PP are significantly positively correlated with PCA but are significantly negatively correlated with PCE. LSI is negatively correlated with PCE, while NDVI is positively correlated with PCI and PCG. No significant correlation exists between the four cooling indexes and modified normalized difference water index(MNDWI). Finally, different parks exhibit variations in their ability to provide cooling benefits. Special or community parks are more appropriately situated in areas with constrained urban land resources. In designing comprehensive parks, the intricate boundary features and vegetation conditions need to be considered to optimize their cooling effects. Moreover, a larger number of residents are allowed to enjoy cooling services. The findings of this project will aid in the construction and optimization of city parks in future to combat the UHI effect.