Previous studies have shown that the terrain elevation of the ICESat-2's ATL08 product is of good accuracy, overall, but in urban areas under complex surface conditions, the terrain elevation is vulnerable to the influence of the effect of dense buildings, resulting in deviations and even outliers. However, the previous studies have not effectively corrected these deviations and outliers. To this end, we propose a method for correcting the terrain elevation of the ATL08 product in urban areas, which is an auto-refinement method for the terrain elevation. Based on the data characteristics of this type of terrain elevation data and the distribution characteristics of urban buildings, the proposed method innovatively corrects the deviated part of the terrain elevation by a water pump deployment criterion with the vertical contour of the terrain. To increase its applicability, the proposed method uses a strategy of mixing the terrain elevation data that are from the strong- and weak-beam observations, allowing the deviated terrain in one beam with a higher missing data rate to be corrected with the aid of the other beam with a lower missing data rate. We used airborne LiDAR data from several areas (New York, Amsterdam, and Palmerston North) with different city sizes to validate the corrected results. The results show that the root-mean-square error (RMSE) of the terrain elevation in urban areas is reduced from ∼4 m to ∼1 m after correction. The correction results also show that the proposed method can correct the deviated terrain elevation, while ensuring that the high-quality terrain elevation can be effectively retained.