With the frequent occurrence of urban waterlogging, the concept and construction of sponge city have been carried out in many inland cities. Urban greening is not only an integral and important part of sponge cities, but also has a considerable impact on climate and urban landscape. This paper analyzes the function and existing problems of sponge city greening. In the past planning, the selection of certain trees brought problems such as flying catkins and pollen to people’s lives. Not only are they an allergen for many residents, but they also pose a fire hazard. At the same time, the construction of some green facilities lacks rationality. They are not only difficult to play the role of interception, but also easy to water in the flower bed in rainy weather, resulting in root rot. In addition, this paper also discusses the improvement of tree species and greening facilities. For some problem trees which are planted in a large area and difficult to renew in a short time, some mitigation measures are put forward. Finally, the vertical greening and rainwater gardens which have great potential in the green selection of sponge city are introduced. This paper is devoted to exploring more scientific and reasonable choices in the greening of sponge cities, while alleviating urban waterlogging and minimizing the impact on residents’ lives.