Objective To investigate the dissipation and outcomes of pulmonary lesions at the first follow-up of patients who recovered from moderate and severe cases of COVID-19. Methods From January 21 to March 3, 2020, a total of 136 patients with COVID-19 were admitted to our hospital. According to inclusion and exclusion criteria, 52 patients who recovered from COVID-19 were included in this study, including 33 moderate cases and 19 severe cases. Three senior radiologists independently and retrospectively analyzed the chest CT imaging data of 52 patients at the last time of admission and the first follow-up after discharge, including primary manifestations, concomitant manifestations, and degree of residual lesion dissipation. Results At the first follow-up after discharge, 16 patients with COVID-19 recovered to normal chest CT appearance, while 36 patients still had residual pulmonary lesions, mainly including 33 cases of ground-glass opacity, 5 cases of consolidation, and 19 cases of fibrous strip shadow. The proportion of residual pulmonary lesions in severe cases (17/19) was statistically higher than in moderate cases (19/33) (χ2 = 5.759, P < 0.05). At the first follow-up, residual pulmonary lesions were dissipated to varying degrees in 47 cases, and lesions remained unchanged in 5 cases. There were no cases of increased numbers of lesions, enlargement of lesions, or appearance of new lesions. The dissipation of residual pulmonary lesions in moderate patients was statistically better than in severe patients (Z = −2.538, P < 0.05). Conclusion Clinically cured patients with COVID-19 had faster dissipation of residual pulmonary lesions after discharge, while moderate patients had better dissipation than severe patients. However, at the first follow-up, most patients still had residual pulmonary lesions, which were primarily ground-glass opacity and fibrous strip shadow. The proportion of residual pulmonary lesions was higher in severe cases of COVID-19, which required further follow-up.