The real-world efficacy, prognostic factors, and adverse events of second-line nivolumab monotherapy and subsequent third-line therapy for unresectable or metastatic esophageal cancer have not been fully evaluated. This multi-institutional retrospective cohort study evaluated 184 consecutive patients treated with second-line nivolumab monotherapy for esophageal cancer between March 2021 and December 2022. We assessed tumor response, adverse events, long-term survival, and prognostic factors. Among 128 patients with measurable lesions, the response rate was 23% and the disease control rate for all enrolled patients was 45%. The incidence of grade 3 or higher adverse events was 14%, but no treatment-related deaths presented. Median progression-free survival was 5.1months and overall survival was 14months, respectively. C-reactive protein level and performance status were identified as significant prognostic factors of overall survival through Cox proportional hazards analysis. The group with two favorable prognostic factors showed better overall survival than the groups with either one or zero prognostic factors (median overall survival: 22, 15, and 4.4months, respectively). Among 69 patients who received third-line taxane anticancer agents, the progression-free survival was 6.7months. Our study demonstrated that the real-world outcomes of second-line nivolumab monotherapy were comparable to those of previous randomized clinical trials in terms of tumor response, safety, and long-term survival. Furthermore, a good performance status and low C-reactive protein levels may identify patients who are likely to benefit from therapy. Third-line chemotherapy after nivolumab treatment may have an enhanced effect; however, further prospective studies are required to confirm this finding.