Patients across various cancers who develop immune-related adverse events (irAEs) post-immune checkpoint inhibitor (ICI) treatment tend to experience better tumor response and survival than those who do not. However, studies regarding this association in patients with esophageal squamous cell carcinoma (ESCC) are limited. We assessed the relationship of irAEs with tumor response and survival in 82 consecutive patients with unresectable advanced or recurrent ESCC treated with second- or later-line nivolumab, an anti-PD-1 antibody, monotherapy. We observed irAEs in 24 (29.3%) patients, with the overall response and disease control rates in the irAE-positive group being significantly better than those in the irAE-negative group (both p < 0.0001). During the entire period and within 8 weeks of nivolumab initiation, progression-free and overall survivals (PFS and OS, respectively) were significantly better in patients with grade1/2 irAEs than in those without. Univariate and multivariate analyses indicated grade1/2 irAEs during the entire period and within 8 weeks as independent covariates for PFS (entire period: hazard ratio [HR] 0.28, 95% confidence interval [CI] 0.16-0.49, p < 0.001; within 8 weeks: HR 0.46, 95% CI 0.23-0.93, p = 0.03) and OS (entire period: HR 0.24, 95% CI 0.13-0.44, p < 0.001; within 8 weeks: HR 0.41, 95% CI 0.18-0.92, p = 0.03). Grade1/2 irAEs during the entire treatment period and within 8 weeks of nivolumab initiation were significantly associated with improved tumor response and survival in patients with advanced ESCC treated with nivolumab monotherapy. Therefore, mild irAEs may be predictive markers for the response and prognosis of ESCC following ICI treatment.