Vegetation phenological carryover effects refer to the influence of previous phenological events on the current or subsequent ones. These effects can modulate the responses of autumn phenology to climate change, but the magnitude and duration of this effect remain poorly understood. Therefore, we employed multiple remote sensing datasets from 1982 to 2018 in the Northern Hemisphere (> 30°N) and partial correlation to investigate the influence of the carryover effect and environmental factors on the end of the growing season (EOS) over time. The importance of the variables in the projection score was used to quantify their relative importance. Our results showed that the previous year's EOS had a robust positive impact on the EOS for 40.02 % of the study area during 1982–2015, which was mainly located in the northern 50°N region. In contrast, the start of the growing season (SOS) was the main contributor to the EOS during 2001–2018, mainly at 40°N-50°N and in northern Russia. The carryover effect persisted into the subsequent year, but its strength and positive impacts varied dramatically in the next year. Concurrently, the mean correlation coefficient between climate factors and EOS rose from 0.20 to 0.22. Notably, the correlation coefficient for frost day frequency increased significantly (P < 0.05) from 0.15 to 0.36, with its influence area expanding from 10.29 % to 11.85 % of the study area. Compared with climate factors, the phenological carryover effect was the dominant driver of the EOS for each vegetation type, accounting for 72.8 % and 44.23 % of the total pixels during 1982–2015 and 2001–2018, respectively. Our study reveals a cascade of ecological consequences that extend beyond the initial occurrence and emphasizes the interconnectedness of growth stages in the plant life cycle, providing valuable insights into the adaptability and vulnerability of plant communities.