Comprehending and quantifying local variability in plant phenology, alongside its impacts on tree growth, is challenging due to spatially and temporally heterogeneous environmental factors that interact to affect phenological events and periods. Although previous studies have focused on the climatic factors driving phenological events at the stand level, the influences of competition, neighborhood characteristics, species richness, and water availability on plant phenology remain unclear. In the present paper, we used hourly terrestrial LiDAR surveys performed between April 2020 and April 2021 to investigate the influence of local factors (neighborhood and topography) on the phenology of silver birch trees (Betula pendula Roth.). We also examined how phenological events affect growth in tree height and crown area. All response and explanatory variables were estimated using LiDAR time-series data and a field survey campaign. Our findings demonstrate a high within-species variability in plant phenology that is controlled by biotic and abiotic characteristics of the ecosystem. We found that between tree variation in leaf burst, completion of the leaf growth and length of canopy growth period were affected by tree size, neighborhood species richness, level of suppression and competition, which potentially indicate plant responses to light availability. The beginning of senescence, completion of leaf drop, and length of autumn phenology were mostly affected by topographic water index, which reflects water availability and can be linked to nutrient availability and exposure to wind. Furthermore, we demonstrated that an earlier leaf burst, and delayed beginning of senescence were associated with larger absolute growth in canopy area but found no clear relationship between height growth and phenology. Our study highlights the capability of dense, high-quality LiDAR time-series to detect significant phenological variation among individuals of the same species within the same locality, demonstrating the potential of LiDAR time-series as a tool for understanding phenology and its impacts.