Understanding how stand structure responds to stresses such as drought and pollution could aid forest managers in evaluating silvicultural treatment success, predicting treatment durability, and designing adaptive management approaches. The size-growth relationship (SGR), a measure of growth partitioning among different size trees in a stand, may provide a means of linking stresses impacting individual trees to forest stand development and growth. No study to date has tested SGR’s response to drought and pollution, specifically N deposition, across landscapes. We combined Forest Inventory and Analysis (FIA) stand development and plot-level lichen bioindicator data on N deposition with climate data denoting moisture availability. Using linear regression, we examined SGR, stand structural complexity, individual tree growth and mortality in largely multi-aged, mixed species stands in California, Oregon, and Washington, USA, coniferous and pine-oak forests. Our goals were to determine a) the influence of moisture availability and/or N deposition on SGR, b) whether SGR translates to differences in stand structural complexity over time, and c) the extent to which SGR mediates the impacts of abiotic stress on tree growth and mortality. Consistent with previous research, our results indicated that SGR increased with stand density, indicative of larger trees possessing a disproportionate advantage in aboveground competition for light. SGR declined linearly with stand age, trending over time towards disproportionately slow large-tree growth. SGR strongly increased with low-moderate bioindicated N deposition, which is consistent with past findings that SGR increases with site quality and suggests that N deposition disproportionately increases growth in larger trees. We did not find evidence that drought stress (as indicated by the Palmer Drought Severity Index) influenced SGR. Stands that were already more structurally complex showed further gains in complexity under high SGR (disproportionately rapid large-tree growth), whereas stands that were initially structurally simpler increased in complexity under low SGR (disproportionately slow large tree growth). As such, individual-tree growth and mortality may drive changes in complexity. Our results support the utility of SGR as a predictor of how stress impacts stand structure, but only when accounting for initial structural complexity. Our findings also have implications for the design and durability of silvicultural treatments, given that silvicultural prescriptions often involve the manipulation of tree size distributions. Moreover, these findings underscore the importance of accounting for the historical influence of N deposition on stand development during treatment planning, as well as the likelihood of socioeconomic changes altering N deposition in the future.