Competition among trees for limited resources (e.g., sunlight, water, and nutrients) impacts their growth differently. Crown plays a crucial role in resource access for trees. However, uncertainties persist regarding crown size differences, tree growth, and tree competition levels between coniferous and broadleaf trees in mixed-age forests. We conducted a study on 3008 live trees across 28 plots in Hunan Province to measure individual crown size and tree growth increment. Introducing a new metric, the Crown Size Competition Index (CSCI), we assessed competition pressure among coniferous and broadleaf species in mixed-age forests. We examined the correlation between competition indices and tree growth increment while also investigating the influence of neighboring species diversity on tree competition. Our results revealed a significant negative correlation between the tree growth of Cunninghamia lanceolata (Lamb.) Hook.(CL) and Phoebe bournei (Hemsl.) Yang (PB) and the competition index. Increased competitive pressure on the focal tree corresponded to a decline in the growth of focal tree volume, with a more pronounced impact observed in PB compared to CL. The diversity of neighboring species contributed to variations in competition for the focal tree, with broadleaved species (PB) exerting a greater influence on the focal tree than coniferous species (CL). These findings underscore the competitive potential of PB in mature coniferous stands and advocate for the restoration of stratified mixes in CL broadleaf forests. Furthermore, our findings support the management strategies for the valuable tree species PB.