Fruit rot in winterberry is associated with a complex of fungal pathogens. Among them, Diaporthe ilicicola plays a unique role by infecting flowers at bloom, resulting in symptom development in mature fruit. This research aimed to identify at what stage of maturation Ilex fruit can develop disease symptoms and correlate changes in fruit physiology (sugar and phenolic content) and environment (temperature and light intensity) with disease incidence. Correlation data informed in vitro studies testing the ability of putative factors to alter growth of D. ilicicola and select opportunistic fungi within the fruit rot complex: Alternaria alternata, Colletotrichum fioriniae, and Epicoccum nigrum. Results indicated that Ilex fruit do not develop symptoms until 81 to 108 days after inoculation. Temperature and fruit phenolic content were negatively correlated with disease incidence, while fruit sugar concentration and light intensity were positively correlated. In vitro assays revealed that sugar concentration had no effect on the growth of D. ilicicola, but increased light intensity increased hyphal growth and pycnidium formation. Additionally, phenolics extracted from fruit inhibited spore germination in A. alternata, induced secondary conidiation in C. fioriniae, and late season phenolic extracts increased hyphal melanization and pycnidial formation in D. ilicicola. Finally, drops in field temperatures, when replicated in vitro, resulted in a decrease in hyphal growth and spore germination for all fungi. These results suggest that changes in Ilex fruit phenolics during maturation and the increased exposure to light following defoliation may play a role in symptom development by altering D. ilicicola growth within the fruit.