A complex interplay of structural, electronic, and vibrational degrees of freedom underpins the fate of molecular excited states. Organic assemblies exhibit a myriad of excited-state decay processes, such as symmetry-breaking charge separation (SB-CS), excimer (EX) formation, singlet fission, and energy transfer. Recent studies of cofacial and slip-stacked perylene-3,4:9,10-bis(dicarboximide) (PDI) multimers demonstrate that slight variations in core substituents and H- or J-type aggregation can determine whether the system follows an SB-CS pathway or an EX one. However, questions regarding the relative importance of structural properties and molecular vibrations in driving the excited-state dynamics remain. Here, we use a combination of two-dimensional electronic spectroscopy, femtosecond stimulated Raman spectroscopy, and quantum chemistry computations to compare the photophysics of two PDI dimers. The dimer with 1,7-bis(pyrrolidin-1'-yl) substituents (5PDI2) undergoes ultrafast SB-CS from a photoexcited mixed state, while the dimer with bis-1,7-(3',5'-di-t-butylphenoxy) substituents (PPDI2) rapidly forms an EX state. Examination of their quantum beating features reveals that SB-CS in 5PDI2 is driven by the collective vibronic coupling of two or more excited-state vibrations. In contrast, we observe signatures of low-frequency vibrational coherence transfer during EX formation by PPDI2, which aligns with several previous studies. We conclude that key electronic and structural differences between 5PDI2 and PPDI2 determine their markedly different photophysics.