In this work, we study the energy flow through anharmonic coupling of vibrational modes after excitation of gas-phase fluorobenzene with a multi-THz pump. We show that to predict the efficiency of anharmonic energy transfer, simple models that only include the anharmonic coupling coefficients and motion of modes at their resonant frequency are not adequate. The full motion of each mode is needed, including the time while the mode is being driven by the pump pulse, because all the frequencies present in the multi-THz pump contribute to the excitation of the non-resonantly excited vibrational modes. Additionally, the model gives us the insight that modes with either A1 or B2 symmetry are more actively involved in anharmonic coupling because these modes have more symmetry-allowed energy transfer pathways.