Slowing hot carrier (HC) cooling and improving HC extraction are considered two pivotal factors for enhancing power conversion efficiency in emerging HC photovoltaic applications of perovskites and other materials. Employing ab initio quantum dynamics simulations, we demonstrate the simultaneous slow cooling and efficient extraction of hot electrons at the C60/CsPbI3 interface through dipolar surface passivation with phenethylammonium and 4-fluorophenethylammonium ligands. The passivation effectively suppresses I-Pb lattice vibrations, weakens the hot electron-phonon interaction in CsPbI3, and thus slows down the HC cooling. At the same time, the dipolar surface passivation elevates the LUMO + 1 state in C60 and reduces the energy gap for HC extraction. Concurrently, higher-frequency vibrations of the dipolar layer enhance the coupling between C60 and CsPbI3, promoting efficient HC extraction further. These phenomena are intensified with increased polarity of the dipolar layer. Furthermore, we find that dipolar passivation has the opposite influence on cold electron collection at the band edge, underscoring the fact that the observed improvement in photovoltaic performance stems preferentially from the effective utilization of HCs rather than cold electrons. The work provides a new strategy for achieving high-performance HC perovskite solar cells.