Non-thermal and thermal carrier populations in plasmonic systems raised significant interest in contemporary fundamental and applied physics. Although the theoretical description predicts not only the energies but also the location of the generated carriers, the experimental justification of these theories is still lacking. Here, we demonstrate experimentally that upon the optical excitation of surface plasmon polaritons, a non-thermal electron population appears in the topmost domain of the plasmonic film directly coupled to the local fields. The applied all-optical method is based on spectroscopic ellipsometric determination of the dielectric function, allowing us to obtain in-depth information on surface plasmon induced changes of the directly related electron occupancies. The ultrahigh sensitivity of our method allows us to capture the signatures of changes induced by electron-electron scattering processes with ultrafast decay times. These experiments shed light on the build-up of plasmonic hot electron population in nanoscale media.