Angle-resolved photoelectron spectroscopy (ARPES) is a powerful tool in solid state sciences. Beside the direct measurement of the energy-momentum dispersion relation, the angular distribution of the photoelectron current reveals the structural environment of the emitting atoms via photoelectron diffraction effects. Moreover, in the case of molecular layers, the angular distribution of emission from molecular orbitals can be directly related to their charge density distribution via so-called orbital tomography. In the present paper we summarize our efforts undertaken over the past 12 years to add the dimension of time to these two methods via pump-probe experiments with femtosecond resolution. We give a comprehensive introduction to standard ARPES and time-resolved two photon photoemission and then focus on our efforts towards time-resolved versions of photoelectron diffraction and orbital tomography. Both, optimization of experimental parameters and data acquisition procedures, as well as new numerical tools are needed in order to realize such challenging full stop missing after experiments.