Human physical activity (HPA), a fundamental physiological signal characteristic of bodily motion is of rapidly growing interest in multidisciplinary research. Here we report the existence of hitherto unidentified hierarchical levels in the temporal organization of HPA on the ultradian scale: on the minute's scale, passive periods are followed by activity bursts of similar intensity (‘quanta’) that are organized into superstructures on the hours- and on the daily scale. The time course of HPA can be considered a stochastic, quasi-binary process, where quanta, assigned to task-oriented actions are organized into work packages on higher levels of hierarchy. In order to grasp the essence of this complex dynamic behaviour, we established a stochastic mathematical model which could reproduce the main statistical features of real activity time series. The results are expected to provide important data for developing novel behavioural models and advancing the diagnostics of neurological or psychiatric diseases.