Abstract Background During the COVID-19 pandemic’s first wave, mobility restrictions and protective measures have impacted both public and private life. In Germany, the population was advised to stay home except for work, outdoor sport activities, and essential shopping. This study aims to evaluate how these measures affected physical activity and sedentary behavior, focusing on identifying the groups most affected. Methods In April and May 2020, we distributed a COVID-19-specific questionnaire to participants of the German National Cohort (NAKO). The questionnaire was specifically designed to assess changes in physical activity and sedentary behavior compared to pre-restriction levels, along with data on anxiety and depressive symptoms. Results Around 26 % of the 152,421 respondents reported increased sedentary time, and about 38 % reported reduced participation in sport activities compared to pre-restriction levels. Over one-third of those who previously met the WHO’s physical activity recommendation could not maintain it during the restrictions. There was also a notable decline in active transportation (M = - 0.12; 95% CI: -.126; -.117), whereas participants spent more time on recreational physical activities (M = 0.12; 95% CI: .117; .126). Based on multivariable linear and log-binomial regression models, we found that younger people were more affected by the restrictions than older adults. Factors such as transitioning to remote work, self-rated health, and depressive symptoms strongly correlated with changes in all physical activity domains, including sedentary behavior and adherence to physical activity guidelines. Conclusions The shift towards inactivity or low-intensity activities during the nationwide restrictions poses potential long-term health risks, highlighting the urgent need for public health policies to address the negative impact of COVID-19 restrictions on physical activity and sedentary behavior.