The heterogeneous symptoms of multiple sclerosis (MS) can considerably impact the lives of people with MS (PwMS). The aim of this study was to describe the extent of restrictions in different life domains that PwMS experience in relation to their symptoms and level of disability. A cross-sectional survey was conducted among working-age PwMS in Sweden. The 4052 participants who answered the questions on restrictions in work and private life domains (family, leisure activities, and contact with friends/acquaintances) were included. Predictors of restrictions in the four domains were determined through multinomial logistic regression. Approximately one-third of the PwMS reported no restrictions in the domains of work (35.7%), family (38.7%), leisure activities (31.1%) or contact with friends/acquaintances (40.3%), the remaining participants reported moderate to severe restrictions. Tiredness/fatigue was the most commonly reported most-limiting symptom (49.5%). PwMS with Expanded Disability Status Scale (EDSS) scores of zero reported restrictions in life domains ranging from 39.6% (friends/acquaintances) to 45.7% (leisure activities). Age, sex, education, type of living area, MS type, type of most-limiting symptom, and EDSS score predicted restrictions in work and private life domains. Most PwMS reported similar levels of restrictions in both their work and private lives. Restrictions in these life domains were also reported by PwMS with low disability levels (EDSS = 0) and were often associated with invisible symptoms such as fatigue. Even in a contemporary MS cohort, close to 90% of PwMS report limitations due to MS.