The objective of this cross-sectional study was to investigate the impact of the COVID-19 pandemic on physical activity (PA) levels of patients with rheumatic and musculoskeletal diseases (RMDs) and to examine factors associated with decreased PA. A sample of adult patients with RMDs (n=7,776) was identified through electronic medical records from an academic health care system in North Carolina. Invitations to participate in an online survey were sent between July 2020 and September 2020 to assess self-reported changes in PA during the COVID-19 pandemic. Descriptive statistics, age-adjusted prevalence odds ratios (PORs), and 95% confidence intervals (CIs) were computed to examine patient characteristics associated with decreased PA. A total of 893 eligible participants completed the survey (mean age 57.8 ± 14.9 years, 75.8% female). The most common primary diagnoses reported among participants included rheumatoid arthritis (27.3%), osteoarthritis (16.0%), and systemic lupus erythematosus (SLE) (13.0%). More than half of participants (56.8%) reported engaging in less PA since the pandemic began. Factors associated with engaging in less PA included lower self-reported general health (POR, 2.21; CI, 1.64-2.97) and a diagnosis of SLE (POR, 1.57; CI, 1.03-2.38). Comorbidities associated with decreased PA included chronic pain (POR, 1.38; CI, 1.04-1.82), depression (POR, 1.48; CI, 1.09-2.01), and hypertension (POR, 1.44; CI, 1.10-1.90). The COVID-19 pandemic has exacerbated barriers to PA in patients with RMDs. There is a critical need to provide resources, support, and multifaceted programs to encourage PA in patients with RMDs during the COVID-19 pandemic.