The COVID-19 pandemic disrupted the lives of college students in many ways, especially a decrease in leisure time exercise and an increase in sedentary behavior resulting in an increase in stress, particularly in college students enrolled at a Hispanic-serving Institution in New York City. The objective of this quantitative study was to investigate the impact of the COVID-19 pandemic on college students’ physical activity, sedentary behavior, and perceived stress. A questionnaire was administered to 883 college students to collect leisure exercise and sedentary behavior prior to March 2020 and in April 2022, along with the impact of the pandemic on stress in April 2022. Findings indicated that the closures and isolation guidelines during the pandemic negatively impacted Black, Indigenous, and people of color’s (BIPOC) physical activity and sedentary behavior similarly to their White peers. Without the facilities and services that higher education institutions normally provide, such as recreational and fitness programming, college students were left on their own to find ways to maintain their active routines, which resulted in higher levels of stress after 2 years of campus closures. Governmental and higher education leadership should better consider the impact of closing their college campuses and limiting access to essential services on college student health and well-being in future acute health crises, particularly among the most vulnerable populations.