This research study aimed to identify the modalities used in teaching Physical Education in the district of San Rafael, Bulacan during the time of pandemic. Further, the study investigated the challenges experienced by the Physical Education (PE) teachers and the solutions they made to address these challenges. The end goal of the study was a school action plan for physical education to address the issues in teaching PE during the pandemic. Qualitative research design through thematic analysis was employed and a semi structured virtual interview was conducted to further substantiate the findings of the study. Results revealed that modular learning is the most common modality used by Physical Education teachers in this time of pandemic. Other modalities such as synchronous and asynchronous online learning and physical activity mobile applications were used by the teachers. It was also revealed that their main reason for using the modalities was for the welfare of their students. Further, the lack of resources of students in terms of internet connectivity and gadgets was the common struggle experienced by the Physical Education teachers and the most common solution done by the Physical Education teachers was doing follow-up with the students through social media. This study recommended the implementation of the proposed action plan to improve the modalities of teachers in teaching Physical Education and to help them avoid problems they may encounter.