A comprehensive standardized evaluation tool was needed to assess community awareness and preparedness when the pandemic hit the United States. This study aimed to develop and validate a new Coronavirus Awareness and Preparedness Scale (CAPS) through psychometric testing. This study unfolded in two phases. Phase 1 (conducted in March and April 2020) focused on the development of the scale. Phase 2 (conducted in June and July 2020) measured the reliability and validity of the scale. Psychometric testing, including exploratory factor analysis and reliability testing, was performed with a convenience sample of 1237 faculty, staff, and students at a southern university in the United States. The final CAPS model consists of four factors with 26 items: threat (seven items), confidence (11 items), individual precautions (three items), and public precautions (five items). The scale demonstrated satisfactory internal consistency (Cronbach's α = 0.75). Strong and statistically significant item correlations were observed within the subscales through item analysis. The CAPS is a reliable and valid comprehensive evaluation instrument designed to gauge community awareness and preparedness during the early stages of the COVID-19 pandemic. Its adaptability makes it suitable for measuring readiness and preparedness concerning any novel airborne disease or future airborne pandemic within a community.