Rapid antigen tests (RAgTs) for SARS-CoV-2 are considered adequate for diagnosis at the point of care. Our objective was to establish the agreement between reverse transcription-quantitative polymerase chain reaction (RT-qPCR) and RAgTs in the pediatric population. All patients aged 1 month to 17 years and 11 months seen at the Emergency Fever Unit of a children's hospital between 6-11-2021 and 10-3-2021 were recruited. The Panbio COVID-19 Ag® test (Abbott Diagnostic) was compared to the reference method RT-qPCR (as per the protocol suggested by the United States Centers for Disease Control and Prevention). A total of 6491 patients were included. The prevalence of COVID-19 was 2.8%. Symptoms were observed in 92.1%. Sensitivity, specificity, and the kappa index of agreement for the RAgT were 71.0%, 99.9%, and 0.813, respectively. The kappa index and the RAgT sensitivity were significantly higher in the group aged 13-17 years (0.89 and 82.4%, respectively) compared to the groups aged 0-5 and 6-12 years. This may be due to the lower viral load observed in patients younger than 12 years. Although RAgTs shorten the time to result and improve the isolation strategy for COVID-19 patients, their sensitivity in children younger than 12 years or asymptomatic children is not within the recommended ranges, especially during periods of low disease prevalence.