The scientific community is focused on developing antiviral therapies to mitigate the impacts of the ongoing novel coronavirus disease 2019 (COVID-19) outbreak. This will be facilitated by improved understanding of viral dynamics within infected hosts. Here, using a mathematical model in combination with published viral load data, we compare within-host viral dynamics of SARS-CoV-2 with analogous dynamics of MERS-CoV and SARS-CoV. Our quantitative analyses using a mathematical model revealed that the within-host reproduction number at symptom onset of SARS-CoV-2 was statistically significantly larger than that of MERS-CoV and similar to that of SARS-CoV. In addition, the time from symptom onset to the viral load peak for SARS-CoV-2 infection was shorter than those of MERS-CoV and SARS-CoV. These findings suggest the difficulty of controlling SARS-CoV-2 infection by antivirals. We further used the viral dynamics model to predict the efficacy of potential antiviral drugs that have different modes of action. The efficacy was measured by the reduction in the viral load area under the curve (AUC). Our results indicate that therapies that block de novo infection or virus production are likely to be effective if and only if initiated before the viral load peak (which appears 2-3 days after symptom onset), but therapies that promote cytotoxicity of infected cells are likely to have effects with less sensitivity to the timing of treatment initiation. Furthermore, combining a therapy that promotes cytotoxicity and one that blocks de novo infection or virus production synergistically reduces the AUC with early treatment. Our unique modeling approach provides insights into the pathogenesis of SARS-CoV-2 and may be useful for development of antiviral therapies.