There have been over 17 million COVID-19 infections worldwide up to July 31, 2020, but the exact transmission route remains a subject for debate. Virus load in different-sized respiratory droplets is the key to address the above question. Investigation on the droplet deposition characteristics during exhalation inside the respiratory tract will facilitate the understanding of their origin and importance in transmitting the respiratory infection. Based on a realistic respiratory model, this study utilized the computational fluid dynamic (CFD) simulation to investigate the deposition of droplets originating from infection sites like pharynx, larynx and trachea under three flow conditions, namely 30 L/min (representing the normal breathing condition), 60 L/min (speaking) and 180 L/min (coughing). The SST k - ω turbulence model integrated in ANSYS Fluent software was utilized to obtain the flow field inside the respiratory tract by solving the continuity and momentum equations, and the Lagrangian approach was used to calculate droplet motion and deposition with the discrete random walk model to account for the turbulence fluctuation effect. Evaporation of droplets was not considered inside the saturated respiratory tract. Droplet diameter, flow rate of the exhaling air, and complexity of the respiratory tract geometry are the most important factors in determining the deposition pattern of respiratory droplets. It is revealed that the largest droplet that originates from the joint of pharynx and larynx and is able to escape out of the respiratory tract is about 20 µm (30 L/min) or 10 µm (60–180 L/min) in diameter; the so-called cut-off sizes for vocal cord and trachea originated droplets are 7 µm (30 L/min), 5 µm (60 L/min) or 3 µm (180 L/min). Larynx and joint of larynx and pharynx are the most important deposition sites due to their complexity in geometry and the existence of the laryngeal jet, whose velocity is up to 102 m/s during coughing and 32 m/s during speaking; the nasal cavity is also effective in trapping relatively small droplets as the airflow has a sudden change in direction before entering the oral cavity. Under the investigated speaking scenario (60 L/min), the escape rate of 1 µm droplets is around 50%, and the maximum escape rates of 5 and 10 µm droplets are respectively 13.1% and 1.3% (originating from the joint of pharynx and larynx). Although large droplets up to several hundred micrometers can be produced inside the oral cavity due to the atomization mechanism, they seldom carry pathogen. Thus, for COVID-19 patents in the early stage of infection who show upper respiratory symptoms, the cut-off size of virus-laden droplets released into the environment is about 20 µm; with the shifting of infection to the lower respiratory tract in the later stage, the cut-off size decreases to 7 µm. Respiratory droplets evaporate immediately after escaping into the indoor environments and shrink to about one third of their initial size, so airborne route is speculated to be important in the transmission of COVID-19. Further investigations considering realistic flow conditions together with droplet sampling experiments on human volunteers are necessary to confirm these cut-off sizes.