Selenium is an important indicator for the evaluation of tea quality. However, the relationship between selenium uptake by tea plants (Camellia sinensis) and soil properties, as well as selenium transport and distribution in a tea plantation soil–tea plant–tea infusion production system, remain unclear. In this study, 12 tea plantations situated in a typical selenium-rich area of China were selected, and the characteristics and crucial factors influencing the uptake and transport of selenium were analyzed using a plantation soil–tea plant–tea infusion production system. The soil total selenium content ranged from 1.12 to 6.67 mg kg−1, with an average of 2.57 mg kg−1. The average available selenium content was 53.56 µg kg−1, and the activation rate of soil selenium was 2.27%. Soil-available selenium was significantly positively correlated with total selenium, available potassium, and soil organic matter contents, and was significantly negatively correlated with soil pH. The selenium content in old leaves ranged from 0.29 to 2.73 mg kg−1, which met the standard for selenium-rich tea, whereas only 33% of young leaves met this standard. The selenium enrichment factor was highest in the fibrous root and lowest in the young leaves. The average selenium transport factors from fibrous roots to main roots, from main roots to main stems, from main stems to lateral stems, from lateral stems to young leaves, and from lateral stems to old leaves were 0.53, 0.92, 0.67, 0.97, and 2.30, respectively. The selenium concentration of tea infusion ranged from 1.88 to 12.49 μg L−1, and the average selenium dissolution rate was 22.62% after one brewing. This study identified critical factors that influence soil-selenium availability. The selenium content in tea plant organs is indicated to be strongly associated with the selenium content in the main roots.