Silicon (Si) plays a pivotal role in mitigating phytotoxicity caused by cadmium (Cd). However, few former reports focused on the internal mechanism how Si assisted in alleviating Cd stress in rice under different durations of Cd exposure. Herein, the effects of Si on subcellular distribution of Cd in rice roots under short-term (12 h) and long-term (20 d) Cd exposure were explored. Results showed that Si decreased shoot Cd concentration but had little impact on root Cd levels. Under short-term Cd exposure, subcellular distribution analysis showed that Si increased the ratio of Cd in root cell wall by 23.2~24.0%, and decreased the ratio of Cd in root soluble fraction by 20.6~21.5%. This suggested that Si supply improved root retention of Cd by fixing it on the cell wall and thus restricted intracellular transportation of Cd. Further analysis unraveled that pectin (especially ionic-soluble pectin) of the cell wall was the main binding component, and Si supply induced more Cd accumulation in covalent-soluble pectin and hemicellulose. Moreover, the overexpression of germin-like proteins (GLPs) proved the role of cell wall in moderating Cd toxicity. Under long-term Cd exposure, Si promoted phytochelatin 2 (PC2) and phytochelatin 3 (PC3) synthesis in cytosol, at the same time, Si down-regulated the expression of the Cd efflux-related protein multidrug resistance-associated protein-like ATP-binding cassette transporters (MRP-like ABC transporters) and limited Cd transportation from vacuole to cytosol. Taken together, Si rather predominates in limiting Cd translocation by the cell wall of root under short-term Cd exposure and promoting vacuole compartmentalization to mitigate the Cd toxicity under long-term exposure, instead of reducing the absorption of Cd in rice roots, thereby decreasing Cd delivery into shoots.