Phosphate is an essential macro-element for plant growth accumulated in the topsoil. The improvement of phosphate uptake efficiency via manually manipulating root system architecture is of vital agronomic importance. This review discusses the molecular mechanisms of root patterning in response to external phosphate availability, which could be applied on the alleviation of phosphate-starvation stress. During the long time evolution, plants have formed sophisticated mechanisms to adapt to environmental phosphate conditions. In terms of root systems, plants would adjust their root system architecture via the regulation of the length of primary root, the length/density of lateral root and root hair and crown root growth angle to cope with different phosphate conditions. Finally, plants develop shallow or deep root system in low or high phosphate conditions, respectively. The plasticity of root system architecture responds to the local phosphate concentrations and this response was regulated by actin filaments, post-translational modification and phytohormones such as auxin, ethylene and cytokinin. This review summarizes the recent progress of adaptive response to external phosphate with focus on integrated physiological, cellular and molecular signaling transduction in rice and Arabidopsis.