Phosphorus (P) is one the least available essential plant macronutrients in soils that is a major constraint on plant growth. Soybean (Glycine max L.) production is often limited due to low P availability. The better management of P deficiency requires improvement of soybean's P use efficiency. Sugars are implicated in P starvation responses, and a complete understanding of the role of sucrose together with P in coordinating P starvation responses is missing in soybean. This study explored global metabolomic changes in previously screened low-P-tolerant (Liaodou, L13) and low-P-sensitive (Tiefeng 3, T3) soybean genotypes by liquid chromatography coupled mass spectrometry. We also studied the root morphological response to sucrose application (1%) in P-starved soybean genotypes against normal P supply. Root morphology in L13 genotype has significantly improved P starvation responses as compared to the T3 genotype. Exogenous sucrose application greatly affected root length, root volume, and root surface area in L13 genotype while low-P-sensitive genotype, i.e., T3, only responded by increasing number of lateral roots. Root : shoot ratio increased after sucrose treatment regardless of P conditions, in both genotypes. T3 showed a relatively higher number of differentially accumulated metabolites between P-starved and normal P conditions as compared to L13 genotype. Common metabolites accumulated under the influence of sucrose were 5-O-methylembelin, D-glucuronic acid, and N-acetyl-L-phenylalanine. We have discussed the possible roles of the pathways associated with these metabolites. The differentially accumulated metabolites between both genotypes under the influence of sucrose are also discussed. These results are important to further explore the role of sucrose in the observed pathways. Especially, our results are relevant to formulate strategies for improving P efficiency of soybean genotypes with different P efficiencies.