Rice production in sub-Saharan Africa (SSA) is restricted by low water availability, soil fertility, and fertilizer input, and phosphate rock (PR) application is expected to increase production. Soil water conditions and soil types affect the efficacy of phosphorus fertilization in improving productivity. However, these factors are rarely discussed together. In this study, we aimed to investigate the soil types and soil water conditions in the fields, as well as their effects on rice productivity after phosphorus fertilization, and optimize the findings using remote sensing techniques. A soil profiling survey, followed by a field experiment in seven farmer fields, was performed in the Central plateau of Burkina Faso. The following treatments were applied: nitrogen and potassium fertilization without phosphorus (NK), PR application with NK (NK+PR), and triple super phosphate (TSP) application with NK (NK+TSP). Submergence duration and cumulative water depth were recorded manually. The inundation score, estimated using a digital elevation model, explained the distribution of soil types and soil water conditions and correlated negatively with sand content and positively with silt and clay content, indicating an illuvial accumulation of fine soil particles with nutrient transportation. The field experiment showed that although grain yield was significantly restricted by phosphorus deficiency, the increase in yield after phosphorus fertilization was higher in Lixisols and Luvisols than in Cambisols because of the low Bray-2-phosphorus content of Lixisols and Luvisols. The inundation score correlated positively with grain yields after NK+PR and NK+TSP treatments. In conclusion, soils with low inundation scores (mainly Lixisols and Luvisols) showed a drastic increase in grain yield after TSP application, whereas those with high inundation scores showed comparable yields after PR and TSP application despite the low phosphorus fertilization effect. Our findings would help optimize fertilization practices to increase rice productivity in SSA.