Conservation tillage, that is, reduced or zero tillage, can change the soil ecological environment and rhizosphere bacterial communities. Here, we investigated temporal variations in rhizosphere bacterial communities during crop development and their relationships with crop growth characteristics under three tillage practices (Plow tillage (PT), chisel plough tillage (CPT), and zero tillage (ZT)) in maize and soybean fields on the Loess Plateau of China. Conservation tillage (CPT and ZT) practices significantly increased the contents of soil moisture (3.62–13.13%), soil organic carbon (29.19–39.67%), and nitrogen (38.69–60.23%) and decreased soil pH (1.15–3.76%). The overall responses of rhizosphere bacterial community composition to tillage practice and phenological period were taxonomically consistent across maize and soybean fields, and changes were predominantly observed in the relative abundances of dominant bacterial phyla. Co-occurrence network analysis indicated that the average connectivity degree among 16S operational taxonomic units was higher under PT (38.92% and 73.60%) practice than under CPT and ZT practices. CPT practice tended to increase the total biomass and nitrogen accumulation of maize and soybean compared with PT practice, whereas ZT practice significantly (P < 0.05) decreased them. Partial least squares path modeling analysis showed that temporal variations in the rhizosphere bacterial communities (explained variations in maize and soybean fields were 94.7% and 92.7%, respectively) were regulated by tillage practices and phenological periods, and partly explained the changes in growth dynamics of maize and soybean (0.161 and 0.031, respectively). Overall, CPT practice could improve the soil ecological environment and promote crop growth in the China’s Loess Plateau. Therefore, we recommend that CPT practice should be adopted in semi-arid agricultural areas to improve the potential relationships between the underground and aboveground in agroecosystems.