The Yellow River has played an indispensable role in supporting Chinese civilization because it provides water resources and rich soil for agriculture. This study analyzes the major ions and the isotopic ratios of the hydrogen (δD), oxygen (δ18O), and carbon (14C) of groundwater samples to identify the sources of recharge and the impact of the Yellow River on the Changqing-Xiaolipu karst aquifer. The major ion/Cl− ratios generally follow the mixing line between the Yellow River and the karst groundwater recharge in the southern mountain areas, indicating the importance of mixing under natural influences in the Yellow River Basin. The dominant hydrochemical type of karst groundwater is Ca·Mg-HCO3·SO4, whereas that of Yellow River water is Ca·Na·Mg-SO4·Cl. Most karst groundwater consists of 10–30% Yellow River water, indicating that the water resources of the Yellow River Basin are generally supplemented by the Yellow River. Therefore, the Yellow River must be considered during the characterization of the chemistry and budget of water resources in the Yellow River Basin.