The variability of ground thermal conductivity, based on underground conditions, is often ignored during the design of ground-source heat pump systems. This study shows a field evidence of such site-scale variations through thermal response tests in eight borehole heat exchangers aligned at a site on a terrace along the foothills of mountains in northern Japan. Conventional analysis of the overall ground thermal conductivity along the total installation length finds that the value at one borehole heat exchanger is 2.5 times that at the other seven boreholes. History matching analysis of underground distributed temperature measurements generates vertical partial ground thermal conductivity data for four depth layers. Based on the moving line heat source theory, the partial values are generally within a narrow range expected for gravel deposits. Darcy velocities of groundwater are estimated to be 74–204 m/y at the borehole with high conductivity, increasing in the shallow layers above a depth of 41 m. In contrast, the velocities at the other seven boreholes are one-to-two orders of magnitude smaller with no trend. These high and low velocity values are considered for the topography and permeability. However, the relatively slow groundwater velocities might not apparently increase the partial conductivity.