Owing to higher heat loads than cooling loads in cold climates, the performance of ground source heat pumps (GSHPs) can significantly degrade over time, leading to eventual system failure for systems not properly sized or when there is insufficient regeneration. Solar-assisted ground source heat pump (SAGSHP) systems are receiving increasing interest as a means of enhancing heating performance and maintaining ground thermal balance in cold regions. However, a critical gap remains in the literature: no study has comprehensively analyzed configurations of SAGSHP systems to enhance their overall performance considering long-term performance and realistic operating conditions. For this purpose, a comprehensive investigation of the long-term performance of single U-tube and double U-tube ground heat exchangers (GHEs) for solar-assisted ground source heat pump systems (SAGSHPs) was carried out and compared with the conventional GSHP. The effect of collector tilt angles (0–90°) on the performance of the single U-tube SAGSHP was also examined. A finite volume computational fluid dynamic model was developed and coupled with an actual building energy load profile and a solar irradiation profile based on Calgary’s weather conditions using a novel custom-coded thermodynamic model. Results show that the yearly average heating coefficient of performance (COP) increases by a factor of 1.21 and 1.18 for the single U-tube SAGSHP and double U-tube SAGSHP, respectively, when compared with the conventional GSHP. However, the average annual cooling COP reduces by 0.65 for the single U-tube and 0.72 for the double U-tube SAGSHPs. Moreover, considering the effect of tilt angle on the single U-tube SAGSHP, it is possible to improve the cooling COP when the collector tilt angle is 90°, at the expense of lower heating COP. However, the highest heating COP and annual energy savings are achieved with a tilt angle of 45°. This study provides practical insight into SAGSHP performance enhancements in cold climates.