The disk instability model is a promising pathway for giant planet formation in various conditions. At the moment, population synthesis models are used to investigate the outcomes of this theory, where a key ingredient of the disk population evolution are collisions of self-gravitating clumps formed by the disk instabilities. In this study, we explored the wide range of dynamics between the colliding clumps by performing state-of-the-art smoothed particle hydrodynamics simulations with a hydrogen-helium mixture equation of state and investigated the parameter space of collisions between clumps of different ages, masses (1--10 Jupiter mass), various impact conditions (head-on to oblique collisions) and a range of relative velocities. We find that the perfect merger assumption used in population synthesis models is rarely satisfied and that the outcomes of most of the collisions lead to erosion, disruption or a hit-and-run. We also show that in some cases collisions can initiate the dynamical collapse of the clump. We conclude that population synthesis models should abandon the simplifying assumption of perfect merging. Relaxing this assumption will significantly affect the inferred population of planets resulting from the disk instability model.