The low thermal conductivity of group IV-VI semiconductors is often attributed to the soft phonons and giant anharmonicity observed in these materials. However, there is still no broad consensus on the fundamental origin of this giant anharmonic effect. Utilizing first-principles calculations and group symmetry analysis, we find that the cation lone-pairs s electrons in IV-VI materials cause a significant coupling between occupied cation s orbitals and unoccupied cation p orbitals due to the symmetry reduction when atoms vibrate away from their equilibrium positions under heating. This leads to an electronic energy gain, consequently flattening the potential energy surface and causing soft phonons and strong anharmonic effects. Our findings provide an intrinsic understanding of the low thermal conductivity in IV-VI compounds by connecting the anharmonicity with the dynamical electronic structures, and can also be extended to a large family of hybrid systems with lone-pair electrons, for promising thermoelectric applications and predictive designs.