Understanding on the structure and dynamics of poly(vinyl acetal)s is insufficient due to the complicated chemical structure and amorphous nature of this type of polymers. In this work, we investigate the effect of side group length on structure and dynamics heterogeneity at different length scales spanning from side group, segment, and polymer network by combing dynamic mechanical analysis (DMA), dielectric relaxation spectroscopy (DRS), solid-state NMR, and differential scanning calorimetry analysis (DSC). By increasing the length of acetal side group, its intrinsic dynamics slows down. Taking into account the scale of segment and networks, with the increase of acetal group length, the formation of cross-linking sites formed by the hydroxyl-rich domain is suppressed, the relaxation distribution of the segment widens, and the volume fraction of rigid component decreases. The effect of side group length on the structure and dynamics heterogeneity of poly(vinyl acetal)s at different scales results in significant changes in material properties such as the non-monotonic change in loss factor value (tan δ) and a monotonous reduction in glass transition temperature (Tg).