Membrane fouling has become the one of main obstacles for the widespread application of membrane technology in water treatment processes. Coagulation as pretreatment is proven to be effective for the alleviation of membrane fouling. In this study, the influence of humic acid (HA)/sodium alginate (SA) fractions in the structure and resistance of cake layer on the membrane surface was investigated. The presence of SA at an appropriate fraction could facilitate the formation of large and loosely branched flocs and thereby form a more permeable cake layer on the membrane surface due to good bridging and charge neutralization abilities of SA molecules. The particle image velocimetry (PIV) technique was employed for monitoring the dynamic formation process of cake layer under different HA/SA fractions. The cake layer with a higher thickness was observed to be rapidly formed on the membrane surface at the presence of SA in water. According to the theoretical analysis, the membrane fouling in coagulation-ultrafiltration (UF) combined system demonstrated to be highly dependent on the size and intra-porosity of flocs. The fractal dimension of flocs might have an impact on the resistance of cake layer through affecting the porosity of aggregated flocs. The SA molecules could be used as the coagulant aid for effective alleviation of membrane fouling and the improvement of filtration performance in a coagulation-UF combined system.