The treatment of a large amount of oil-water mixture generated by oil leakage accidents is an environmental issue that cannot be ignored. Achieving fast and efficient oil-water separation is a goal pursued by both academia and industry. In this paper, poly(melamine formaldehyde) (PMF) sponges were modified by the hydrophilic bacterial nanocellulose (BNC) through mild and facile conditions. With increasing the concentration of BNC dispersion used, the pore size of the composite decreases. The water contact angle of the obtained PMF/BNC composite surface is 0° or so, and the underwater oil contact angle is greater than 150°. Based on its hierarchical pore structure, hydrophilicity and oil repellency, the PMF/BNC composite exhibits excellent oil-water separation efficiency and water treatment flux for layered oil-water mixture (>1.0×107L/(m2·h·bar)). In addition, the PMF/BNC composite also exhibits high water treatment flux and oil-water separation efficiency (> 95%) for oil-water emulsion with and without surfactant. Stacking several composite slices could achieve higher oil-water separation efficiency.