Cellulose aerogels with polyester resin as cross-linkers have attracted much attention. This study describes the route to produce a fully bio-based aerogel with high added value from waste paper and starch, cellulose acetate and starch–cellulose acetate mixture as cross-linkers for oil adsorption, instead of the environmentally harmful polyester resin. The manufacturing process is simple, sustainable and cost-efficient, without releasing harmful by-products into the environment. The effects of different cross-linkers on the oil adsorption, dynamic oil retention, reusability and morphology of the aerogels were studied in detail. Experimental results show that these environmentally friendly recycled aerogels have a very low density, i.e., —0.0110–0.0209 g cm−3, and highly porous structures, with a porosity of 96.74–99.18%. The synthesized hydrophobic aerogels showed contact angles of ∼124–129°. The compression moduli are lower than that of an aerogel with polyester as a cross-linker, but the compression modulus of the mixture of starch and cellulose acetate especially shows a higher value than expected. The sorption capacity of the aerogels with bio-based cross-linkers was significantly increased compared to the aerogels with polyester; it is now up to 56 times their own weight. The aerogels also have good oil-retention properties.