As a renewable biomass material, nano-cellulose has been investigated as a reinforcing filler in rubber composites but has seen little success because of its strong inclination towards aggregating. Here, a bottom-up self-assembly approach was proposed by regenerating cellulose crystals from a mixture of cellulose solution and natural rubber (NR) latex. Different co-coagulants of both cellulose solution and natural rubber latex were added to break the dissolution equilibrium and in-situ regenerate cellulose in the NR matrix. The SEM images showed that the sizes and morphologies of regenerated cellulose (RC) varied greatly with the addition of different co-coagulants. Only when a 5 wt% acetic acid aqueous solution was used, the RC particles showed an ideal rod-like structure with small sizes of about 100 nm in diameter and 1.0 μm in length. The tensile test showed that rod-like RC (RRC)-endowed NR vulcanizates with pronounced reinforcement had a drastic upturn in stress after stretching to 200% strain. The results of XRD and the Mullins effect showed that this drastic upturn in stress was mainly attributed to the formation of rigid RRC-RRC networks during stretching instead of the strain-induced crystallization of NR. This bottom-up approach provided a simple way to ensure the effective utilization of cellulosic materials in the rubber industry.