Current stem cell-based techniques for bone-like tissue synthesis require at least two to three weeks. Therefore, novel techniques to promote rapid 3D bone-like tissue synthesis in vitro are still required. In this study, we explored the concept of using cell nanofragments as a substrate material to promote rapid bone formation in vitro. The methods for cell nanofragment fabrication were ultrasonication (30 s and 3 min), non-ionic detergent (triton 0.1% and 1%), or freeze-dried powder. The results showed that ultrasonication for 3 min allowed the fabrication of homogeneous nanofragments of less than 150 nm in length, which mineralized surprisingly in just one day, faster than the fragments obtained from all other methods. Further optimization of culture conditions indicated that a concentration of 10 mM or 100 mM of β-glycerophosphate enhanced, whereas fetal bovine serum (FBS) inhibited in a concentration-dependent manner, the mineralization of the cell nanofragments. Finally, a 3D collagen-cell nanofragment-mineral complex mimicking a bone-like structure was generated in just two days by combining the cell nanofragments in collagen gel. In conclusion, sonication for three min could be applied as a novel method to fabricate cell nanofragments of less than 150 nm in length, which can be used as a material for in vitro bone tissue engineering.