The successful commercialization of promising silicon-based anode materials has been hampered by their poor cycling stability caused by the huge volume change. Integration of the carbon matrix with silicon-based (C/Si-based) anode materials has been demonstrated to be a powerful solution to achieve satisfactory electrochemical performance. This minireview aims to outline recent developments on C/Si-based composites, with the emphasis on the importance of carbon distribution at multiple scales. In addition, the forms of the carbon framework (carbon sources and doping of heteroatoms) have been summarized. Particularly, a novel C/Si-based hybrid with carbon distributed at the atomic scale has been highlighted.