Optimizing heterojunction structure is an important way to improve photocatalytic activity. Herein, we report a novel hollow tubular C3N4/Nb4+/Nb2O5 nanoparticle Z-Scheme heterojunction, by introducing Nb4+ ions into Nb2O5 through a reducing atmosphere during C3N4 thermal polymerization. The optimized heterostructure showed outstanding photocatalytic hydrogen evolution activity under both UV–vis (14.93 mmol g−1 h−1) and Vis (5.22 mmol g−1 h−1) lights. The photocatalytic hydrogen evolution activity under UV–vis light is 26.6 and 4.75 times that of bulk C3N4 (CN) and hollow tubular C3N4 (HCN), respectively. The increased photocatalytic activity can be attributed to the larger specific surface area, more active sites, and enhanced light absorption capacity of the composite. Crucially, the introduction of Nb4+ ions as the charge-carrier transport channels in the Z-scheme heterostructure improves the efficiency of photogenerated charge-carrier separation. This study provides a useful design strategy for Z-Scheme photocatalytic heterojunction structures that can utilize solar light more efficiently.