Graphitic-phase carbon nitride (g-C3N4) nanosheets with lateral size of 1000 nm, 500 nm, and 100 nm have been fabricated by a one-step thermal condensation method at different thermal treating temperatures and used as filler for poly(vinylidene fluoride) (PVDF)-based dielectric composites. The effects of its size and content on energy storage density of g-C3N4/PVDF composites are discussed. The experimental results show that the energy storage density of the composites containing 3 wt% g-C3N4 increases with the decrease of lateral size and could reach to 11.7 J cm−3 at 522 kV mm−1, much higher than pure PVDF of 5.8 J cm−3 at 386 kV mm−1. A finite element simulation is employed to describe electric field distribution within the composites and reveal further the role of g-C3N4 nanosheets on the energy storage behavior of the composites. This work provides a new inorganic filler for high energy storage density PVDF-based dielectric composites.