Polymer nanocomposites hold great potential as dielectrics for energy storage devices and flexible electronics. The structural architecture of the nanofillers is expected to play a crucial role in the fundamental mechanisms governing the electrical breakdown and dielectric properties of the nanocomposites. However, the effect of nanofiller structure and dimensionality on these properties has not been studied thoroughly to date. This study explores the critical relationship between nanofiller dimensionality and dielectric properties in polymer nanocomposites. We fabricated polyvinylidene fluoride (PVDF) nanocomposites by incorporating a range of carbon-based nanofillers separately, including zero-dimensional (0D) carbon black (CB), one-dimensional (1D) multiwalled carbon nanotubes (MWCNT), 1D single-walled carbon nanotubes (SWCNT), two-dimensional (2D) reduced graphene oxide (rGO), and three-dimensional (3D) graphite. The frequency-dependent (1 kHz to 1 MHz) dielectric permittivity (k) of the nanocomposites at the same concentration of nanofillers demonstrated a hierarchical order, with MWCNT showing the highest permittivity (∼400%), succeeded by rGO (∼360%), CB (∼290%), SWCNT (∼230%), and graphite (∼70%), respectively. The temperature-dependent (50-150 °C) dielectric spectroscopy revealed high k with increasing temperature due to the enhanced dipole movement. However, their dielectric breakdown strength and energy densities were not correlated to k and exhibited the following order: SWCNT > MWCNT > CB > rGO > graphite. As the electrical breakdown depends upon the nanocomposites' mechanical strength, we correlated the mechanical properties with the nanofiller dimensionality, and Young's modulus followed the 1D ≈ 2D > 0D > 3D order. These findings will provide fundamental insights into designing tunable, conducive nanofiller-based nanocomposites in next-generation flexible electronics and capacitive energy storage devices.