Piezoelectric nanocomposite fibrous membranes consisting of polymer polyvinylidene fluoride (PVDF) as matrix and incorporating 1D carbon nanotubes (CNTs) and 2D graphene oxide (GO) were prepared using an electrospinning process. The influence of the filler type, loading, and dispersion status on the total PVDF crystallinity (Xc); the relative fraction of the β phase (piezoelectric phase) in crystalline PVDF (Fβ); the volume fraction of β phase in the samples (vβ); and the piezoelectric coefficient d33 were investigated. The vβ is used to assess the formation of β phase for the first time, which considered the combined influence of fillers on Xc and Fβ, and is more practical than other investigations using only Fβ for the assessment. The inclusion of all types of carbon fillers had resulted in a considerable reduction in the Xc compared with the neat PVDF, and the Xc decreased with the CNT loading while increased with the GO loading. The addition of CNT and GO had also reduced the Fβ compared with the neat PVDF, and Fβ increased with CNT loading while decreased as GO loading increased. The vβ is significantly reduced by the addition of CNT and GO, while vβ decreases with CNT and GO loading increases. Since the calculation of vβ has considered the combined influence of fillers on Xc and Fβ, both of which were reduced by incorporating CNT and GO, the reduction of vβ was expected. The vβ of the PVDF/CNT composites were higher than that of the PVDF/GO composites. Although it is generally anticipated that d33 increases with vβ, it is observed that in the presence of CNT, d33 is dominated by the increase in electric conductivity of the composites during and after the electrospinning process, giving rise to transport of charges, produced by β crystals within the fiber to the surface of the sample. In addition, the 1D CNTs may have promoted the orientation of β crystals in the d33 direction, therefore, enhancing the d33 of the composites despite the hindrance of the β‐phase formation (i.e., the reduction of vβ). Adding CNTs can also improve piezoelectricity through interfacial polarization, which increases the dielectric constant of composite (mobile charges within CNTs facilitate composite polarization). CNT loadings higher than 0.01 wt.% are sufficient to outperform the neat PVDF, and d33 becomes 59.7% higher than the neat PVDF at 0.03 wt.% loading, but only GO loadings of 0.5 wt.% achieved comparable d33 to the neat PVDF; further increase in GO loading had resulted in a decline in d33. The low conductivity of GO, the influence of flocculation, and the lower aspect ratio compared with CNT may result in lower electron transfer and less orientation of the β‐phase polycrystalline. The d33 of the PVDF/CNT composites is higher than that of the PVDF/GO composites despite much higher loading of GO. This study aims to contribute to the development of PVDF nanocomposites in piezoelectric energy harvesting applications (e.g., self‐powered biosensors and wireless sensor networks).