In this study, 15 % w/w polyvinylidene fluoride (PVDF)–Fe3O4 nanoparticle (NP) nanocomposite scaffolds were prepared using coaxial electrospinning with a high-speed conductive rotating collector to obtain aligned fibers. The effects of varying the Fe3O4 NP size (6, 9, and 14 nm in diameter) on the fiber morphology, mechanical response, and piezoelectric phase content were investigated. In situ X-ray diffraction measurements during heating-cooling and tensile tests were carried out using synchrotron radiation to study the charge in the β-phase content and polymer chain orientation under different conditions. At zero strain, the presence of smaller NPs seems to impede the β-phase crystallization in PVDF. However, heating-cooling cycles revealed that the NPs acted as nucleation agents, promoting a higher β-phase content after cooling compared to pure PVDF. The mechanical response showed that nanocomposites with smaller NPs exhibited higher stiffness. While the initial degree of polymer chain orientation was higher in the nanocomposites, the presence of NPs hindered the α-to-β phase transformation and chain alignment under tensile deformation compared to pure PVDF. This study highlights the complex interplay among NP size, β-phase formation, mechanical properties, and chain orientation in PVDF-Fe3O4 nanocomposites, providing insights into tailoring their piezoelectric performance for various applications.