Differential phase contrast scanning transmission electron microscopy (DPC STEM) is a powerful technique for directly visualizing electromagnetic fields inside materials at high spatial resolution. Electric field observation within ferroelectric materials is potentially possible by DPC STEM, but concomitant diffraction contrast hinders the quantitative electric field evaluation. Diffraction contrast is basically caused by the diffraction-condition variation inside a field of view, but in the case of ferroelectric materials, the diffraction conditions can also change with respect to the polarization orientations. To quantitatively observe electric field distribution inside ferroelectric domains, the formation mechanism of diffraction contrast should be clarified in detail. In this study, we systematically simulated diffraction contrast of ferroelectric domains in DPC STEM images based on the dynamical diffraction theory, and clarify the issues for quantitatively observing electric fields inside ferroelectric domains. Furthermore, we conducted experimental DPC STEM observations for a ferroelectric material to confirm the influence of diffraction contrast predicted by the simulations.