The recently-introduced Parity Expanded Variational Analysis (PEVA) technique allows for the isolation of baryon eigenstates at finite momentum free from opposite-parity contamination. In this paper, we establish the formalism for computing form factors of spin-1/2 states using PEVA. Selecting the vector current, we compare the electromagnetic form factors of the ground state nucleon extracted via this technique to a conventional parity-projection approach. Our results show a statistically significant discrepancy between the PEVA and conventional analyses. This indicates that existing calculations of matrix elements of ground state baryons at finite momentum can be affected by systematic errors of ~20% at physical quark masses. The formalism introduced here provides an effective approach to removing these systematic errors.