Computational head models are promising tools for understanding and predicting traumatic brain injuries. Most available head models are developed using inputs (i.e. head geometry, material properties and boundary conditions) from experiments on cadavers or animals and employ hereditary integral-based constitutive models that assume linear viscoelasticity in part of the rate-sensitive material response. This leads to high uncertainty and poor accuracy in capturing the nonlinear brain tissue response. To resolve these issues, a framework for the development of subject-specific three-dimensional head models is proposed, in which all inputs are derived in vivo from the same living human subject: head geometry via magnetic resonance imaging (MRI), brain tissue properties via magnetic resonance elastography (MRE), and full-field strain-response of the brain under rapid head rotation via tagged MRI. A nonlinear, viscous dissipation-based visco-hyperelastic constitutive model is employed to capture brain tissue response. Head models are validated using quantitative metrics that compare spatial strain distribution, temporal strain evolution, and the magnitude of strain maxima, with the corresponding experimental observations from tagged MRI. Results show that our head models accurately capture the strain-response of the brain. Further, employment of the nonlinear visco-hyperelastic constitutive framework provides improvements in the prediction of peak strains and temporal strain evolution over hereditary integral-based models.