The Mercury-Manganese star Phi Her is a well known spectroscopic binary that has been the subject of a recent study by Zavala et al. (2006), in which they resolved the companion using long-baseline interferometry. The total mass of the binary is now fairly well established, but the combination of the spectroscopy with the astrometry has not resulted in individual masses consistent with the spectral types of the components. The motion of the center of light of Phi Her was clearly detected by the Hipparcos satellite. Here we make use of the Hipparcos intermediate data (`abscissa residuals') and show that by combining them in an optimal fashion with the interferometry the individual masses can be obtained reliably using only astrometry. We re-examine and then incorporate existing radial-velocity measurements into the orbital solution, obtaining improved masses of 3.05 +/- 0.24 M_Sun and 1.614 +/- 0.066 M_Sun that are consistent with the theoretical mass-luminosity relation from recent stellar evolution models. These mass determinations provide important information for the understanding of the nature of this peculiar class of stars.