As a power generation fuel, high-pressure hydrogen gas is widely used in transportation, and significantly contributed to development of hydrogen fuel cell electric vehicles. However, obvious temperature rise generated during fast refueling causes serious safety risk to reliable operation of fuel cell stacks. Therefore, it is necessary to conduct in-depth research on fast filling process. Based on safety reasons, the SAE J2601/ISO 15869 strictly regulates the maximum temperature limit of 85 °C in specifications for refueling hydrogen gas tanks. In this study, a 70 MPa, Type IV on-board hydrogen storage tank is adopted as the research object, and a 2-dimensional axisymmetric numerical model is established to study the temperature rise of the vapor within storage tanks during fast refueling. The Realizable k-ε turbulence model is employed to simulate high intensity turbulent fluctuation during fast filling. Considering the compressibility of vapor, the state of equation for real hydrogen gas is used by obtaining fluid thermodynamic properties from the National Institute of Standards and Technology database. Three groups of fast filling experiments are selected to validate the developed numerical model. The comparison result shows that the numerical model has good prediction ability on hydrogen fast refueling. The final mass average temperature differences between numerical results and experimental data are 2.6 K, 4.3 K, and 0.03 K, respectively. Based on the developed numerical model, the influences of structure parameters and material properties on the temperature rise of hydrogen storage tanks are investigated. The results indicate that the inlet diameter and wall thickness of the inner and outer layers of the storage tank have weaken impacts on the temperature rise during rapid charging, with the maximum temperature differences of 1.8 K, 0.74 K, and 0.54 K, respectively. Due to the influence of heat capacity, the material properties of different layers exhibit a similar variation trend. This work can deepen researchers' understanding of the temperature rise of on-board hydrogen storage tanks during fast filling, and provide technical references for the structural optimal design of tanks and rapid refueling at hydrogen stations.