To investigate the effect of asphalt pavement layer temperature on the fatigue performance of welded details in orthotropic steel bridge deck (OSD), this study focuses on the critical fatigue crack regions of the rib-to-deck weld details. A systematic study was conducted based on the theory of linear elastic fracture mechanics (LEFM) and the finite element model (FEM). In this research, the elastic modulus of the pavement layer at different temperatures, and the initial crack shape, were considered as parameters. The maximum normal stress, stress intensity factor (SIF), and fatigue crack growth (FCG) shape and life of the weld details under the influence of these parameters were analyzed. The analysis results indicate that using a constant temperature of 20°C for the pavement layer will ignore the adverse effects of high summer temperatures. Under the influence of the pavement layer temperature effects, the weld toe of the top deck is the most critical welded detail. The FCG life and final crack shape at the weld toe of top deck are closely related to the effects of pavement layer temperature and the initial crack shape, higher pavement layer temperatures result in shorter fatigue life and larger final crack propagation sizes. Therefore, it is recommended that pavement layer and temperature effects be considered in the FCG analysis of welded details in OSDs.