Overall fatigue strengths and hardness distributions of the aluminum alloy similar and dissimilar friction stir welding (FSW) joints were determined. The local fatigue strengths as well as local tensile strengths were also obtained by using small round bar specimens extracted from specific locations, such as the stir zone, heat affected zone, and base metal. It was found from the results that fatigue fracture of the FSW joint plate specimen occurred at the location of the lowest local fatigue strength as well as the lowest hardness, regardless of microstructural evolution. To estimate the fatigue strengths of aluminum alloy FSW joints from the hardness measurements, the relationship between fatigue strength and hardness for aluminum alloys was investigated based on the present experimental results and the available wide range of data from the references. It was found as: σa (R = −1) = 1.68 HV (σa is in MPa and HV has no unit). It was also confirmed that the estimated fatigue strengths were in good agreement with the experimental results for aluminum alloy FSW joints.