Rail welded joints are a critical component of seamless railway tracks, and they are essential for maintaining the continuity and smoothness of the tracks. However, they also represent weak points in the entire track, which makes these areas susceptible to frequent damage and rail breaks. This study employs an impact wear testing platform with controlled energy to compare and analyse the impact wear characteristics of three different locations (i.e., weld zone, heat-affected zone and base material) on the U75VG flash-butt welding joint. Results indicate significant differences in material properties, such as hardness and microstructure, within different zones of the flash welded rail joints, which leads to varying impact damage behaviours. The heat-affected zones, which are located on both sides of the weld zone, exhibit the weakest ability to resist impact deformation. Thus, these areas are the most vulnerable in the entire welded rail joint and are prone to damages, such as squat. In general, damage in different zones of the welded joint gradually evolves from plastic deformation and local pitting into fatigue wear with delamination as the main failure mechanism, while the surface of the heat-affected zone tends to develop an oxide debris layer. The distinct damages observed in different zones of the welded joint pose challenges to the problem of track irregularities. This study offers a theoretical framework for predicting the evolution of damage in welded joints.