We performed high-frequency (0.4–1.7 MHz) measurements of the internal friction (IF) on 14 bulk metallic glasses (MGs). It is found that 12 of these MGs display relaxation IF peaks at temperatures ≈ 400–500 K, which are weakly affected by heat treatment within the amorphous state. The corresponding relaxation time is about 0.3 μs. This fast relaxation is reported for the first time in the literature. The apparent activation enthalpy for 4 MGs is determined. It is shown that if measured at a low frequency of 1 Hz, these IF peaks would appear near room temperature or by 30–50 K below it. Thus, the IF peaks found in the present investigation are direct analogues of low-temperature/low-frequency β′- and/or γ-relaxations described in the literature. It is argued that the origin of these IF peaks is related to the relaxation of structural defects similar to dumbbell interstitials, which are frozen in solid glass from the liquid state upon melt quenching. These defects can be considered as elastic dipoles and their re-orientation in the applied stress provides anelastic deformation and corresponding IF peak. After correction for temperature dependence of the shear modulus, the true activation enthalpy (0.62–1.08 eV) and activation entropy (4 ≤ΔS∕kB≤15) for defect re-orientation are determined.