Numerous phosphate glass systems with compositions covering the entire glass forming range have been examined by small angle X-ray scattering. The experiments were carried out in a widely extended interval of s values between 0.055 and 31 nm −1. A small angle scattering effect was detected for all samples investigated with the exception of the aluminium metaphosphate glass. The small angle scattering recorded indicates the presence of two differently-sized heterogeneity regions of electron density. The small-scale heterogeneities are present in magnesium and zinc phosphate glasses only. Their size is about 1 nm diameter in the magnesium and about 2 nm in the zinc phosphate glasses. The species do not result from liquid–liquid phase separation. Examinations to extract information on the nature of these heterogeneity regions are described in detail. There is no fundamental knowledge on the large-scale heterogeneities established. The small angle scattering suggests that their occurrence is related to water contamination. Anomalous small angle X-ray scattering experiments of a series of zinc polyphosphate glasses and a strontium metaphosphate glass sample are performed to examine the distribution of the Zn or Sr atoms, respectively.